-- Logs begin at Wed 2021-10-27 15:03:41 UTC, end at Wed 2021-10-27 16:28:12 UTC. -- Oct 27 15:34:03.594193 dv-cinder-800703-2-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Oct 27 15:34:03.604292 dv-cinder-800703-2-iscsi devstack@n-api.service[107257]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Oct 27 15:34:03.605442 dv-cinder-800703-2-iscsi devstack@n-api.service[107257]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Oct 27 15:34:03 2021] *** Oct 27 15:34:03.605442 dv-cinder-800703-2-iscsi devstack@n-api.service[107257]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Oct 27 15:34:03.605442 dv-cinder-800703-2-iscsi devstack@n-api.service[107257]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Oct 27 15:34:03.605442 dv-cinder-800703-2-iscsi devstack@n-api.service[107257]: nodename: dv-cinder-800703-2-iscsi Oct 27 15:34:03.605442 dv-cinder-800703-2-iscsi devstack@n-api.service[107257]: machine: x86_64 Oct 27 15:34:03.605442 dv-cinder-800703-2-iscsi devstack@n-api.service[107257]: clock source: unix Oct 27 15:34:03.605442 dv-cinder-800703-2-iscsi devstack@n-api.service[107257]: pcre jit disabled Oct 27 15:34:03.605442 dv-cinder-800703-2-iscsi devstack@n-api.service[107257]: detected number of CPU cores: 4 Oct 27 15:34:03.605442 dv-cinder-800703-2-iscsi devstack@n-api.service[107257]: current working directory: / Oct 27 15:34:03.605442 dv-cinder-800703-2-iscsi devstack@n-api.service[107257]: detected binary path: /usr/bin/uwsgi-core Oct 27 15:34:03.605442 dv-cinder-800703-2-iscsi devstack@n-api.service[107257]: your processes number limit is 47680 Oct 27 15:34:03.606107 dv-cinder-800703-2-iscsi devstack@n-api.service[107257]: your memory page size is 4096 bytes Oct 27 15:34:03.606107 dv-cinder-800703-2-iscsi devstack@n-api.service[107257]: detected max file descriptor number: 2048 Oct 27 15:34:03.606107 dv-cinder-800703-2-iscsi devstack@n-api.service[107257]: lock engine: pthread robust mutexes Oct 27 15:34:03.606107 dv-cinder-800703-2-iscsi devstack@n-api.service[107257]: thunder lock: enabled Oct 27 15:34:03.606107 dv-cinder-800703-2-iscsi devstack@n-api.service[107257]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Oct 27 15:34:03.606107 dv-cinder-800703-2-iscsi devstack@n-api.service[107257]: Python version: 3.8.10 (default, Sep 28 2021, 16:10:42) [GCC 9.3.0] Oct 27 15:34:03.650180 dv-cinder-800703-2-iscsi devstack@n-api.service[107257]: Python main interpreter initialized at 0x562a79c089c0 Oct 27 15:34:03.650180 dv-cinder-800703-2-iscsi devstack@n-api.service[107257]: python threads support enabled Oct 27 15:34:03.650180 dv-cinder-800703-2-iscsi devstack@n-api.service[107257]: your server socket listen backlog is limited to 100 connections Oct 27 15:34:03.650180 dv-cinder-800703-2-iscsi devstack@n-api.service[107257]: your mercy for graceful operations on workers is 90 seconds Oct 27 15:34:03.650544 dv-cinder-800703-2-iscsi devstack@n-api.service[107257]: mapped 403077 bytes (393 KB) for 2 cores Oct 27 15:34:03.650635 dv-cinder-800703-2-iscsi devstack@n-api.service[107257]: *** Operational MODE: preforking *** Oct 27 15:34:03.650845 dv-cinder-800703-2-iscsi devstack@n-api.service[107257]: *** uWSGI is running in multiple interpreter mode *** Oct 27 15:34:03.650845 dv-cinder-800703-2-iscsi devstack@n-api.service[107257]: spawned uWSGI master process (pid: 107257) Oct 27 15:34:03.651031 dv-cinder-800703-2-iscsi systemd[1]: Started Devstack devstack@n-api.service. Oct 27 15:34:03.652392 dv-cinder-800703-2-iscsi devstack@n-api.service[107257]: spawned uWSGI worker 1 (pid: 107258, cores: 1) Oct 27 15:34:03.652392 dv-cinder-800703-2-iscsi devstack@n-api.service[107257]: spawned uWSGI worker 2 (pid: 107259, cores: 1) Oct 27 15:34:03.652392 dv-cinder-800703-2-iscsi devstack@n-api.service[107257]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Oct 27 15:34:05.299637 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 27 15:34:05.299637 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: from cryptography.utils import int_from_bytes Oct 27 15:34:05.300451 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 27 15:34:05.300451 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: from cryptography.utils import int_from_bytes Oct 27 15:34:05.300451 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 27 15:34:05.300451 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: from cryptography.utils import int_from_bytes Oct 27 15:34:05.301068 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 27 15:34:05.301068 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: from cryptography.utils import int_from_bytes Oct 27 15:34:07.902764 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 27 15:34:07.903395 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 27 15:34:07.903494 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 27 15:34:07.903707 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 27 15:34:07.904103 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 27 15:34:07.904202 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 27 15:34:07.904292 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 27 15:34:07.904454 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 27 15:34:07.904551 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:34:07.904778 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:34:07.904877 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 27 15:34:07.905065 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 27 15:34:07.905163 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:34:07.905406 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:34:07.905497 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:34:07.905736 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:34:07.905830 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:34:07.906048 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:34:07.906138 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:34:07.906375 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:34:07.906465 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:34:07.906687 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:34:07.906775 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:34:07.907009 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:34:07.907101 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:34:07.907266 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:34:07.907405 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:34:07.907579 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:34:07.907712 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:34:07.907941 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-800703-2-iscsi {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:34:07.908081 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:34:07.908240 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:34:07.908374 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:34:07.908531 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:34:07.908661 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:34:07.908855 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:34:07.908986 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-800703-2-iscsi {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:34:07.909173 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:34:07.909314 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:34:07.909477 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:34:07.909609 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:34:07.909786 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:34:07.909917 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:34:07.910096 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:34:07.910220 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:34:07.910400 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:34:07.910606 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:34:07.910757 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:34:07.911741 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:34:07.911908 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:34:07.911908 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:34:07.912152 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:34:07.912300 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:34:07.913015 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:34:07.913158 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:34:07.913355 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:34:07.913509 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:34:07.913629 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:34:07.913737 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:34:07.913846 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:34:07.913960 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:34:07.914065 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:34:07.914171 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:34:07.914279 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:34:07.914393 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:34:07.914512 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:34:07.914626 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:34:07.914735 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:34:07.914917 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-800703-2-iscsi {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:34:07.915047 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:34:07.915203 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:34:07.915324 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:34:07.915517 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:34:07.915634 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-800703-2-iscsi {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:34:07.915832 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:34:07.915980 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:34:07.916261 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:34:07.916405 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:34:07.916581 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:34:07.916783 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:34:07.916968 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:34:07.917168 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:34:07.917354 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:34:07.917545 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:34:07.917725 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:34:07.917881 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:34:07.918091 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:34:07.918286 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:34:07.918529 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:34:07.918734 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:34:07.918924 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:34:07.919105 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:34:07.919296 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:34:07.920153 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:34:07.920294 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:34:07.920426 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:34:07.920590 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:34:07.920718 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:34:07.920845 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:34:07.920984 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:34:07.921107 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:34:07.921258 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:34:07.921389 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:34:07.921510 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:34:07.921635 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:34:07.921841 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:34:07.921974 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:34:07.922096 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:34:07.922222 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:34:07.922349 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:34:07.922477 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:34:07.922666 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:34:07.922791 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:34:07.922917 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:34:07.923038 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:34:07.923164 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:34:07.923284 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:34:07.923420 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:34:07.923548 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:34:07.923676 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:34:07.923796 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:34:07.923942 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:34:07.924079 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:34:07.924207 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:34:07.924329 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:34:07.924457 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:34:07.924584 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:34:07.924717 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:34:07.924838 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:34:07.924972 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:34:07.925162 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:34:07.925293 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:34:07.925415 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:34:07.925545 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:34:07.925676 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:34:07.925797 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:34:07.925922 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:34:07.926043 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:34:07.926174 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:34:07.926296 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:34:07.926415 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:34:07.926540 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:34:07.926666 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:34:07.926786 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:34:07.926914 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:34:07.927041 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:34:07.927162 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:34:07.927287 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:34:07.927414 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:34:07.927535 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:34:07.927663 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:34:07.927785 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:34:07.927994 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.64 {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:34:07.928129 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:34:07.928251 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.64 {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:34:07.928371 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:34:07.928504 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:34:07.928625 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.64 {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:34:07.928756 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:34:07.928883 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.64 {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:34:07.929003 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:34:07.929128 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:34:07.929257 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:34:07.929375 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:34:07.929495 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:34:07.929614 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:34:07.929734 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:34:07.929901 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:34:07.930027 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:34:07.930224 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:34:07.930355 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:34:07.930548 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:34:07.930673 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:34:07.930858 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:34:07.930984 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:34:07.931173 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:34:07.931297 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:34:07.931483 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:34:07.931608 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:34:07.931739 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:34:07.931881 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:34:07.932054 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:34:07.932190 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:34:07.932362 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:34:07.932493 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:34:07.932680 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:34:07.932806 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:34:07.932983 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:34:07.933106 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:34:07.933287 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:34:07.933422 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:34:07.933592 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:34:07.933717 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:34:07.933892 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:34:07.934023 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:34:07.934197 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:34:07.934329 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:34:07.934500 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:34:07.934624 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:34:07.934801 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:34:07.934924 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:34:07.935101 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:34:07.935313 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:34:07.935439 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:34:07.935566 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:34:07.935687 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:34:07.935814 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:34:07.936022 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:34:07.936160 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:34:07.936325 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:34:07.936449 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:34:07.936631 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:34:07.936761 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:34:07.936944 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:34:07.937079 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:34:07.937254 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:34:07.937378 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:34:07.937557 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:34:07.937681 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:34:07.937862 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:34:07.937988 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:34:07.938164 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:34:07.938296 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:34:07.938470 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:34:07.938603 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:34:07.938774 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:34:07.938905 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:34:07.939080 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:34:07.939204 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:34:07.939385 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:34:07.939517 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:34:07.939704 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:34:07.939836 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:34:07.940041 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:34:07.940179 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:34:07.940346 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:34:07.940478 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:34:07.940664 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:34:07.940799 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:34:07.940969 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:34:07.941094 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:34:07.941276 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:34:07.941407 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:34:07.941593 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:34:07.941726 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:34:07.941893 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:34:07.942018 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:34:07.942196 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:34:07.942331 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:34:07.942512 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:34:07.942638 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:34:07.942817 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:34:07.942943 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:34:07.943121 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:34:07.943246 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:34:07.943430 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:34:07.943557 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:34:07.943751 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:34:07.943906 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:34:07.944080 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:34:07.944205 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:34:07.944385 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:34:07.944513 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:34:07.944688 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:34:07.944814 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:34:07.944990 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:34:07.945124 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:34:07.945358 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:34:07.945502 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:34:07.945631 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:34:07.945753 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:34:07.945915 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:34:07.946049 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:34:07.946220 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:34:07.946344 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:34:07.946525 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:34:07.946656 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:34:07.946829 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:34:07.947037 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:34:07.947161 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:34:07.947282 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:34:07.947447 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:34:07.947571 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:07.947756 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:34:07.947913 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:07.948103 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:34:07.948230 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:07.948443 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:07.948570 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:07.948776 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:07.948913 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:07.949107 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:07.949237 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:07.949423 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:07.949544 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:07.949778 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:07.949911 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:07.950054 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:07.950179 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:07.950383 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:07.950516 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:07.950696 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:07.950823 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:07.951010 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:07.951135 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:07.951322 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:07.951456 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:07.951641 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:07.951787 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:07.951986 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:07.952124 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:07.952305 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:07.952443 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:07.952621 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:07.952745 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:07.952939 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:07.953078 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:07.953260 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:07.953395 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:07.953574 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:07.953705 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:07.953892 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:07.954024 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:07.954216 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:07.954350 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:07.954534 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:07.954659 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:07.954843 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:07.954969 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:07.955174 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:07.955306 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:07.955508 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:07.955654 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:07.955815 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:07.955930 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:07.956165 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:07.956270 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:07.956479 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:07.956568 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:07.956802 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:07.956891 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:07.957116 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:07.957212 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:07.957430 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:07.957525 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:07.957744 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:07.957832 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:07.958060 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:07.958149 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:07.958375 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:07.958467 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:07.958689 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:07.958777 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:07.959021 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:07.959109 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:07.959935 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:07.960086 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:07.960313 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:07.960443 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:07.960658 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:07.960801 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:07.960965 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:07.961105 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:07.961274 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:07.961420 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:07.961569 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:07.961701 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:07.961882 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:07.962015 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:07.962189 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:07.962329 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:07.962507 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:07.962646 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:07.962814 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:07.962945 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:07.963137 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:07.963276 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:07.963447 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:07.963580 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:07.963761 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:07.963939 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:07.964100 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:07.964198 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:07.964408 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:07.964500 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:07.964722 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:07.964808 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:07.965035 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:07.965127 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:07.965341 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:07.965426 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:07.965659 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:07.965756 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:07.965965 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:07.966051 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:07.966274 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:07.966364 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:07.966596 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:07.966686 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:07.966904 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:07.966991 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:07.967210 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:07.967306 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:07.967527 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:07.967612 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:07.967836 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:07.967952 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:07.968166 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:07.968251 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:07.968482 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:07.968576 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:07.968794 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:07.968878 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:07.969109 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:07.969193 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:07.969421 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:07.969518 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:07.969745 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:07.969847 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:07.970068 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:07.970189 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:07.970379 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:07.970553 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:07.970766 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:07.970863 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:07.971091 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:07.971194 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:07.971399 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:07.971504 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:07.971703 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:07.971801 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:07.972042 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:07.972141 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:07.972350 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:07.972441 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:07.972659 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:07.972748 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:07.972966 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:07.973053 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:07.973273 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:07.973369 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:07.973576 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:07.973661 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:07.973881 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:07.973966 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:07.974186 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:07.974273 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:07.974493 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:07.974589 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:07.974895 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:07.975522 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:07.975745 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:07.975907 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:07.976161 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:07.976250 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:07.976475 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:07.976561 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:07.976805 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:07.976895 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:07.977115 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:07.977207 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:07.977423 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:07.977522 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:07.977733 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:07.977820 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:07.978050 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:07.978226 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:07.978393 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:07.978533 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:07.978703 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:07.978829 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:07.979026 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:07.979152 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:07.979342 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:07.979476 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:07.979659 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:07.979792 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:07.979997 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:07.980141 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:07.980375 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:07.980513 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:07.980635 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:07.980756 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:07.980917 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:07.981043 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:07.981233 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:07.981357 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:07.981545 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:07.981679 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:07.981864 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:07.981993 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:07.982173 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:07.982307 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:07.982489 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:07.982612 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:07.982797 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:07.983185 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:07.983374 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:07.983499 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:07.983680 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:07.983804 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:07.984023 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:07.984149 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:07.984344 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:07.984469 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:07.984654 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:07.984788 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:07.984973 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:07.985110 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:07.985299 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:07.985423 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:07.985612 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:07.985738 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:07.985938 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:07.986071 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:07.986226 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:07.986353 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:07.986538 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:07.986673 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:07.986851 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:07.986985 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:07.987161 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:07.987304 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:07.987474 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:07.987606 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:07.987786 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:07.988019 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:07.988146 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:07.988264 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:07.988436 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:07.988561 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:07.988752 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:07.988894 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:07.989076 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:07.989199 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:07.989391 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:07.989525 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:07.989696 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:07.990018 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:07.990376 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:07.990916 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:07.991236 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:07.991554 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:07.991897 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:07.992115 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:07.992252 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:07.992462 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:07.992594 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:07.992811 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:07.993120 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:07.993428 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:07.993741 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:07.994056 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:07.994370 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:07.994684 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:07.994967 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:07.995094 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:07.995294 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:07.995604 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:07.995979 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:07.996240 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:07.996556 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:07.996882 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:07.997197 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:07.997470 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:07.997596 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:07.997823 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:07.997951 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:07.998127 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:07.998251 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:07.998433 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:07.998565 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:07.998760 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:07.998892 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:07.999071 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:07.999208 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:07.999379 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:07.999510 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:07.999687 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:07.999814 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.000025 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.000152 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.000374 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.000526 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.000687 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.000812 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.000995 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.001121 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.001319 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.001457 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.001642 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.001773 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.001953 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.002080 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.002268 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.002401 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.002579 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.002704 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.002888 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.003014 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.003202 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.003338 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.003515 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.003698 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.003827 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.004012 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.004214 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.004338 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.004458 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.004578 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.004758 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.004884 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.005070 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.005197 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.005395 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.005521 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.005706 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.005830 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.006092 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.006227 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.006350 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.006477 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.006672 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.006796 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.006985 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.007112 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.007298 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.007425 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.007609 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.007947 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.008076 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.008286 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.008412 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.008601 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.008723 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.008923 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.009048 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.009245 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.009371 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.009562 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.009693 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.009883 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.010010 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.010201 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.010333 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.010517 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.010635 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.010826 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.010951 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.011140 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.011264 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.011449 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.011583 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.011757 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.011912 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.012099 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.012233 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.012407 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.012540 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.012716 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.012841 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.013025 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.013149 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.013339 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.013473 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.013644 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.013769 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.013952 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.014077 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.014259 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.014394 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.014575 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.014708 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.014893 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.015030 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.015199 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.015460 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.015597 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.015802 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.015951 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.016195 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.016328 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.016450 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.016588 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.016754 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.016886 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.017065 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.017190 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.017377 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.017510 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.017720 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.017847 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.018028 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.018155 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.018346 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.018470 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.018663 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.018795 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.018977 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.019102 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.019290 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.019422 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.019582 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.019705 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.019931 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.020076 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.020245 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.020371 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.020550 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.020675 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.020855 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.020990 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.021163 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.021294 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.021471 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.021602 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.022318 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.022467 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.022659 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.022784 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.022975 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.023111 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.023290 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.023414 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.023604 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.023729 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.023934 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.024061 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.024250 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.024376 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.024558 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.024685 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.024875 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.025000 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.025186 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.025311 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.025492 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.025624 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.025797 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.025923 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.026109 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.026262 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.026458 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.026584 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.026705 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.026826 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.027009 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.027146 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.027314 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.027446 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.027632 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.027764 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.027962 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.028100 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.028269 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.028396 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.028575 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.028701 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.028888 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.029091 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.029228 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.029351 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.029479 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.029607 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.029802 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.029929 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.030115 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.030247 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.030422 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.030554 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.030735 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.030861 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.031042 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.031177 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.031346 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.031473 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.031649 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.031776 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.031984 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.032111 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.032303 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.032427 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.032618 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.032750 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.032920 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.033044 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.033223 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.033355 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.033527 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.033658 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.033834 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.033959 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.034140 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.034273 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.034449 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.034575 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.034753 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.034884 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.035057 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.035191 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.035361 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.035493 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.035664 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.035789 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.035989 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.036131 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.036303 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.036441 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.036628 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.036753 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.036887 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.037016 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.037197 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.037373 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.038183 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.038349 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.038534 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.038662 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.038843 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.038976 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.039205 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.039338 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.039516 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.039642 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.039827 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.039973 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.040166 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.040293 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.040478 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.040610 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.040799 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.040918 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.041115 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.041250 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.041422 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.041548 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.041741 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.041866 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.042055 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.042188 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.042371 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.042496 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.042676 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.042802 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.042982 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.043118 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.043298 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.043424 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.043607 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.043732 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.043936 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.044081 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.044247 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.044373 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.044575 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.044707 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.044889 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.045027 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.045193 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.045324 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.045502 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.045626 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.045810 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.045937 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.046119 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.046251 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.046429 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.046554 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.046762 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.046889 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.047037 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.047171 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.047351 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.047477 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.047664 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.047790 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.048000 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.048127 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.048314 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.048450 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.048622 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.048749 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.048932 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.049057 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.049243 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.049378 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.049548 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.049673 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.049864 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.049987 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.050171 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.050311 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.050473 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.050597 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.050788 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.050914 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.051095 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.051228 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.051405 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.051537 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.051710 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.051835 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.052067 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.052201 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.052402 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.052527 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.052709 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.052841 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.053053 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.053232 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.053358 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.053480 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.053664 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.053792 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.053977 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.054109 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.054292 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.054417 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.054599 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.054724 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.054916 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.055040 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.055231 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.055357 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.055544 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.055670 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.055886 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.056022 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.056202 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.056304 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.056517 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.056627 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.056833 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.056931 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.057143 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.057240 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.057449 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.057554 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.057757 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.057854 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.058063 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.058163 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.058374 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.058548 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.058682 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.058818 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.059000 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.059124 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.059309 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.059443 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.059714 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.059839 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.060046 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.060173 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.060371 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.060496 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.060683 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.060817 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.061001 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.061155 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.061318 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.061444 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.061640 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.061765 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.061958 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.062083 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.062266 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.062392 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.062589 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.062713 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.062900 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.063026 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.063226 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.063352 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.063552 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.063677 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.063883 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.064025 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.064204 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.064329 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.064512 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.064645 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.064837 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.064972 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.065144 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.065275 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.065455 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.065581 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.065763 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.065897 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.066091 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.066217 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.066401 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.066527 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.066727 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.066880 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.067075 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.067206 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.067406 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.067538 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.067714 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.067841 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.068049 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.068176 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.068362 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.068992 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.069186 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.069411 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.069536 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.069747 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.069872 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.070079 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.070214 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.070400 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.070525 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.070711 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.070834 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.071026 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.071164 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.071334 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.071472 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.071642 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.071774 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.071988 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.072123 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.072298 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.072434 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.072617 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.072741 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.072929 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.073059 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.073254 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.073381 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.073578 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.073709 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.073886 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.074012 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.074210 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.074341 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.074518 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.074649 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.074826 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.074952 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.075132 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.075259 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.075439 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.075565 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.075784 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.075943 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.076118 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.076245 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.076440 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.076568 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.076773 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.076914 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.077097 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.077212 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.077407 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.077506 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.077732 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.077839 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.078056 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.078175 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.078355 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.078456 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.078669 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.078777 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.078983 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.079080 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.079285 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.079381 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.079587 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.079699 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.079918 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.080031 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.080225 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.080314 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.080529 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.080626 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.080834 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.080923 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.081150 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.081246 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.081456 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.081558 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.081759 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.081855 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.082065 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.082154 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.082387 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.082482 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.082687 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.082774 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.082997 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.083083 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.083310 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.083414 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.083622 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.083722 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.083947 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.084104 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.084853 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.084989 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.085115 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.085301 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.085525 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.085736 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.085871 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.086000 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.086123 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.086254 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.086378 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.086583 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.086755 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.086889 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.087013 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.087218 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.087326 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.087554 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.087654 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.087881 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.087982 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.088197 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.088308 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.088513 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.088610 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.088823 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.088920 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.089135 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.089242 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.089451 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.089549 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.089763 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.089869 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.090071 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.090180 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.090382 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.090479 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.090695 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.090792 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.091029 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.091219 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.091319 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.091550 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.091684 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.091876 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.092026 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.092200 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.092327 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.092515 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.092641 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.092831 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.092964 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.093147 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.093274 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.093460 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.093593 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.093773 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.093908 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.094086 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.094212 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.094399 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.094525 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.094729 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.094855 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.095050 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.095176 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.095378 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.095510 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.095697 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.095823 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.096044 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.096172 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.096358 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.096491 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.096677 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.096805 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.096994 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.097117 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.097321 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.097438 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.097644 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.097745 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.097951 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.098056 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.098268 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.098378 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.098582 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.098680 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.098899 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.098997 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.099214 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.099430 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.099529 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.099799 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.099987 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.100164 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.100325 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.100466 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.100605 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.100790 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.100929 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.101110 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.101257 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.101429 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.101597 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.101736 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.101822 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.102053 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.102155 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.102371 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.102460 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.102683 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.102770 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.103000 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.103090 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.103318 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.103413 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.103649 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.103913 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.104087 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.104179 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.104413 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.104508 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.104736 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.104863 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.105056 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.105157 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.105378 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.105478 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.105718 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.105818 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.106045 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.106134 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.106352 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.106447 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.106661 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.106826 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.106976 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.107064 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.107288 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.107375 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.107594 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.107694 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.108189 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.108298 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.108514 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.108601 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.108822 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.108913 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.109142 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.109230 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.109449 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.109536 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.109768 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.109985 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.110074 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.110339 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.110426 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.110658 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.110755 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.110993 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.111082 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.111323 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.111411 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.111643 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.111743 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.111975 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.112066 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.112304 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.112500 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.112601 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.112823 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.112912 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.113164 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.113260 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.113496 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.113592 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.113807 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.113953 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.114113 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.114201 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.114425 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.114591 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.114737 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.114841 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.115042 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.115138 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.115355 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.115478 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.115716 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.115894 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.116064 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.116204 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.116350 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.116488 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.116661 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.116842 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.117006 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.117142 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.117286 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.117439 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.117658 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.117800 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.117935 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.118079 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.118222 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.118409 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.118553 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.118738 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.118896 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.119102 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.119252 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.119395 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.119532 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.119673 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.119815 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.120007 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.120145 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.120285 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.120421 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.120555 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.120689 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.120835 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.120971 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.121149 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.121291 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.121455 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.121605 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.121749 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.121920 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.122057 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.122228 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.122366 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.122499 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.122670 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.122820 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.122985 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.123133 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.123300 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.123450 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.123630 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.123771 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.123971 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.124115 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.124261 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.124490 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.124634 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.124869 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.125009 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.125179 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.125321 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.125496 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.125639 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.125806 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.125950 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.126115 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.126257 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.126429 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.126572 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.126737 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.126886 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.127052 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.127201 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.127361 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.127502 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.127655 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.127888 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.128044 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.128191 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.128327 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.128460 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.128600 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.128735 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.128869 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.129012 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.129179 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.129321 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.129493 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.129636 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.129801 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.129952 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.130109 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.130250 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.130430 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.130571 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.130744 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.130887 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.131588 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.131734 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.131915 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.132103 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.132257 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.132400 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.132546 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.132679 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.132837 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.132979 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.133148 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.133392 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.133535 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.133772 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.133914 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.134086 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.134230 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.134398 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.134562 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.134761 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.134901 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.135071 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.135215 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.135386 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.135528 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.135699 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.135842 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.136049 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.136185 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.136347 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.136490 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.136664 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.136816 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.136979 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.137121 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.137295 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.137445 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.137611 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.137760 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.137982 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.138123 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.138258 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.138393 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.138537 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.138684 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.138819 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.138953 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.139157 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.139300 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.139483 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.139632 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.139790 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.139964 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.140116 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.140253 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.140441 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.140584 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.140755 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.140896 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.141072 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.141213 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.141385 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.141535 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.141697 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.141839 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.142006 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.142148 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.142330 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.142487 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.142654 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.142796 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.142975 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.143125 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.143288 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.143430 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.143622 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.143765 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.143960 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.144181 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.144329 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.144478 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.144620 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.144759 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.144893 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.145040 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.145176 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.145310 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.145475 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.145623 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.145804 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.145947 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.146132 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.146274 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.146441 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.146583 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.147368 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.147550 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.147687 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.147824 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.148082 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.148232 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.148381 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.148517 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.148658 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.148793 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.149076 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.149227 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.149363 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.149497 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.149631 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.149763 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.149897 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.150040 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.150176 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.150310 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.150489 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.150631 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.150810 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.150971 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.151113 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.151247 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.151432 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.151580 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.151758 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.151945 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.152090 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.152231 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.152406 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.152559 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.152745 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.152944 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.153090 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.153225 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.153359 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.153492 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.153639 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=107259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 27 15:34:08.153773 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.153970 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.154288 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.154606 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.154941 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.155273 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.155586 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.155937 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.156263 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.156590 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.156910 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.157228 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.157562 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.157878 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.158200 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.158514 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.158834 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.159187 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.159551 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.159934 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.160270 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.160602 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.160935 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.161289 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.161610 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.161957 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.162348 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:34:08.162671 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=107258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 27 15:34:08.175878 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG oslo_db.sqlalchemy.engines [None req-d8e9d45e-cb15-48be-b44a-dbc12184143f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=107259) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 27 15:34:08.184379 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG oslo_db.sqlalchemy.engines [None req-819a31d3-c544-41de-b8b7-c6e3d66c9170 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=107258) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 27 15:34:08.350746 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.context [None req-d8e9d45e-cb15-48be-b44a-dbc12184143f None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),c943b248-24a3-4c90-8911-04b0b8d5cf35(cell1) {{(pid=107259) load_cells /opt/stack/nova/nova/context.py:464}} Oct 27 15:34:08.355299 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG oslo_concurrency.lockutils [None req-d8e9d45e-cb15-48be-b44a-dbc12184143f None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:34:08.356945 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG oslo_concurrency.lockutils [None req-d8e9d45e-cb15-48be-b44a-dbc12184143f None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:34:08.357758 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG oslo_concurrency.lockutils [None req-d8e9d45e-cb15-48be-b44a-dbc12184143f None None] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:34:08.359952 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG oslo_concurrency.lockutils [None req-d8e9d45e-cb15-48be-b44a-dbc12184143f None None] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:34:08.369091 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.context [None req-819a31d3-c544-41de-b8b7-c6e3d66c9170 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),c943b248-24a3-4c90-8911-04b0b8d5cf35(cell1) {{(pid=107258) load_cells /opt/stack/nova/nova/context.py:464}} Oct 27 15:34:08.371340 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG oslo_db.sqlalchemy.engines [None req-d8e9d45e-cb15-48be-b44a-dbc12184143f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=107259) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 27 15:34:08.373578 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG oslo_concurrency.lockutils [None req-819a31d3-c544-41de-b8b7-c6e3d66c9170 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:34:08.373745 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG oslo_db.sqlalchemy.engines [None req-d8e9d45e-cb15-48be-b44a-dbc12184143f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=107259) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 27 15:34:08.375182 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG oslo_concurrency.lockutils [None req-819a31d3-c544-41de-b8b7-c6e3d66c9170 None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:34:08.376024 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG oslo_concurrency.lockutils [None req-819a31d3-c544-41de-b8b7-c6e3d66c9170 None None] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:34:08.377962 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG oslo_concurrency.lockutils [None req-819a31d3-c544-41de-b8b7-c6e3d66c9170 None None] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:34:08.390384 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG oslo_db.sqlalchemy.engines [None req-819a31d3-c544-41de-b8b7-c6e3d66c9170 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=107258) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 27 15:34:08.392822 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG oslo_db.sqlalchemy.engines [None req-819a31d3-c544-41de-b8b7-c6e3d66c9170 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=107258) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 27 15:34:08.641973 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG oslo_db.sqlalchemy.engines [None req-d8e9d45e-cb15-48be-b44a-dbc12184143f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=107259) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 27 15:34:08.652645 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG oslo_db.sqlalchemy.engines [None req-819a31d3-c544-41de-b8b7-c6e3d66c9170 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=107258) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 27 15:34:08.981635 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: WARNING keystonemiddleware.auth_token [None req-d8e9d45e-cb15-48be-b44a-dbc12184143f None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 27 15:34:08.988408 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: WARNING keystonemiddleware.auth_token [None req-d8e9d45e-cb15-48be-b44a-dbc12184143f None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 27 15:34:08.990715 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: WARNING keystonemiddleware.auth_token [None req-819a31d3-c544-41de-b8b7-c6e3d66c9170 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 27 15:34:08.997350 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: WARNING keystonemiddleware.auth_token [None req-819a31d3-c544-41de-b8b7-c6e3d66c9170 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 27 15:34:09.338350 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: WARNING keystonemiddleware.auth_token [None req-d8e9d45e-cb15-48be-b44a-dbc12184143f None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 27 15:34:09.343626 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: WARNING keystonemiddleware.auth_token [None req-d8e9d45e-cb15-48be-b44a-dbc12184143f None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 27 15:34:09.349411 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: WARNING keystonemiddleware.auth_token [None req-819a31d3-c544-41de-b8b7-c6e3d66c9170 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 27 15:34:09.349996 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x562a79c089c0 pid: 107259 (default app) Oct 27 15:34:09.352011 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi [None req-d8e9d45e-cb15-48be-b44a-dbc12184143f None None] Calling method '>' {{(pid=107259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:34:09.353179 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: INFO nova.api.openstack.requestlog [None req-d8e9d45e-cb15-48be-b44a-dbc12184143f None None] 10.222.0.64 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001754 Oct 27 15:34:09.353597 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: [pid: 107259|app: 0|req: 1/1] 10.222.0.64 () {50 vars in 788 bytes} [Wed Oct 27 15:34:09 2021] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 15:34:09.354823 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: WARNING keystonemiddleware.auth_token [None req-819a31d3-c544-41de-b8b7-c6e3d66c9170 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 27 15:34:09.361488 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x562a79c089c0 pid: 107258 (default app) Oct 27 15:35:30.817691 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi [None req-d8e9d45e-cb15-48be-b44a-dbc12184143f None None] Calling method '>' {{(pid=107259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:35:30.819284 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: INFO nova.api.openstack.requestlog [None req-d8e9d45e-cb15-48be-b44a-dbc12184143f None None] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002036 Oct 27 15:35:30.819969 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: [pid: 107259|app: 0|req: 2/2] 10.222.0.64 () {54 vars in 930 bytes} [Wed Oct 27 15:35:30 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 15:35:31.270177 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi [None req-1508072f-4cef-4a30-a527-602549571eb5 admin admin] Calling method '>' {{(pid=107258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:35:31.299459 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: INFO nova.api.openstack.requestlog [None req-1508072f-4cef-4a30-a527-602549571eb5 admin admin] 10.222.0.64 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.471955 Oct 27 15:35:31.304109 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: [pid: 107258|app: 0|req: 1/3] 10.222.0.64 () {60 vars in 1291 bytes} [Wed Oct 27 15:35:30 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 15:35:33.600617 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi [None req-d8e9d45e-cb15-48be-b44a-dbc12184143f None None] Calling method '>' {{(pid=107259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:35:33.601606 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: INFO nova.api.openstack.requestlog [None req-d8e9d45e-cb15-48be-b44a-dbc12184143f None None] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001451 Oct 27 15:35:33.601995 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: [pid: 107259|app: 0|req: 3/4] 10.222.0.64 () {54 vars in 930 bytes} [Wed Oct 27 15:35:33 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 15:35:33.662143 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi [None req-8b1248a7-d5e3-4a57-9057-b4c4db79d1e3 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "ram": 256, "id": "c1", "disk": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "name": "cirros256", "vcpus": 1, "swap": 0}} {{(pid=107258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 15:35:33.682218 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-flavor-manage:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 27 15:35:33.682218 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: warnings.warn(msg) Oct 27 15:35:33.714314 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: INFO nova.api.openstack.requestlog [None req-8b1248a7-d5e3-4a57-9057-b4c4db79d1e3 admin admin] 10.222.0.64 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.103832 Oct 27 15:35:33.719903 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: [pid: 107258|app: 0|req: 2/5] 10.222.0.64 () {64 vars in 1282 bytes} [Wed Oct 27 15:35:33 2021] POST /compute/v2.1/flavors => generated 407 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 15:35:33.946464 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi [None req-c44b81f4-227a-4282-ae9b-f28a45525442 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=107259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 15:35:33.948916 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-flavor-extra-specs:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 27 15:35:33.948916 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: warnings.warn(msg) Oct 27 15:35:34.005547 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: INFO nova.api.openstack.requestlog [None req-c44b81f4-227a-4282-ae9b-f28a45525442 admin admin] 10.222.0.64 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.280408 Oct 27 15:35:34.006386 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: [pid: 107259|app: 0|req: 4/6] 10.222.0.64 () {64 vars in 1335 bytes} [Wed Oct 27 15:35:33 2021] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 15:35:36.366660 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi [None req-8b1248a7-d5e3-4a57-9057-b4c4db79d1e3 admin admin] Calling method '>' {{(pid=107258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:35:36.368393 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: INFO nova.api.openstack.requestlog [None req-8b1248a7-d5e3-4a57-9057-b4c4db79d1e3 admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002160 Oct 27 15:35:36.368919 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: [pid: 107258|app: 0|req: 3/7] 10.222.0.64 () {54 vars in 930 bytes} [Wed Oct 27 15:35:36 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 15:35:36.490793 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi [None req-5a69a59d-afbb-4d35-b6d8-fa7986aa70a3 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "os-flavor-access:is_public": true, "id": "d1", "rxtx_factor": 1.0, "swap": 0, "ram": 512, "disk": 5, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds512M"}} {{(pid=107259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 15:35:36.510707 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-flavor-manage:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 27 15:35:36.510707 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: warnings.warn(msg) Oct 27 15:35:36.531654 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: INFO nova.api.openstack.requestlog [None req-5a69a59d-afbb-4d35-b6d8-fa7986aa70a3 admin admin] 10.222.0.64 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.155330 Oct 27 15:35:36.532484 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: [pid: 107259|app: 0|req: 5/8] 10.222.0.64 () {64 vars in 1282 bytes} [Wed Oct 27 15:35:36 2021] POST /compute/v2.1/flavors => generated 404 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 15:35:36.545778 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi [None req-52ce11d2-7eb0-4992-b660-9e4e115d4105 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=107258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 15:35:36.547571 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-flavor-extra-specs:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 27 15:35:36.547571 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: warnings.warn(msg) Oct 27 15:35:36.580158 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: INFO nova.api.openstack.requestlog [None req-52ce11d2-7eb0-4992-b660-9e4e115d4105 admin admin] 10.222.0.64 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.038009 Oct 27 15:35:36.580970 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: [pid: 107258|app: 0|req: 4/9] 10.222.0.64 () {64 vars in 1335 bytes} [Wed Oct 27 15:35:36 2021] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 15:35:38.917431 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi [None req-5a69a59d-afbb-4d35-b6d8-fa7986aa70a3 admin admin] Calling method '>' {{(pid=107259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:35:38.918433 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: INFO nova.api.openstack.requestlog [None req-5a69a59d-afbb-4d35-b6d8-fa7986aa70a3 admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001836 Oct 27 15:35:38.918837 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: [pid: 107259|app: 0|req: 6/10] 10.222.0.64 () {54 vars in 930 bytes} [Wed Oct 27 15:35:38 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 15:35:38.990823 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi [None req-f5227b82-289c-442a-b905-f1d6003e27ef admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "os-flavor-access:is_public": true, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 10, "id": "d2", "name": "ds1G", "swap": 0, "rxtx_factor": 1.0}} {{(pid=107258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 15:35:39.011132 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: INFO nova.api.openstack.requestlog [None req-f5227b82-289c-442a-b905-f1d6003e27ef admin admin] 10.222.0.64 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.083376 Oct 27 15:35:39.019641 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: [pid: 107258|app: 0|req: 5/11] 10.222.0.64 () {64 vars in 1282 bytes} [Wed Oct 27 15:35:38 2021] POST /compute/v2.1/flavors => generated 404 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 15:35:39.024923 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi [None req-0c8cec03-dfd5-4dbb-a367-7baa9f17b078 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=107259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 15:35:39.053920 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: INFO nova.api.openstack.requestlog [None req-0c8cec03-dfd5-4dbb-a367-7baa9f17b078 admin admin] 10.222.0.64 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.034352 Oct 27 15:35:39.054824 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: [pid: 107259|app: 0|req: 7/12] 10.222.0.64 () {64 vars in 1335 bytes} [Wed Oct 27 15:35:39 2021] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 15:35:41.388473 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi [None req-f5227b82-289c-442a-b905-f1d6003e27ef admin admin] Calling method '>' {{(pid=107258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:35:41.389573 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: INFO nova.api.openstack.requestlog [None req-f5227b82-289c-442a-b905-f1d6003e27ef admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001586 Oct 27 15:35:41.390060 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: [pid: 107258|app: 0|req: 6/13] 10.222.0.64 () {54 vars in 930 bytes} [Wed Oct 27 15:35:41 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 15:35:41.448568 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi [None req-7bbd5ee2-0ba7-451b-a5bd-1498b297cfa0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "vcpus": 2, "id": "d3", "name": "ds2G", "swap": 0, "ram": 2048, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 10, "os-flavor-access:is_public": true}} {{(pid=107259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 15:35:41.465739 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: INFO nova.api.openstack.requestlog [None req-7bbd5ee2-0ba7-451b-a5bd-1498b297cfa0 admin admin] 10.222.0.64 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.068532 Oct 27 15:35:41.466282 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: [pid: 107259|app: 0|req: 8/14] 10.222.0.64 () {64 vars in 1282 bytes} [Wed Oct 27 15:35:41 2021] POST /compute/v2.1/flavors => generated 404 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 15:35:41.479244 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi [None req-bed9aa7f-bbf5-47c9-96e2-dbb469181f19 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=107258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 15:35:41.501407 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: INFO nova.api.openstack.requestlog [None req-bed9aa7f-bbf5-47c9-96e2-dbb469181f19 admin admin] 10.222.0.64 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.025986 Oct 27 15:35:41.501965 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: [pid: 107258|app: 0|req: 7/15] 10.222.0.64 () {64 vars in 1335 bytes} [Wed Oct 27 15:35:41 2021] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 15:35:43.841353 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi [None req-7bbd5ee2-0ba7-451b-a5bd-1498b297cfa0 admin admin] Calling method '>' {{(pid=107259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:35:43.842352 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: INFO nova.api.openstack.requestlog [None req-7bbd5ee2-0ba7-451b-a5bd-1498b297cfa0 admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001422 Oct 27 15:35:43.842757 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: [pid: 107259|app: 0|req: 9/16] 10.222.0.64 () {54 vars in 930 bytes} [Wed Oct 27 15:35:43 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 15:35:43.908802 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi [None req-a47078af-7dbc-45f0-bd20-cf5fbaadf895 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "vcpus": 4, "ram": 4096, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d4", "name": "ds4G", "disk": 20, "rxtx_factor": 1.0, "swap": 0}} {{(pid=107258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 15:35:43.931060 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: INFO nova.api.openstack.requestlog [None req-a47078af-7dbc-45f0-bd20-cf5fbaadf895 admin admin] 10.222.0.64 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.081206 Oct 27 15:35:43.931748 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: [pid: 107258|app: 0|req: 8/17] 10.222.0.64 () {64 vars in 1282 bytes} [Wed Oct 27 15:35:43 2021] POST /compute/v2.1/flavors => generated 404 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 15:35:43.944839 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi [None req-e8ce858d-8177-400c-bafc-c51cecfc9508 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=107259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 15:35:43.968586 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: INFO nova.api.openstack.requestlog [None req-e8ce858d-8177-400c-bafc-c51cecfc9508 admin admin] 10.222.0.64 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028058 Oct 27 15:35:43.969164 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: [pid: 107259|app: 0|req: 10/18] 10.222.0.64 () {64 vars in 1335 bytes} [Wed Oct 27 15:35:43 2021] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 15:35:46.301741 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi [None req-a47078af-7dbc-45f0-bd20-cf5fbaadf895 admin admin] Calling method '>' {{(pid=107258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:35:46.302745 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: INFO nova.api.openstack.requestlog [None req-a47078af-7dbc-45f0-bd20-cf5fbaadf895 admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001439 Oct 27 15:35:46.303162 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: [pid: 107258|app: 0|req: 9/19] 10.222.0.64 () {54 vars in 930 bytes} [Wed Oct 27 15:35:46 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 15:35:46.362571 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi [None req-be316dc3-447c-4b06-9c8c-33678aeb3f3b admin admin] Calling method '>' {{(pid=107259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:35:46.384951 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: INFO nova.api.openstack.requestlog [None req-be316dc3-447c-4b06-9c8c-33678aeb3f3b admin admin] 10.222.0.64 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.075077 Oct 27 15:35:46.385476 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: [pid: 107259|app: 0|req: 11/20] 10.222.0.64 () {60 vars in 1291 bytes} [Wed Oct 27 15:35:46 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 15:35:48.726133 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi [None req-a47078af-7dbc-45f0-bd20-cf5fbaadf895 admin admin] Calling method '>' {{(pid=107258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:35:48.727495 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: INFO nova.api.openstack.requestlog [None req-a47078af-7dbc-45f0-bd20-cf5fbaadf895 admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001957 Oct 27 15:35:48.728066 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: [pid: 107258|app: 0|req: 10/21] 10.222.0.64 () {54 vars in 930 bytes} [Wed Oct 27 15:35:48 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 15:35:48.787452 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi [None req-a544fd09-04a7-4fde-a806-5ff4dc9746a1 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "disk": 1, "ram": 512, "name": "m1.tiny", "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "id": "1", "vcpus": 1}} {{(pid=107259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 15:35:48.807455 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: INFO nova.api.openstack.requestlog [None req-a544fd09-04a7-4fde-a806-5ff4dc9746a1 admin admin] 10.222.0.64 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.072840 Oct 27 15:35:48.808061 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: [pid: 107259|app: 0|req: 12/22] 10.222.0.64 () {64 vars in 1282 bytes} [Wed Oct 27 15:35:48 2021] POST /compute/v2.1/flavors => generated 402 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 15:35:48.821305 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi [None req-d1373422-2587-450a-a78a-5352cacef2ab admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=107258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 15:35:48.842710 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: INFO nova.api.openstack.requestlog [None req-d1373422-2587-450a-a78a-5352cacef2ab admin admin] 10.222.0.64 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.025108 Oct 27 15:35:48.843258 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: [pid: 107258|app: 0|req: 11/23] 10.222.0.64 () {64 vars in 1332 bytes} [Wed Oct 27 15:35:48 2021] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 15:35:51.557318 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi [None req-a544fd09-04a7-4fde-a806-5ff4dc9746a1 admin admin] Calling method '>' {{(pid=107259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:35:51.558853 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: INFO nova.api.openstack.requestlog [None req-a544fd09-04a7-4fde-a806-5ff4dc9746a1 admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001465 Oct 27 15:35:51.559255 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: [pid: 107259|app: 0|req: 13/24] 10.222.0.64 () {54 vars in 930 bytes} [Wed Oct 27 15:35:51 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 15:35:51.619720 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi [None req-a08e9e4b-131f-429b-9969-29b67c577f03 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 20, "id": "2", "name": "m1.small", "swap": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "vcpus": 1, "ram": 2048, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=107258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 15:35:51.641176 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: INFO nova.api.openstack.requestlog [None req-a08e9e4b-131f-429b-9969-29b67c577f03 admin admin] 10.222.0.64 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.075174 Oct 27 15:35:51.641899 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: [pid: 107258|app: 0|req: 12/25] 10.222.0.64 () {64 vars in 1282 bytes} [Wed Oct 27 15:35:51 2021] POST /compute/v2.1/flavors => generated 405 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 27 15:35:51.654983 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi [None req-8b83df8b-f7e0-46bc-97eb-2a19e8677c50 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=107259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 15:35:51.677805 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: INFO nova.api.openstack.requestlog [None req-8b83df8b-f7e0-46bc-97eb-2a19e8677c50 admin admin] 10.222.0.64 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026534 Oct 27 15:35:51.678373 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: [pid: 107259|app: 0|req: 14/26] 10.222.0.64 () {64 vars in 1332 bytes} [Wed Oct 27 15:35:51 2021] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 15:35:53.997999 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi [None req-a08e9e4b-131f-429b-9969-29b67c577f03 admin admin] Calling method '>' {{(pid=107258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:35:53.998932 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: INFO nova.api.openstack.requestlog [None req-a08e9e4b-131f-429b-9969-29b67c577f03 admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001448 Oct 27 15:35:53.999347 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: [pid: 107258|app: 0|req: 13/27] 10.222.0.64 () {54 vars in 930 bytes} [Wed Oct 27 15:35:53 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 15:35:54.058343 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi [None req-317a4a67-dc2b-4352-8515-74dbc915a9a3 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 2, "os-flavor-access:is_public": true, "id": "3", "swap": 0, "rxtx_factor": 1.0, "name": "m1.medium", "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 4096, "disk": 40}} {{(pid=107259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 15:35:54.075607 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: INFO nova.api.openstack.requestlog [None req-317a4a67-dc2b-4352-8515-74dbc915a9a3 admin admin] 10.222.0.64 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.069419 Oct 27 15:35:54.076198 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: [pid: 107259|app: 0|req: 15/28] 10.222.0.64 () {64 vars in 1282 bytes} [Wed Oct 27 15:35:54 2021] POST /compute/v2.1/flavors => generated 406 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 15:35:54.089524 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi [None req-cc0feff0-4179-44be-81bd-9f05ffd626b8 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=107258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 15:35:54.112661 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: INFO nova.api.openstack.requestlog [None req-cc0feff0-4179-44be-81bd-9f05ffd626b8 admin admin] 10.222.0.64 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026736 Oct 27 15:35:54.113221 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: [pid: 107258|app: 0|req: 14/29] 10.222.0.64 () {64 vars in 1332 bytes} [Wed Oct 27 15:35:54 2021] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 15:35:56.429799 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi [None req-317a4a67-dc2b-4352-8515-74dbc915a9a3 admin admin] Calling method '>' {{(pid=107259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:35:56.430809 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: INFO nova.api.openstack.requestlog [None req-317a4a67-dc2b-4352-8515-74dbc915a9a3 admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001423 Oct 27 15:35:56.431201 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: [pid: 107259|app: 0|req: 16/30] 10.222.0.64 () {54 vars in 930 bytes} [Wed Oct 27 15:35:56 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 15:35:56.501534 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi [None req-0372b1a3-a777-44ef-a4d5-8478325f52fa admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 8192, "rxtx_factor": 1.0, "id": "4", "vcpus": 4, "os-flavor-access:is_public": true, "swap": 0, "name": "m1.large", "disk": 80, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=107258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 15:35:56.525116 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: INFO nova.api.openstack.requestlog [None req-0372b1a3-a777-44ef-a4d5-8478325f52fa admin admin] 10.222.0.64 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.087604 Oct 27 15:35:56.525816 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: [pid: 107258|app: 0|req: 15/31] 10.222.0.64 () {64 vars in 1282 bytes} [Wed Oct 27 15:35:56 2021] POST /compute/v2.1/flavors => generated 405 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 27 15:35:56.538653 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi [None req-29194b56-f3ff-484c-a757-756c1c87138d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=107259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 15:35:56.564600 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: INFO nova.api.openstack.requestlog [None req-29194b56-f3ff-484c-a757-756c1c87138d admin admin] 10.222.0.64 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029586 Oct 27 15:35:56.566899 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: [pid: 107259|app: 0|req: 17/32] 10.222.0.64 () {64 vars in 1332 bytes} [Wed Oct 27 15:35:56 2021] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 15:35:58.911659 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi [None req-0372b1a3-a777-44ef-a4d5-8478325f52fa admin admin] Calling method '>' {{(pid=107258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:35:58.912717 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: INFO nova.api.openstack.requestlog [None req-0372b1a3-a777-44ef-a4d5-8478325f52fa admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001503 Oct 27 15:35:58.913118 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: [pid: 107258|app: 0|req: 16/33] 10.222.0.64 () {54 vars in 930 bytes} [Wed Oct 27 15:35:58 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 15:35:58.976175 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi [None req-b7388b9e-8469-43a4-b9a5-5b01aced516b admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "rxtx_factor": 1.0, "id": "5", "disk": 160, "os-flavor-access:is_public": true, "ram": 16384, "name": "m1.xlarge", "vcpus": 8}} {{(pid=107259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 15:35:58.996933 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: INFO nova.api.openstack.requestlog [None req-b7388b9e-8469-43a4-b9a5-5b01aced516b admin admin] 10.222.0.64 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.076977 Oct 27 15:35:59.007125 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: [pid: 107259|app: 0|req: 18/34] 10.222.0.64 () {64 vars in 1282 bytes} [Wed Oct 27 15:35:58 2021] POST /compute/v2.1/flavors => generated 408 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 27 15:35:59.011537 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi [None req-7ea49605-2b91-450e-a7e7-e09c53e5f69c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=107258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 15:35:59.040114 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: INFO nova.api.openstack.requestlog [None req-7ea49605-2b91-450e-a7e7-e09c53e5f69c admin admin] 10.222.0.64 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032076 Oct 27 15:35:59.041093 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: [pid: 107258|app: 0|req: 17/35] 10.222.0.64 () {64 vars in 1332 bytes} [Wed Oct 27 15:35:59 2021] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 15:36:39.009252 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi [None req-b7388b9e-8469-43a4-b9a5-5b01aced516b admin admin] Calling method '>' {{(pid=107259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:36:39.010252 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: INFO nova.api.openstack.requestlog [None req-b7388b9e-8469-43a4-b9a5-5b01aced516b admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001432 Oct 27 15:36:39.010654 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: [pid: 107259|app: 0|req: 19/36] 10.222.0.64 () {54 vars in 930 bytes} [Wed Oct 27 15:36:39 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 15:36:39.070922 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi [None req-4557cc50-4131-4172-a034-d81166ae6f7c admin admin] Calling method '>' {{(pid=107258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:36:39.088148 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: INFO nova.api.openstack.requestlog [None req-4557cc50-4131-4172-a034-d81166ae6f7c admin admin] 10.222.0.64 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.070846 Oct 27 15:36:39.088782 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: [pid: 107258|app: 0|req: 18/37] 10.222.0.64 () {60 vars in 1291 bytes} [Wed Oct 27 15:36:39 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 15:36:40.610677 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi [None req-b7388b9e-8469-43a4-b9a5-5b01aced516b admin admin] Calling method '>' {{(pid=107259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:36:40.612452 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: INFO nova.api.openstack.requestlog [None req-b7388b9e-8469-43a4-b9a5-5b01aced516b admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001394 Oct 27 15:36:40.612857 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: [pid: 107259|app: 0|req: 20/38] 10.222.0.64 () {56 vars in 1074 bytes} [Wed Oct 27 15:36:40 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 15:36:40.804727 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi [None req-8d97c2ec-3a31-447f-9538-9e940a73f8f0 admin admin] Calling method '>' {{(pid=107258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:36:40.810030 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: INFO nova.api.openstack.wsgi [None req-8d97c2ec-3a31-447f-9538-9e940a73f8f0 admin admin] HTTP exception thrown: Flavor 42 could not be found. Oct 27 15:36:40.810586 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi [None req-8d97c2ec-3a31-447f-9538-9e940a73f8f0 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=107258) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 27 15:36:40.811371 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: INFO nova.api.openstack.requestlog [None req-8d97c2ec-3a31-447f-9538-9e940a73f8f0 admin admin] 10.222.0.64 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.057564 Oct 27 15:36:40.811910 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: [pid: 107258|app: 0|req: 19/39] 10.222.0.64 () {60 vars in 1190 bytes} [Wed Oct 27 15:36:40 2021] GET /compute/v2.1/flavors/42 => generated 75 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 27 15:36:40.822021 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi [None req-baacde2c-4d8d-4d5d-84f5-b260960efea6 admin admin] Calling method '>' {{(pid=107259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:36:40.842499 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: INFO nova.api.openstack.requestlog [None req-baacde2c-4d8d-4d5d-84f5-b260960efea6 admin admin] 10.222.0.64 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.024058 Oct 27 15:36:40.843025 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: [pid: 107259|app: 0|req: 21/40] 10.222.0.64 () {60 vars in 1210 bytes} [Wed Oct 27 15:36:40 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 15:36:40.854327 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi [None req-6c330d30-7db1-41fb-af5c-7e28d600d0ad admin admin] Calling method '>' {{(pid=107258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:36:40.875117 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: INFO nova.api.openstack.requestlog [None req-6c330d30-7db1-41fb-af5c-7e28d600d0ad admin admin] 10.222.0.64 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.024345 Oct 27 15:36:40.875790 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: [pid: 107258|app: 0|req: 20/41] 10.222.0.64 () {60 vars in 1210 bytes} [Wed Oct 27 15:36:40 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 15:36:40.885360 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi [None req-c77c0aa7-6f61-4cc2-957f-d8724bca57d0 admin admin] Calling method '>' {{(pid=107259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:36:40.890830 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: INFO nova.api.openstack.wsgi [None req-c77c0aa7-6f61-4cc2-957f-d8724bca57d0 admin admin] HTTP exception thrown: Flavor 42 could not be found. Oct 27 15:36:40.891388 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi [None req-c77c0aa7-6f61-4cc2-957f-d8724bca57d0 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=107259) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 27 15:36:40.892221 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: INFO nova.api.openstack.requestlog [None req-c77c0aa7-6f61-4cc2-957f-d8724bca57d0 admin admin] 10.222.0.64 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.010412 Oct 27 15:36:40.893210 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: [pid: 107259|app: 0|req: 22/42] 10.222.0.64 () {60 vars in 1190 bytes} [Wed Oct 27 15:36:40 2021] GET /compute/v2.1/flavors/42 => generated 75 bytes in 11 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 27 15:36:42.300014 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi [None req-6c330d30-7db1-41fb-af5c-7e28d600d0ad admin admin] Calling method '>' {{(pid=107258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:36:42.301006 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: INFO nova.api.openstack.requestlog [None req-6c330d30-7db1-41fb-af5c-7e28d600d0ad admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001953 Oct 27 15:36:42.301396 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: [pid: 107258|app: 0|req: 21/43] 10.222.0.64 () {56 vars in 1074 bytes} [Wed Oct 27 15:36:42 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 15:36:42.496991 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi [None req-ee8da055-9c5b-439f-8b13-97a16de1aa4e admin admin] Calling method '>' {{(pid=107259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:36:42.503731 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: INFO nova.api.openstack.wsgi [None req-ee8da055-9c5b-439f-8b13-97a16de1aa4e admin admin] HTTP exception thrown: Flavor 84 could not be found. Oct 27 15:36:42.504314 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi [None req-ee8da055-9c5b-439f-8b13-97a16de1aa4e admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=107259) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 27 15:36:42.505091 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: INFO nova.api.openstack.requestlog [None req-ee8da055-9c5b-439f-8b13-97a16de1aa4e admin admin] 10.222.0.64 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.059211 Oct 27 15:36:42.505591 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: [pid: 107259|app: 0|req: 23/44] 10.222.0.64 () {60 vars in 1190 bytes} [Wed Oct 27 15:36:42 2021] GET /compute/v2.1/flavors/84 => generated 75 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 27 15:36:42.515470 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi [None req-46e0ba4f-4741-4d0a-b5e5-09ee1c38ec75 admin admin] Calling method '>' {{(pid=107258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:36:42.528867 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: INFO nova.api.openstack.requestlog [None req-46e0ba4f-4741-4d0a-b5e5-09ee1c38ec75 admin admin] 10.222.0.64 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017033 Oct 27 15:36:42.529385 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: [pid: 107258|app: 0|req: 22/45] 10.222.0.64 () {60 vars in 1210 bytes} [Wed Oct 27 15:36:42 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 15:36:42.539224 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi [None req-f6e147d7-169d-4c74-9ce4-ce95503012ec admin admin] Calling method '>' {{(pid=107259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:36:42.553320 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: INFO nova.api.openstack.requestlog [None req-f6e147d7-169d-4c74-9ce4-ce95503012ec admin admin] 10.222.0.64 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017481 Oct 27 15:36:42.553848 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: [pid: 107259|app: 0|req: 24/46] 10.222.0.64 () {60 vars in 1210 bytes} [Wed Oct 27 15:36:42 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 15:36:42.563233 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi [None req-b5fefcba-9e77-4bbc-a83c-6093cc4a9844 admin admin] Calling method '>' {{(pid=107258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:36:42.568995 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: INFO nova.api.openstack.wsgi [None req-b5fefcba-9e77-4bbc-a83c-6093cc4a9844 admin admin] HTTP exception thrown: Flavor 84 could not be found. Oct 27 15:36:42.569543 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi [None req-b5fefcba-9e77-4bbc-a83c-6093cc4a9844 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=107258) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 27 15:36:42.570310 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: INFO nova.api.openstack.requestlog [None req-b5fefcba-9e77-4bbc-a83c-6093cc4a9844 admin admin] 10.222.0.64 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.010549 Oct 27 15:36:42.570791 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: [pid: 107258|app: 0|req: 23/47] 10.222.0.64 () {60 vars in 1190 bytes} [Wed Oct 27 15:36:42 2021] GET /compute/v2.1/flavors/84 => generated 75 bytes in 11 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Oct 27 15:36:43.965203 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi [None req-f6e147d7-169d-4c74-9ce4-ce95503012ec admin admin] Calling method '>' {{(pid=107259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:36:43.966201 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: INFO nova.api.openstack.requestlog [None req-f6e147d7-169d-4c74-9ce4-ce95503012ec admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001449 Oct 27 15:36:43.966600 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: [pid: 107259|app: 0|req: 25/48] 10.222.0.64 () {56 vars in 1074 bytes} [Wed Oct 27 15:36:43 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 15:36:44.165368 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi [None req-ec689dd1-62ae-418e-95ae-50d07fb42339 admin admin] Calling method '>' {{(pid=107258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:36:44.170878 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: INFO nova.api.openstack.wsgi [None req-ec689dd1-62ae-418e-95ae-50d07fb42339 admin admin] HTTP exception thrown: Flavor 451 could not be found. Oct 27 15:36:44.171419 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi [None req-ec689dd1-62ae-418e-95ae-50d07fb42339 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=107258) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 27 15:36:44.172215 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: INFO nova.api.openstack.requestlog [None req-ec689dd1-62ae-418e-95ae-50d07fb42339 admin admin] 10.222.0.64 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.066514 Oct 27 15:36:44.172710 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: [pid: 107258|app: 0|req: 24/49] 10.222.0.64 () {60 vars in 1193 bytes} [Wed Oct 27 15:36:44 2021] GET /compute/v2.1/flavors/451 => generated 76 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 27 15:36:44.183044 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi [None req-47d25dda-5b25-4504-a89f-55156369ae46 admin admin] Calling method '>' {{(pid=107259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:36:44.196281 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: INFO nova.api.openstack.requestlog [None req-47d25dda-5b25-4504-a89f-55156369ae46 admin admin] 10.222.0.64 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.016685 Oct 27 15:36:44.196797 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: [pid: 107259|app: 0|req: 26/50] 10.222.0.64 () {60 vars in 1210 bytes} [Wed Oct 27 15:36:44 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 15:36:44.206724 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi [None req-8b451d2f-82a4-41a9-a142-37465418613c admin admin] Calling method '>' {{(pid=107258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:36:44.219706 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: INFO nova.api.openstack.requestlog [None req-8b451d2f-82a4-41a9-a142-37465418613c admin admin] 10.222.0.64 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.016871 Oct 27 15:36:44.220245 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: [pid: 107258|app: 0|req: 25/51] 10.222.0.64 () {60 vars in 1210 bytes} [Wed Oct 27 15:36:44 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 15:36:44.232915 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi [None req-a100819e-7613-4ab8-837c-e821afce4728 admin admin] Calling method '>' {{(pid=107259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:36:44.239141 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: INFO nova.api.openstack.wsgi [None req-a100819e-7613-4ab8-837c-e821afce4728 admin admin] HTTP exception thrown: Flavor 451 could not be found. Oct 27 15:36:44.239704 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi [None req-a100819e-7613-4ab8-837c-e821afce4728 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=107259) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 27 15:36:44.240527 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: INFO nova.api.openstack.requestlog [None req-a100819e-7613-4ab8-837c-e821afce4728 admin admin] 10.222.0.64 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.013871 Oct 27 15:36:44.241083 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: [pid: 107259|app: 0|req: 27/52] 10.222.0.64 () {60 vars in 1193 bytes} [Wed Oct 27 15:36:44 2021] GET /compute/v2.1/flavors/451 => generated 76 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 27 15:36:45.651890 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi [None req-8b451d2f-82a4-41a9-a142-37465418613c admin admin] Calling method '>' {{(pid=107258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:36:45.652896 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: INFO nova.api.openstack.requestlog [None req-8b451d2f-82a4-41a9-a142-37465418613c admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001440 Oct 27 15:36:45.653289 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: [pid: 107258|app: 0|req: 26/53] 10.222.0.64 () {56 vars in 1074 bytes} [Wed Oct 27 15:36:45 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 15:36:45.841554 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi [None req-4b63f528-839f-4fd1-9197-86cbe6f3d973 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=107259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 15:36:45.860285 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: INFO nova.api.openstack.requestlog [None req-4b63f528-839f-4fd1-9197-86cbe6f3d973 admin admin] 10.222.0.64 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.068825 Oct 27 15:36:45.860867 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: [pid: 107259|app: 0|req: 28/54] 10.222.0.64 () {64 vars in 1235 bytes} [Wed Oct 27 15:36:45 2021] POST /compute/v2.1/flavors => generated 404 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 15:36:47.302198 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi [None req-8b451d2f-82a4-41a9-a142-37465418613c admin admin] Calling method '>' {{(pid=107258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:36:47.303191 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: INFO nova.api.openstack.requestlog [None req-8b451d2f-82a4-41a9-a142-37465418613c admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001406 Oct 27 15:36:47.303581 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: [pid: 107258|app: 0|req: 27/55] 10.222.0.64 () {56 vars in 1074 bytes} [Wed Oct 27 15:36:47 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 15:36:47.493828 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi [None req-f05a33dc-97d7-4a5f-abc5-37dd0d90c64e admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=107259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 15:36:47.510605 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: INFO nova.api.openstack.requestlog [None req-f05a33dc-97d7-4a5f-abc5-37dd0d90c64e admin admin] 10.222.0.64 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.067465 Oct 27 15:36:47.511090 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: [pid: 107259|app: 0|req: 29/56] 10.222.0.64 () {64 vars in 1235 bytes} [Wed Oct 27 15:36:47 2021] POST /compute/v2.1/flavors => generated 405 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 15:36:48.927082 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi [None req-8b451d2f-82a4-41a9-a142-37465418613c admin admin] Calling method '>' {{(pid=107258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:36:48.928123 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: INFO nova.api.openstack.requestlog [None req-8b451d2f-82a4-41a9-a142-37465418613c admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001404 Oct 27 15:36:48.928543 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: [pid: 107258|app: 0|req: 28/57] 10.222.0.64 () {56 vars in 1074 bytes} [Wed Oct 27 15:36:48 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 15:36:49.117860 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi [None req-d2b599ee-6d52-49d9-8fcd-7c0d485f18f3 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=107259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 15:36:49.136362 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: INFO nova.api.openstack.requestlog [None req-d2b599ee-6d52-49d9-8fcd-7c0d485f18f3 admin admin] 10.222.0.64 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.068644 Oct 27 15:36:49.136897 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: [pid: 107259|app: 0|req: 30/58] 10.222.0.64 () {64 vars in 1235 bytes} [Wed Oct 27 15:36:49 2021] POST /compute/v2.1/flavors => generated 407 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 27 15:36:50.559741 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi [None req-8b451d2f-82a4-41a9-a142-37465418613c admin admin] Calling method '>' {{(pid=107258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:36:50.560792 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: INFO nova.api.openstack.requestlog [None req-8b451d2f-82a4-41a9-a142-37465418613c admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001492 Oct 27 15:36:50.561212 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: [pid: 107258|app: 0|req: 29/59] 10.222.0.64 () {56 vars in 1074 bytes} [Wed Oct 27 15:36:50 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 15:36:50.753064 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi [None req-b4a53019-191e-41a3-8534-a45faec1f7e6 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=107259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 15:36:50.770322 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: INFO nova.api.openstack.requestlog [None req-b4a53019-191e-41a3-8534-a45faec1f7e6 admin admin] 10.222.0.64 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.069453 Oct 27 15:36:50.770809 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: [pid: 107259|app: 0|req: 31/60] 10.222.0.64 () {64 vars in 1235 bytes} [Wed Oct 27 15:36:50 2021] POST /compute/v2.1/flavors => generated 409 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 15:36:52.195740 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi [None req-8b451d2f-82a4-41a9-a142-37465418613c admin admin] Calling method '>' {{(pid=107258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:36:52.196752 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: INFO nova.api.openstack.requestlog [None req-8b451d2f-82a4-41a9-a142-37465418613c admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001430 Oct 27 15:36:52.197141 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: [pid: 107258|app: 0|req: 30/61] 10.222.0.64 () {56 vars in 1074 bytes} [Wed Oct 27 15:36:52 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 15:36:52.390219 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi [None req-fbcfc83f-15cb-4152-9882-5c0110c278a1 admin admin] Calling method '>' {{(pid=107259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:36:52.410063 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: INFO nova.api.openstack.requestlog [None req-fbcfc83f-15cb-4152-9882-5c0110c278a1 admin admin] 10.222.0.64 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.072566 Oct 27 15:36:52.410527 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: [pid: 107259|app: 0|req: 32/62] 10.222.0.64 () {60 vars in 1202 bytes} [Wed Oct 27 15:36:52 2021] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 15:37:38.739270 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi [None req-8b451d2f-82a4-41a9-a142-37465418613c admin admin] Calling method '>' {{(pid=107258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:37:38.740302 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: INFO nova.api.openstack.requestlog [None req-8b451d2f-82a4-41a9-a142-37465418613c admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001461 Oct 27 15:37:38.740720 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: [pid: 107258|app: 0|req: 31/63] 10.222.0.64 () {54 vars in 930 bytes} [Wed Oct 27 15:37:38 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 15:37:38.799624 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi [None req-16bb9fec-ef64-45cb-8e2c-a02375722267 admin admin] Calling method '>' {{(pid=107259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:37:38.819340 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: INFO nova.api.openstack.requestlog [None req-16bb9fec-ef64-45cb-8e2c-a02375722267 admin admin] 10.222.0.64 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.072106 Oct 27 15:37:38.819972 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: [pid: 107259|app: 0|req: 33/64] 10.222.0.64 () {60 vars in 1291 bytes} [Wed Oct 27 15:37:38 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 15:37:38.841673 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi [None req-452cd3f3-043b-4d42-9898-cd24c265fb90 admin admin] Calling method '>' {{(pid=107258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:37:38.849804 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: INFO nova.api.openstack.requestlog [None req-452cd3f3-043b-4d42-9898-cd24c265fb90 admin admin] 10.222.0.64 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011638 Oct 27 15:37:38.850313 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: [pid: 107258|app: 0|req: 32/65] 10.222.0.64 () {60 vars in 1282 bytes} [Wed Oct 27 15:37:38 2021] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 15:37:38.863065 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi [None req-30a3696c-f427-4545-9dad-b8136dc7ee8c admin admin] Calling method '>' {{(pid=107259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:37:38.870565 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: INFO nova.api.openstack.requestlog [None req-30a3696c-f427-4545-9dad-b8136dc7ee8c admin admin] 10.222.0.64 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012036 Oct 27 15:37:38.871073 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: [pid: 107259|app: 0|req: 34/66] 10.222.0.64 () {60 vars in 1285 bytes} [Wed Oct 27 15:37:38 2021] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 15:37:38.882324 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi [None req-77e803c9-4bd1-45c7-a42a-c7d5d41b509d admin admin] Calling method '>' {{(pid=107258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:37:38.890003 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: INFO nova.api.openstack.requestlog [None req-77e803c9-4bd1-45c7-a42a-c7d5d41b509d admin admin] 10.222.0.64 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011009 Oct 27 15:37:38.890534 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: [pid: 107258|app: 0|req: 33/67] 10.222.0.64 () {60 vars in 1285 bytes} [Wed Oct 27 15:37:38 2021] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 15:37:38.902305 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi [None req-7a043a11-bb86-46d7-8052-acbb487030b0 admin admin] Calling method '>' {{(pid=107259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:37:38.910455 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: INFO nova.api.openstack.requestlog [None req-7a043a11-bb86-46d7-8052-acbb487030b0 admin admin] 10.222.0.64 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011593 Oct 27 15:37:38.910970 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: [pid: 107259|app: 0|req: 35/68] 10.222.0.64 () {60 vars in 1282 bytes} [Wed Oct 27 15:37:38 2021] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 15:39:06.027825 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi [None req-ffeace09-24d4-4860-9837-133b5b3bae38 tempest-verify_tempest_config-1475242132 tempest-verify_tempest_config-1475242132-project] Calling method '>' {{(pid=107258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:39:06.029817 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: INFO nova.api.openstack.requestlog [None req-ffeace09-24d4-4860-9837-133b5b3bae38 tempest-verify_tempest_config-1475242132 tempest-verify_tempest_config-1475242132-project] 10.222.0.64 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.104178 Oct 27 15:39:06.030342 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: [pid: 107258|app: 0|req: 34/69] 10.222.0.64 () {58 vars in 1133 bytes} [Wed Oct 27 15:39:05 2021] GET /compute/v2.1/extensions => generated 22700 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 15:40:38.550858 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi [None req-7a043a11-bb86-46d7-8052-acbb487030b0 admin admin] Calling method '>' {{(pid=107259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:40:38.551870 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: INFO nova.api.openstack.requestlog [None req-7a043a11-bb86-46d7-8052-acbb487030b0 admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001420 Oct 27 15:40:38.552277 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: [pid: 107259|app: 0|req: 36/70] 10.222.0.64 () {56 vars in 1074 bytes} [Wed Oct 27 15:40:38 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 15:40:38.808341 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi [None req-bf257875-6e41-43ce-8f18-4e66be33b479 admin admin] Calling method '>' {{(pid=107258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:40:38.809678 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 27 15:40:38.809678 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: warnings.warn(msg) Oct 27 15:40:38.811253 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG oslo_concurrency.lockutils [None req-bf257875-6e41-43ce-8f18-4e66be33b479 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:40:38.811691 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG oslo_concurrency.lockutils [None req-bf257875-6e41-43ce-8f18-4e66be33b479 admin admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:40:38.812503 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG oslo_concurrency.lockutils [None req-bf257875-6e41-43ce-8f18-4e66be33b479 admin admin] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:40:38.812925 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG oslo_concurrency.lockutils [None req-bf257875-6e41-43ce-8f18-4e66be33b479 admin admin] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:40:38.847266 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: INFO nova.api.openstack.requestlog [None req-bf257875-6e41-43ce-8f18-4e66be33b479 admin admin] 10.222.0.64 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.154776 Oct 27 15:40:38.848134 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: [pid: 107258|app: 0|req: 35/71] 10.222.0.64 () {60 vars in 1193 bytes} [Wed Oct 27 15:40:38 2021] GET /compute/v2.1/os-services => generated 791 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 15:40:40.571967 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi [None req-7a043a11-bb86-46d7-8052-acbb487030b0 admin admin] Calling method '>' {{(pid=107259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:40:40.573031 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: INFO nova.api.openstack.requestlog [None req-7a043a11-bb86-46d7-8052-acbb487030b0 admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001582 Oct 27 15:40:40.573436 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: [pid: 107259|app: 0|req: 37/72] 10.222.0.64 () {56 vars in 1074 bytes} [Wed Oct 27 15:40:40 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 15:40:40.788006 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi [None req-ca5ad430-ea4c-4581-8034-965784406693 admin admin] Calling method '>' {{(pid=107258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:40:40.789246 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 27 15:40:40.789246 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: warnings.warn(msg) Oct 27 15:40:40.790857 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG oslo_concurrency.lockutils [None req-ca5ad430-ea4c-4581-8034-965784406693 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:40:40.791318 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG oslo_concurrency.lockutils [None req-ca5ad430-ea4c-4581-8034-965784406693 admin admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:40:40.792137 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG oslo_concurrency.lockutils [None req-ca5ad430-ea4c-4581-8034-965784406693 admin admin] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:40:40.792554 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG oslo_concurrency.lockutils [None req-ca5ad430-ea4c-4581-8034-965784406693 admin admin] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:40:40.813074 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: INFO nova.api.openstack.requestlog [None req-ca5ad430-ea4c-4581-8034-965784406693 admin admin] 10.222.0.64 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.085393 Oct 27 15:40:40.813650 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: [pid: 107258|app: 0|req: 36/73] 10.222.0.64 () {60 vars in 1193 bytes} [Wed Oct 27 15:40:40 2021] GET /compute/v2.1/os-services => generated 791 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 27 15:40:52.669293 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi [None req-7a043a11-bb86-46d7-8052-acbb487030b0 admin admin] Calling method '>' {{(pid=107259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:40:52.670276 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: INFO nova.api.openstack.requestlog [None req-7a043a11-bb86-46d7-8052-acbb487030b0 admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001396 Oct 27 15:40:52.670670 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: [pid: 107259|app: 0|req: 38/74] 10.222.0.64 () {56 vars in 1074 bytes} [Wed Oct 27 15:40:52 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 15:40:52.861010 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi [None req-e81a244e-02cb-4cbd-b43c-584b4ff1864b admin admin] Calling method '>' {{(pid=107258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:40:52.862670 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 27 15:40:52.862670 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: warnings.warn(msg) Oct 27 15:40:52.864196 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG oslo_concurrency.lockutils [None req-e81a244e-02cb-4cbd-b43c-584b4ff1864b admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:40:52.864632 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG oslo_concurrency.lockutils [None req-e81a244e-02cb-4cbd-b43c-584b4ff1864b admin admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:40:52.865405 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG oslo_concurrency.lockutils [None req-e81a244e-02cb-4cbd-b43c-584b4ff1864b admin admin] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:40:52.865820 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG oslo_concurrency.lockutils [None req-e81a244e-02cb-4cbd-b43c-584b4ff1864b admin admin] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:40:52.890337 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: INFO nova.api.openstack.requestlog [None req-e81a244e-02cb-4cbd-b43c-584b4ff1864b admin admin] 10.222.0.64 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.080688 Oct 27 15:40:52.890813 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: [pid: 107258|app: 0|req: 37/75] 10.222.0.64 () {60 vars in 1193 bytes} [Wed Oct 27 15:40:52 2021] GET /compute/v2.1/os-services => generated 1035 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 15:40:54.320196 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: DEBUG nova.api.openstack.wsgi [None req-7a043a11-bb86-46d7-8052-acbb487030b0 admin admin] Calling method '>' {{(pid=107259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:40:54.321202 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: INFO nova.api.openstack.requestlog [None req-7a043a11-bb86-46d7-8052-acbb487030b0 admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001444 Oct 27 15:40:54.321594 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: [pid: 107259|app: 0|req: 39/76] 10.222.0.64 () {56 vars in 1074 bytes} [Wed Oct 27 15:40:54 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 15:40:54.515135 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG nova.api.openstack.wsgi [None req-06a1ba82-2fcb-4ece-8ad0-8892e4f4ee4d admin admin] Calling method '>' {{(pid=107258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:40:54.516365 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 27 15:40:54.516365 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: warnings.warn(msg) Oct 27 15:40:54.517901 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG oslo_concurrency.lockutils [None req-06a1ba82-2fcb-4ece-8ad0-8892e4f4ee4d admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:40:54.518410 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG oslo_concurrency.lockutils [None req-06a1ba82-2fcb-4ece-8ad0-8892e4f4ee4d admin admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:40:54.519266 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG oslo_concurrency.lockutils [None req-06a1ba82-2fcb-4ece-8ad0-8892e4f4ee4d admin admin] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:40:54.519676 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: DEBUG oslo_concurrency.lockutils [None req-06a1ba82-2fcb-4ece-8ad0-8892e4f4ee4d admin admin] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:40:54.540837 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: INFO nova.api.openstack.requestlog [None req-06a1ba82-2fcb-4ece-8ad0-8892e4f4ee4d admin admin] 10.222.0.64 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.077385 Oct 27 15:40:54.541313 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: [pid: 107258|app: 0|req: 38/77] 10.222.0.64 () {60 vars in 1193 bytes} [Wed Oct 27 15:40:54 2021] GET /compute/v2.1/os-services => generated 1035 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 15:41:51.336046 dv-cinder-800703-2-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Oct 27 15:41:51.336901 dv-cinder-800703-2-iscsi devstack@n-api.service[107257]: Wed Oct 27 15:41:51 2021 - graceful shutdown triggered... Oct 27 15:41:51.337414 dv-cinder-800703-2-iscsi devstack@n-api.service[107259]: Gracefully killing worker 2 (pid: 107259)... Oct 27 15:41:51.337788 dv-cinder-800703-2-iscsi devstack@n-api.service[107258]: Gracefully killing worker 1 (pid: 107258)... Oct 27 15:41:52.337481 dv-cinder-800703-2-iscsi devstack@n-api.service[107257]: worker 1 buried after 1 seconds Oct 27 15:41:52.338010 dv-cinder-800703-2-iscsi devstack@n-api.service[107257]: worker 2 buried after 1 seconds Oct 27 15:41:52.338010 dv-cinder-800703-2-iscsi devstack@n-api.service[107257]: goodbye to uWSGI. Oct 27 15:41:52.339074 dv-cinder-800703-2-iscsi systemd[1]: devstack@n-api.service: Succeeded. Oct 27 15:41:52.339633 dv-cinder-800703-2-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Oct 27 15:41:52.342459 dv-cinder-800703-2-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Oct 27 15:41:52.351579 dv-cinder-800703-2-iscsi devstack@n-api.service[122205]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Oct 27 15:41:52.353921 dv-cinder-800703-2-iscsi devstack@n-api.service[122205]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Oct 27 15:41:52 2021] *** Oct 27 15:41:52.353921 dv-cinder-800703-2-iscsi devstack@n-api.service[122205]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Oct 27 15:41:52.353921 dv-cinder-800703-2-iscsi devstack@n-api.service[122205]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Oct 27 15:41:52.353921 dv-cinder-800703-2-iscsi devstack@n-api.service[122205]: nodename: dv-cinder-800703-2-iscsi Oct 27 15:41:52.353921 dv-cinder-800703-2-iscsi devstack@n-api.service[122205]: machine: x86_64 Oct 27 15:41:52.353921 dv-cinder-800703-2-iscsi devstack@n-api.service[122205]: clock source: unix Oct 27 15:41:52.353921 dv-cinder-800703-2-iscsi devstack@n-api.service[122205]: pcre jit disabled Oct 27 15:41:52.353921 dv-cinder-800703-2-iscsi devstack@n-api.service[122205]: detected number of CPU cores: 4 Oct 27 15:41:52.353921 dv-cinder-800703-2-iscsi devstack@n-api.service[122205]: current working directory: / Oct 27 15:41:52.353921 dv-cinder-800703-2-iscsi devstack@n-api.service[122205]: detected binary path: /usr/bin/uwsgi-core Oct 27 15:41:52.353921 dv-cinder-800703-2-iscsi devstack@n-api.service[122205]: your processes number limit is 47680 Oct 27 15:41:52.354627 dv-cinder-800703-2-iscsi devstack@n-api.service[122205]: your memory page size is 4096 bytes Oct 27 15:41:52.354627 dv-cinder-800703-2-iscsi devstack@n-api.service[122205]: detected max file descriptor number: 2048 Oct 27 15:41:52.354627 dv-cinder-800703-2-iscsi devstack@n-api.service[122205]: lock engine: pthread robust mutexes Oct 27 15:41:52.354627 dv-cinder-800703-2-iscsi devstack@n-api.service[122205]: thunder lock: enabled Oct 27 15:41:52.354627 dv-cinder-800703-2-iscsi devstack@n-api.service[122205]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Oct 27 15:41:52.354627 dv-cinder-800703-2-iscsi devstack@n-api.service[122205]: Python version: 3.8.10 (default, Sep 28 2021, 16:10:42) [GCC 9.3.0] Oct 27 15:41:52.399405 dv-cinder-800703-2-iscsi devstack@n-api.service[122205]: Python main interpreter initialized at 0x55c85408d9c0 Oct 27 15:41:52.399405 dv-cinder-800703-2-iscsi devstack@n-api.service[122205]: python threads support enabled Oct 27 15:41:52.399405 dv-cinder-800703-2-iscsi devstack@n-api.service[122205]: your server socket listen backlog is limited to 100 connections Oct 27 15:41:52.399405 dv-cinder-800703-2-iscsi devstack@n-api.service[122205]: your mercy for graceful operations on workers is 90 seconds Oct 27 15:41:52.399799 dv-cinder-800703-2-iscsi devstack@n-api.service[122205]: mapped 403077 bytes (393 KB) for 2 cores Oct 27 15:41:52.399887 dv-cinder-800703-2-iscsi devstack@n-api.service[122205]: *** Operational MODE: preforking *** Oct 27 15:41:52.400160 dv-cinder-800703-2-iscsi devstack@n-api.service[122205]: *** uWSGI is running in multiple interpreter mode *** Oct 27 15:41:52.400342 dv-cinder-800703-2-iscsi devstack@n-api.service[122205]: spawned uWSGI master process (pid: 122205) Oct 27 15:41:52.400685 dv-cinder-800703-2-iscsi systemd[1]: Started Devstack devstack@n-api.service. Oct 27 15:41:52.401434 dv-cinder-800703-2-iscsi devstack@n-api.service[122205]: spawned uWSGI worker 1 (pid: 122224, cores: 1) Oct 27 15:41:52.401947 dv-cinder-800703-2-iscsi devstack@n-api.service[122205]: spawned uWSGI worker 2 (pid: 122225, cores: 1) Oct 27 15:41:52.403610 dv-cinder-800703-2-iscsi devstack@n-api.service[122205]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Oct 27 15:41:54.219692 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 27 15:41:54.219692 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: from cryptography.utils import int_from_bytes Oct 27 15:41:54.220460 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 27 15:41:54.220460 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: from cryptography.utils import int_from_bytes Oct 27 15:41:54.259698 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 27 15:41:54.259698 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: from cryptography.utils import int_from_bytes Oct 27 15:41:54.260374 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 27 15:41:54.260374 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: from cryptography.utils import int_from_bytes Oct 27 15:41:56.778040 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 27 15:41:56.778661 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 27 15:41:56.778793 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 27 15:41:56.779142 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 27 15:41:56.779397 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 27 15:41:56.779785 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:41:56.780139 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:41:56.780461 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:41:56.780780 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:41:56.781114 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:41:56.781424 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:41:56.781748 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:41:56.782064 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:41:56.782394 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:41:56.782654 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:41:56.783070 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:41:56.783378 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-800703-2-iscsi {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:41:56.784996 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:41:56.784996 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:41:56.784996 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:41:56.784996 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:41:56.785874 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:41:56.785956 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:41:56.786214 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:41:56.786723 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:41:56.788216 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:41:56.788216 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:41:56.788216 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:41:56.788216 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:41:56.788604 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:41:56.788818 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:41:56.789050 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:41:56.789355 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:41:56.789977 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:41:56.790294 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:41:56.790709 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-800703-2-iscsi {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:41:56.791035 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:41:56.791355 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:41:56.791673 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:41:56.792127 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:41:56.792457 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:41:56.792755 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:41:56.793076 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:41:56.793401 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:41:56.793710 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:41:56.794036 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:41:56.794353 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:41:56.794676 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:41:56.794992 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:41:56.795294 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:41:56.795601 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:41:56.796000 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:41:56.796256 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:41:56.796561 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:41:56.796866 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:41:56.797116 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:41:56.797421 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:41:56.797744 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:41:56.798063 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:41:56.798385 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:41:56.798635 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:41:56.798889 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:41:56.799206 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:41:56.799525 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:41:56.799834 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:41:56.800170 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:41:56.800479 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:41:56.800786 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:41:56.801648 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:41:56.802050 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:41:56.802290 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:41:56.802544 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:41:56.802859 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:41:56.803174 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:41:56.803495 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:41:56.803997 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:41:56.804318 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:41:56.804730 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.64 {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:41:56.804980 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.64 {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:41:56.805286 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:41:56.805628 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:41:56.805944 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:41:56.806250 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:41:56.806570 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:41:56.806889 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:41:56.807227 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:41:56.807536 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:41:56.807836 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:41:56.808178 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:41:56.808516 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:41:56.808821 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:41:56.809076 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:41:56.809378 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:41:56.809681 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:41:56.809998 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:41:56.810302 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:41:56.810609 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:41:56.810908 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:41:56.811212 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:41:56.811511 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:41:56.811817 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:41:56.812147 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:41:56.812453 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:41:56.812759 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:41:56.813066 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:41:56.813370 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:41:56.813767 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:41:56.814211 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:41:56.814406 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:41:56.814605 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:41:56.814916 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:41:56.815218 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:41:56.815524 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:41:56.815828 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:41:56.816169 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:41:56.816475 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:41:56.817262 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:41:56.817595 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:41:56.817908 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:41:56.818218 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:41:56.818539 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:41:56.818849 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:41:56.819156 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:41:56.819482 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:41:56.819785 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:41:56.820125 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:41:56.820443 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:41:56.820754 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:41:56.821060 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:41:56.821408 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:41:56.821668 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:41:56.821976 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:41:56.822282 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:41:56.822588 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:41:56.822893 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:41:56.823223 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:41:56.823514 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:41:56.823971 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:41:56.824176 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:41:56.824700 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:41:56.824870 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:41:56.825130 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:41:56.825405 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.825735 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.826080 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.826489 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.826825 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.827157 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.827476 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.827788 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.828127 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.828456 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.828770 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.829082 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.829400 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.829719 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.830036 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.830363 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.830680 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.830995 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.831312 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.831628 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.831968 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.832352 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.832671 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.832983 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.833492 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.833838 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.834270 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.834469 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.834886 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.835102 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.835420 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.835735 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.836074 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.836406 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.836719 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.837032 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.837371 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.837692 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.838492 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.838492 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.838810 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.838961 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.839197 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.839504 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.839827 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.840169 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.840478 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.840811 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.841119 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.841429 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.841800 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.842042 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.842355 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.842665 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.842971 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.843292 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.843604 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.843931 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.844299 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.844560 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.844865 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.845180 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.845494 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.845803 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.846115 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.846438 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.846750 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.847059 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.847389 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.847719 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.848568 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.848890 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.849217 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.849534 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.849845 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.850207 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.850485 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 27 15:41:56.850982 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.851129 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 27 15:41:56.851272 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.851272 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.851576 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 27 15:41:56.852117 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.852279 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 27 15:41:56.852425 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.852575 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 27 15:41:56.852728 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.852872 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:41:56.853029 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.853174 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:41:56.853316 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.853466 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:41:56.853617 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.853829 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:41:56.853988 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.854156 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:41:56.855132 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.855306 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:41:56.855479 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.855703 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:41:56.856001 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.856166 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:41:56.856344 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.856493 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:41:56.856645 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.856820 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:41:56.856972 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.857124 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:41:56.857267 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.857417 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-800703-2-iscsi {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:41:56.857568 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.857724 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:41:56.857869 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.858012 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:41:56.858156 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.858306 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:41:56.858451 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.858608 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:41:56.858764 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.858907 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:41:56.859064 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.859215 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:41:56.859359 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.859518 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:41:56.859670 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.859670 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.859991 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:41:56.860167 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.860325 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:41:56.860487 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.860632 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:41:56.860774 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.860916 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:41:56.861058 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.861219 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:41:56.861418 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.861578 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:41:56.861722 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.861876 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:41:56.862020 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.862284 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:41:56.862443 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.862607 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:41:56.862751 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.862900 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:41:56.863058 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.863209 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:41:56.863360 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.863552 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-800703-2-iscsi {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:41:56.864205 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.864390 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:41:56.864619 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.864770 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:41:56.864914 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.865064 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:41:56.865317 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.865479 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:41:56.865632 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.865632 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.866017 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:41:56.866276 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.866516 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:41:56.866675 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.866829 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:41:56.866980 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.867124 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:41:56.867267 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.867434 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:41:56.867581 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.867724 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:41:56.867903 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.868054 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:41:56.868209 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.868368 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:41:56.868525 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.868685 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:41:56.868830 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.868991 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:41:56.869149 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.869300 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:41:56.869468 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.869613 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:41:56.869757 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.869943 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:41:56.870092 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.870244 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:41:56.870408 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.870567 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:41:56.870567 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:41:56.870872 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.871023 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:41:56.871173 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.871337 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:41:56.871500 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.871650 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:41:56.871800 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.871986 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:41:56.872151 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.872309 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:41:56.872528 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.872776 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:41:56.872935 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.873086 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:41:56.873254 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.873423 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:41:56.873583 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.873739 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:41:56.873898 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.874063 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:41:56.874215 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.874364 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:41:56.874521 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.874770 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:41:56.874928 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.875088 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:41:56.875250 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.875490 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:41:56.875670 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.875822 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:41:56.876095 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.876347 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:41:56.877035 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.877206 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:41:56.877366 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.877517 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:41:56.877666 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.877826 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:41:56.877978 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.878242 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:41:56.878421 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.878595 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:41:56.878748 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.878748 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.879099 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.64 {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:41:56.879099 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.64 {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:41:56.879417 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.879568 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:41:56.879730 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.879986 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:41:56.880157 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.880309 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:41:56.880460 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.880628 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:41:56.880792 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.880951 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:41:56.881101 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.881252 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:41:56.881409 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.881565 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:41:56.881724 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.881882 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:41:56.882033 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.882183 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:41:56.882333 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.882490 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:41:56.882664 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.882664 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.889446 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:41:56.889618 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.889779 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:41:56.889779 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:41:56.890102 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.890254 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:41:56.890405 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.890554 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:41:56.890715 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.890880 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:41:56.891041 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.891215 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:41:56.891373 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.891524 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:41:56.891674 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.891834 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:41:56.892027 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.892179 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:41:56.892336 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.892486 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:41:56.892635 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.892795 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:41:56.892946 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.893095 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:41:56.893255 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.893562 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:41:56.893734 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.893895 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:41:56.894053 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.894212 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:41:56.894371 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.894522 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:41:56.894718 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.894887 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:41:56.894887 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:41:56.895190 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.895342 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:41:56.895512 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.895806 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:41:56.895998 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.896165 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:41:56.896317 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.896466 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:41:56.896625 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.896982 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:41:56.897150 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.897303 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:41:56.897452 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.897615 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:41:56.897786 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.897938 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:41:56.898096 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.898255 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:41:56.898413 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.898572 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:41:56.898736 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.898899 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:41:56.899355 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.899537 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:41:56.899698 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.899895 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:41:56.900067 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.900231 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:41:56.900395 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.900553 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:41:56.900704 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.900854 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:41:56.901004 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.901163 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:41:56.901323 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.901475 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:41:56.901624 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.901782 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:41:56.901992 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.902150 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:41:56.902321 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.902478 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:41:56.902628 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.902778 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:41:56.902941 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.903092 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:41:56.903242 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.903399 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:41:56.903567 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.903833 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:41:56.904023 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.904183 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:41:56.904342 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.904566 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:41:56.904732 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.904896 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:41:56.905047 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.905197 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:41:56.905369 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.905533 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:41:56.905684 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.905848 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:41:56.905998 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.906156 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:41:56.906306 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.906471 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:41:56.906628 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.906789 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 15:41:56.907118 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.907276 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.907437 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.907588 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.907754 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.907951 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.908115 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.908273 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.908430 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.908597 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.908851 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.909005 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.909163 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.909163 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.909163 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.909163 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.909163 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.909163 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.909163 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.909163 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.911125 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.911125 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.911438 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.911597 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.911758 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.911932 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.912088 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.912256 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.912256 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.912559 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.912722 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.912880 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.913037 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.913197 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.913347 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.913507 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.913658 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.913835 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.914084 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.914249 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.914400 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.914551 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.914708 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.920276 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.921718 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.921900 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.922062 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.922062 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.922388 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.922555 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.922719 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.922882 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.923042 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.923196 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.923354 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.923516 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.923667 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.923817 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.924081 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.924365 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.924563 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.924855 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.924855 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.925179 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.925332 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.925483 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.925647 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.925806 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.926061 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.926842 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.927004 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.927165 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.927332 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.927500 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.927651 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.927809 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.927996 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.928150 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.928528 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.928691 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.928843 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.928994 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.929144 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.929295 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.929457 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.929616 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.929786 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.929954 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.930114 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.930114 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.930654 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.930820 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.930982 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.931142 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.931293 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.931462 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.931616 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.931774 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.931989 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.932143 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.932293 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.932460 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.932620 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.932772 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.932929 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.933080 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.933230 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.933393 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.933554 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.933713 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.933864 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.934089 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.934256 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.934521 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.934681 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.934861 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.935031 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.935190 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.935355 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.935507 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.935667 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.935820 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.936006 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.936166 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.936337 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.936489 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.936683 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.936841 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.936998 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.937156 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.937319 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.937471 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.937621 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.937776 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.937928 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.938091 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.938250 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.938431 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.938739 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.938909 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.939071 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.939235 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.939386 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.939536 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.939699 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.939904 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.940065 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.940229 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.940399 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.940728 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.940894 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.941048 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.941048 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.941368 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.941553 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.941712 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.941895 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.942055 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.942213 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.942373 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.942538 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.942688 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.942854 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.943012 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.943177 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.943329 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.943485 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.943643 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.943793 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.943971 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.944136 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.944288 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.944438 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.944700 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.944859 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.945021 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.945186 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.945345 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.945495 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.945644 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.945800 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.945958 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.946121 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.946273 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.946423 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.946573 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.946731 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.946892 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.947052 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.947210 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.947369 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.947520 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.947677 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.947922 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.948091 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.948243 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.948401 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.948570 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.948890 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.949063 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.949234 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.949387 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.949536 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.949685 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.949841 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.950004 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.950162 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.950320 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.950478 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.950647 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.950647 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.951117 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.951276 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.951438 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.951596 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.951748 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.951965 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.952125 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.952125 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.952376 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.952474 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.952560 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.952658 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.952751 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.952837 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.952921 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.952998 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.953070 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.953154 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.953227 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.953297 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.953375 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.953447 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.953531 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.953603 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.953680 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.953759 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.953830 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.953906 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.953986 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.954059 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.954129 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.954205 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.954284 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.954284 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.954428 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.954501 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.954570 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.954640 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.954731 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.954805 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.954885 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.954972 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.955046 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.955123 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.955194 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.955273 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.955353 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.955439 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.955517 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.955589 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.955666 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.955747 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.955819 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.955919 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.955994 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.956064 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.956140 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.956140 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.956285 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.956285 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.956412 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.956481 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.956551 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.956633 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.956712 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.956712 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.956853 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.956930 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.957013 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.957013 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.957172 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.957301 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.957385 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.957467 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.957556 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.957628 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.957740 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.957740 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.957963 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.958060 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.958160 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.958240 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.958319 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.958390 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.958460 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.958543 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.958623 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.958695 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.958766 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.959113 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.959193 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.959277 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.959358 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.959430 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.959508 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.959586 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.959665 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.959750 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.959830 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.959924 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.960010 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.960091 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.960164 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.960247 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.960327 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.960407 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.960479 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.960556 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.960628 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.960710 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.960791 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.960888 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.961147 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.961255 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.961339 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.961413 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.961491 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.961563 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.961633 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.961703 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.961781 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.961862 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.961934 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.962004 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.962081 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.962152 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.962235 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.962307 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.962391 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.962471 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.962543 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.962613 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.962690 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.962763 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.962840 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.962918 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.962990 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.963068 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.963140 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.963209 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.963209 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.963209 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.963209 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.963462 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.963541 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.963620 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.963691 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.963761 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.963830 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.963957 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.964032 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.964101 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.964178 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.964249 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.964317 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.964317 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.964465 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.964544 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.964621 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.964698 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.964787 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.964860 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.964945 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.965023 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.965101 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.965172 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.965315 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.965396 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.965476 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.965548 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.965548 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.965673 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.965756 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.965835 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.965908 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.965984 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.966055 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.966055 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.966272 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.966347 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.966418 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.966495 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.966567 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.966645 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.966718 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.966795 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.966866 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.966935 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.967004 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.967102 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.967195 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.967277 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.967356 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.967428 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.967505 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.967589 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.967668 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.967740 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.967809 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.967908 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.967992 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.968077 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.968170 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.968243 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.968334 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.968427 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.968525 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.968618 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.968828 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.968947 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.969052 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.969139 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.969233 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.969319 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.969416 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.969416 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.969584 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.969670 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.969765 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.970019 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.970123 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.970237 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.970325 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.970410 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.970501 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.970600 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.970687 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.970783 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.970868 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.970952 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.971062 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.971161 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.971248 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.971345 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.971431 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.971522 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.971615 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.971615 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.971615 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.971615 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.971615 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.971615 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.971615 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.971615 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.972256 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.972256 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.972256 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.972256 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.972256 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.972256 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.972256 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.973305 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.973305 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.973588 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.973802 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.974199 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.974513 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.974830 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.975145 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.975467 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.975801 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.976145 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.976458 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.977028 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.977345 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.977865 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.978178 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.978511 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.978833 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.979156 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.979477 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.979794 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.980163 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.980467 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.980773 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.981082 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.981391 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.981696 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.982015 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.982324 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.982628 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.982946 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.983253 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.983793 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.983984 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.984170 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.984405 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.984515 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.984749 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.984851 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.985117 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.985213 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.985433 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.985522 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.985742 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.985848 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.986069 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.986170 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.986377 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.986477 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.986684 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.986790 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.987001 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.987093 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.987313 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.987416 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.987618 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.987712 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.987959 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.988274 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.989294 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.989656 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.989973 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.990281 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.990611 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.990919 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.991226 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.991531 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.991842 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.992120 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.992232 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.992459 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.992563 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.992767 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.992863 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.993071 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.993176 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.993382 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.993479 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.993686 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.993842 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.993996 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.994192 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.994292 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.994521 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.994618 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.994853 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.994952 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.995177 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.995281 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.995585 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.995683 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.995830 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.996074 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.996179 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.996409 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.996516 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.996732 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.996831 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.997051 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.997147 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.997373 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.997478 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.997684 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.997780 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.997999 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.998096 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.998345 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.998443 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.998664 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.998761 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.999014 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.999202 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.999329 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.999598 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.999702 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:56.999956 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.000055 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.000378 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.000493 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.000636 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.000804 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.000945 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.001151 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.001243 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.001550 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.001666 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.003885 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.003995 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.004112 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.004203 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.004283 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.004362 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.004433 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.004509 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.004580 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.004663 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.004735 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.004817 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.004889 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.004972 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.005044 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.005125 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.005207 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.005285 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.005363 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.005433 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.005534 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.005630 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.005710 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.005782 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.005850 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.005918 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.005994 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.007110 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.007217 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.007292 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.007361 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.007430 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.007513 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.007585 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.007660 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.007731 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.007808 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.007911 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.008004 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.008077 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.008146 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.008738 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.008833 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.008920 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.009001 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.009080 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.009151 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.009483 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.009604 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.009693 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.009772 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.010011 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.010105 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.010284 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.010376 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.011162 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.011265 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.011350 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.011423 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.011493 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.011572 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.011650 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.011872 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.011966 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.012315 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.012408 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.012492 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.012564 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.012807 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.012908 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.013092 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.013186 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.015891 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.016006 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.016006 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.016174 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.016255 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.016345 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.016930 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.017019 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.017109 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.017109 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.017109 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.017301 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.017378 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.017448 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.017526 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.017597 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.017673 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.017749 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.017819 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.017894 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.017978 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.018049 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.018117 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.018185 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.018253 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.019343 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.019421 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.019491 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.019559 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.019628 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.020288 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.020383 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.020468 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.020540 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.020609 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.020678 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.020787 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.020908 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.021006 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.021097 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.021167 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.021236 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.021305 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.021383 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.021455 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.021523 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.022385 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.022540 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.022698 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.022858 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.023007 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.023155 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.023311 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.023460 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.023621 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.023771 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.023953 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.024105 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.024268 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.024417 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.024573 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.024573 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.024573 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.025062 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.025274 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.025274 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.025569 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.025717 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.025871 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.026021 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.026179 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.026352 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.026503 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.026657 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.026657 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.027054 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.027212 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.027376 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.027526 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.027674 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.027822 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.028036 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.028198 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=122225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 27 15:41:57.028364 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.028364 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.028645 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.029704 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.029704 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.029704 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.030169 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.030316 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.030869 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.031196 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.031533 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.032130 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.032384 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.032705 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.033103 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.033428 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.033833 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.034274 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.034599 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.034916 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.036034 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.036370 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.036851 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.037589 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.037928 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.038267 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.038588 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.038915 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.039239 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.039575 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.039938 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.040265 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.040599 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.040915 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.041249 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.041583 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.041910 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.042244 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.042669 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.043000 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.043322 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.043654 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.044012 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.044330 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.044647 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.044968 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.045284 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.045600 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.045932 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.046246 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.046757 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.047252 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.047583 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.047935 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.048256 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.048591 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.048909 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.049246 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.049568 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.049901 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.050233 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.050554 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.050913 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.051116 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_db.sqlalchemy.engines [None req-a6ca8af9-2dce-4dca-b02e-e189ebea0a4a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122225) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 27 15:41:57.051238 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.051554 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.051886 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.052203 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.052555 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.052871 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.053201 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.053543 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.053883 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.054206 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.054546 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.054884 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.055203 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.055529 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.055878 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.056371 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.056695 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.057014 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.057329 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.057644 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.057959 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.058279 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.058590 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.058900 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.059947 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.059947 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.060294 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.060454 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.060659 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.061001 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.061282 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.061595 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.061944 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.062303 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.062663 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.062998 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.063331 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.063764 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.064053 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.064389 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.064782 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.065042 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.065385 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.065730 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.066074 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.066400 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.066779 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.067066 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.067442 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.067795 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.068200 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.068868 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.069306 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.069607 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.069990 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.070321 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.070650 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.070975 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.071299 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.071621 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.071969 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.072298 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.072635 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.072965 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.073297 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.073641 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.073968 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.074293 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.074616 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.074985 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.075302 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.075626 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.075981 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.076307 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.076632 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.076956 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.077276 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.077595 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.077916 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.078238 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.078555 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.078874 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.079220 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.079544 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.079974 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.080232 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.080565 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.080887 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.081210 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.081534 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.082090 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.083002 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.083437 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.083779 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.084184 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.084516 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.084844 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.085178 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.085494 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.085808 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.086127 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.086447 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.086761 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.087091 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.087409 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.087720 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.088071 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.088389 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.088932 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.089288 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.089612 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.089944 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.090275 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.090600 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.090921 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.091249 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.091562 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.091891 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.092215 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.092535 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.092846 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.093158 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.093473 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.093785 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.094096 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.094412 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.094723 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.095055 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.095369 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.095680 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.096041 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.096345 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.096658 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.096993 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.097306 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.097618 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.098752 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.099458 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.099789 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.100133 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.100459 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.100774 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.101094 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.101414 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.102011 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.102323 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.102635 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.102962 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.103361 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.103727 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.104077 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.104401 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.104757 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.105082 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.105637 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.106025 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.106356 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.106707 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.107054 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.107371 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.107684 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.108020 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.108351 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.108670 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.108989 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.109305 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.109623 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.109943 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.110260 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.110580 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.110895 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.111212 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.111607 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.111904 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.112232 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.112554 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.112878 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.113197 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.113564 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.114052 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.114374 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.114702 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.115038 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.115362 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.115675 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.116131 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.116454 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.116781 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.117107 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.117424 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.117752 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.118081 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.118399 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.118727 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.119046 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.119382 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.119727 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.120097 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.120433 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.120744 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.121056 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.121366 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.121685 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.122022 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.122345 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.122673 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.122986 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.123313 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.123627 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.123975 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.124303 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.124626 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.124940 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.125279 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.125600 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.125918 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.126237 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.126615 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.126936 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.127255 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.127587 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.127944 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.128279 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.128627 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.128953 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.129394 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.129679 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.130094 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.130457 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.130784 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.131109 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.131435 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.131757 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.132106 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.132431 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.132766 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.133099 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.133463 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.133796 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.134148 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.134467 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.134818 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.135151 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 15:41:57.135399 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=122224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 27 15:41:57.139107 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.context [None req-a6ca8af9-2dce-4dca-b02e-e189ebea0a4a None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),c943b248-24a3-4c90-8911-04b0b8d5cf35(cell1) {{(pid=122225) load_cells /opt/stack/nova/nova/context.py:464}} Oct 27 15:41:57.143562 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-a6ca8af9-2dce-4dca-b02e-e189ebea0a4a None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:41:57.145631 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-a6ca8af9-2dce-4dca-b02e-e189ebea0a4a None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:41:57.146438 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-a6ca8af9-2dce-4dca-b02e-e189ebea0a4a None None] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:41:57.148588 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-a6ca8af9-2dce-4dca-b02e-e189ebea0a4a None None] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:41:57.158616 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_db.sqlalchemy.engines [None req-28aae371-9e77-4c27-a9c4-aace81ab9b96 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122224) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 27 15:41:57.159547 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_db.sqlalchemy.engines [None req-a6ca8af9-2dce-4dca-b02e-e189ebea0a4a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122225) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 27 15:41:57.161677 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_db.sqlalchemy.engines [None req-a6ca8af9-2dce-4dca-b02e-e189ebea0a4a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122225) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 27 15:41:57.240701 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.context [None req-28aae371-9e77-4c27-a9c4-aace81ab9b96 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),c943b248-24a3-4c90-8911-04b0b8d5cf35(cell1) {{(pid=122224) load_cells /opt/stack/nova/nova/context.py:464}} Oct 27 15:41:57.245112 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-28aae371-9e77-4c27-a9c4-aace81ab9b96 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:41:57.246678 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-28aae371-9e77-4c27-a9c4-aace81ab9b96 None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:41:57.247480 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-28aae371-9e77-4c27-a9c4-aace81ab9b96 None None] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:41:57.249434 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-28aae371-9e77-4c27-a9c4-aace81ab9b96 None None] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:41:57.260112 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_db.sqlalchemy.engines [None req-28aae371-9e77-4c27-a9c4-aace81ab9b96 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122224) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 27 15:41:57.260931 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_db.sqlalchemy.engines [None req-28aae371-9e77-4c27-a9c4-aace81ab9b96 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122224) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 27 15:41:57.422210 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_db.sqlalchemy.engines [None req-a6ca8af9-2dce-4dca-b02e-e189ebea0a4a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122225) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 27 15:41:57.527210 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_db.sqlalchemy.engines [None req-28aae371-9e77-4c27-a9c4-aace81ab9b96 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122224) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 27 15:41:57.749957 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: WARNING keystonemiddleware.auth_token [None req-a6ca8af9-2dce-4dca-b02e-e189ebea0a4a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 27 15:41:57.757866 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: WARNING keystonemiddleware.auth_token [None req-a6ca8af9-2dce-4dca-b02e-e189ebea0a4a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 27 15:41:57.857702 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: WARNING keystonemiddleware.auth_token [None req-28aae371-9e77-4c27-a9c4-aace81ab9b96 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 27 15:41:57.864844 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: WARNING keystonemiddleware.auth_token [None req-28aae371-9e77-4c27-a9c4-aace81ab9b96 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 27 15:41:58.119003 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: WARNING keystonemiddleware.auth_token [None req-a6ca8af9-2dce-4dca-b02e-e189ebea0a4a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 27 15:41:58.124319 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: WARNING keystonemiddleware.auth_token [None req-a6ca8af9-2dce-4dca-b02e-e189ebea0a4a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 27 15:41:58.130424 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55c85408d9c0 pid: 122225 (default app) Oct 27 15:41:58.217361 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: WARNING keystonemiddleware.auth_token [None req-28aae371-9e77-4c27-a9c4-aace81ab9b96 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 27 15:41:58.222679 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: WARNING keystonemiddleware.auth_token [None req-28aae371-9e77-4c27-a9c4-aace81ab9b96 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 27 15:41:58.228324 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55c85408d9c0 pid: 122224 (default app) Oct 27 15:42:34.269585 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-40e750e1-da9f-4ef5-af51-a5473498e51a tempest-DeleteServersTestJSON-752571955 tempest-DeleteServersTestJSON-752571955-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1367145052", "imageRef": "b585ffbc-6a36-48c9-81b3-e26f9bd0fcba", "flavorRef": "452", "networks": [{"uuid": "d43db4f4-bda3-4f8b-ae8d-53614dba9331"}]}} {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 15:42:34.355298 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-ba76875c-c71b-487b-9a40-cdadb7430111 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-728428587", "imageRef": "b585ffbc-6a36-48c9-81b3-e26f9bd0fcba", "flavorRef": "452", "networks": [{"uuid": "d9775d1d-2e09-490f-b5c0-23cc640635a9"}]}} {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 15:42:34.904951 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.network.neutron [None req-40e750e1-da9f-4ef5-af51-a5473498e51a tempest-DeleteServersTestJSON-752571955 tempest-DeleteServersTestJSON-752571955-project] validate_networks() for [('d43db4f4-bda3-4f8b-ae8d-53614dba9331', None, None, None, None, None)] {{(pid=122224) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Oct 27 15:42:35.148067 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.network.neutron [None req-ba76875c-c71b-487b-9a40-cdadb7430111 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] validate_networks() for [('d9775d1d-2e09-490f-b5c0-23cc640635a9', None, None, None, None, None)] {{(pid=122225) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Oct 27 15:42:36.582314 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.virt.hardware [None req-40e750e1-da9f-4ef5-af51-a5473498e51a tempest-DeleteServersTestJSON-752571955 tempest-DeleteServersTestJSON-752571955-project] Flavor limits 0:0:0 {{(pid=122224) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 15:42:36.583003 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.virt.hardware [None req-40e750e1-da9f-4ef5-af51-a5473498e51a tempest-DeleteServersTestJSON-752571955 tempest-DeleteServersTestJSON-752571955-project] Image limits 0:0:0 {{(pid=122224) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 15:42:36.583220 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.virt.hardware [None req-40e750e1-da9f-4ef5-af51-a5473498e51a tempest-DeleteServersTestJSON-752571955 tempest-DeleteServersTestJSON-752571955-project] Flavor pref 0:0:0 {{(pid=122224) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 15:42:36.583598 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.virt.hardware [None req-40e750e1-da9f-4ef5-af51-a5473498e51a tempest-DeleteServersTestJSON-752571955 tempest-DeleteServersTestJSON-752571955-project] Image pref 0:0:0 {{(pid=122224) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 15:42:36.584031 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.virt.hardware [None req-40e750e1-da9f-4ef5-af51-a5473498e51a tempest-DeleteServersTestJSON-752571955 tempest-DeleteServersTestJSON-752571955-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122224) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 15:42:36.646254 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-40e750e1-da9f-4ef5-af51-a5473498e51a tempest-DeleteServersTestJSON-752571955 tempest-DeleteServersTestJSON-752571955-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:42:36.646915 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-40e750e1-da9f-4ef5-af51-a5473498e51a tempest-DeleteServersTestJSON-752571955 tempest-DeleteServersTestJSON-752571955-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:42:36.648795 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-40e750e1-da9f-4ef5-af51-a5473498e51a tempest-DeleteServersTestJSON-752571955 tempest-DeleteServersTestJSON-752571955-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:42:36.654807 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-40e750e1-da9f-4ef5-af51-a5473498e51a tempest-DeleteServersTestJSON-752571955 tempest-DeleteServersTestJSON-752571955-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:42:36.772463 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.virt.hardware [None req-ba76875c-c71b-487b-9a40-cdadb7430111 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Flavor limits 0:0:0 {{(pid=122225) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 15:42:36.773585 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.virt.hardware [None req-ba76875c-c71b-487b-9a40-cdadb7430111 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Image limits 0:0:0 {{(pid=122225) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 15:42:36.775033 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.virt.hardware [None req-ba76875c-c71b-487b-9a40-cdadb7430111 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Flavor pref 0:0:0 {{(pid=122225) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 15:42:36.775839 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.virt.hardware [None req-ba76875c-c71b-487b-9a40-cdadb7430111 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Image pref 0:0:0 {{(pid=122225) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 15:42:36.777254 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.virt.hardware [None req-ba76875c-c71b-487b-9a40-cdadb7430111 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122225) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 15:42:36.779127 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.quota [None req-40e750e1-da9f-4ef5-af51-a5473498e51a tempest-DeleteServersTestJSON-752571955 tempest-DeleteServersTestJSON-752571955-project] Getting quotas for project be9d7084d7ab4e408be53dd27f8748a0. Resources: {'ram', 'instances', 'cores'} {{(pid=122224) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 27 15:42:36.793840 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.quota [None req-40e750e1-da9f-4ef5-af51-a5473498e51a tempest-DeleteServersTestJSON-752571955 tempest-DeleteServersTestJSON-752571955-project] Getting quotas for user cf1a0e4ab3ab4008a25339e4eda7a48d and project be9d7084d7ab4e408be53dd27f8748a0. Resources: {'ram', 'instances', 'cores'} {{(pid=122224) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 27 15:42:36.806176 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-ba76875c-c71b-487b-9a40-cdadb7430111 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:42:36.806615 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-ba76875c-c71b-487b-9a40-cdadb7430111 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:42:36.807522 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-ba76875c-c71b-487b-9a40-cdadb7430111 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:42:36.807968 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-ba76875c-c71b-487b-9a40-cdadb7430111 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:42:36.824345 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-40e750e1-da9f-4ef5-af51-a5473498e51a tempest-DeleteServersTestJSON-752571955 tempest-DeleteServersTestJSON-752571955-project] Going to run 1 instances... {{(pid=122224) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Oct 27 15:42:36.830712 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-40e750e1-da9f-4ef5-af51-a5473498e51a tempest-DeleteServersTestJSON-752571955 tempest-DeleteServersTestJSON-752571955-project] [instance: 6cc17348-b41d-46ba-a1d6-9f80614b7596] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b585ffbc-6a36-48c9-81b3-e26f9bd0fcba',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122224) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Oct 27 15:42:36.882156 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.quota [None req-ba76875c-c71b-487b-9a40-cdadb7430111 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Getting quotas for project 4fc48df471f247809d82ddf926bfdc6c. Resources: {'ram', 'instances', 'cores'} {{(pid=122225) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 27 15:42:36.907332 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.quota [None req-ba76875c-c71b-487b-9a40-cdadb7430111 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Getting quotas for user 0abe23cb5f314bc883ef7958b0ed9b5f and project 4fc48df471f247809d82ddf926bfdc6c. Resources: {'ram', 'instances', 'cores'} {{(pid=122225) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 27 15:42:36.931661 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-ba76875c-c71b-487b-9a40-cdadb7430111 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Going to run 1 instances... {{(pid=122225) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Oct 27 15:42:36.936493 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-ba76875c-c71b-487b-9a40-cdadb7430111 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] [instance: a4e225e4-7815-4f6a-b1e6-53edab3c1abd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b585ffbc-6a36-48c9-81b3-e26f9bd0fcba',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122225) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Oct 27 15:42:37.044119 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-40e750e1-da9f-4ef5-af51-a5473498e51a tempest-DeleteServersTestJSON-752571955 tempest-DeleteServersTestJSON-752571955-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.317434 Oct 27 15:42:37.044775 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 1/1] 10.222.0.64 () {60 vars in 1146 bytes} [Wed Oct 27 15:42:33 2021] POST /compute/v2.1/servers => generated 380 bytes in 3320 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 15:42:37.060948 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-fb00b01b-06f2-4b4b-bb73-88f175113bd5 tempest-VolumesTestJSON-1049566844 tempest-VolumesTestJSON-1049566844-project] Calling method '.version_select at 0x7fbc072a68b0>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:42:37.140353 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-ba76875c-c71b-487b-9a40-cdadb7430111 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.651133 Oct 27 15:42:37.142111 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 1/2] 10.222.0.64 () {60 vars in 1146 bytes} [Wed Oct 27 15:42:33 2021] POST /compute/v2.1/servers => generated 380 bytes in 3655 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 15:42:37.165538 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-a6169e98-617d-40ae-bded-17e881ca9a89 tempest-DeleteServersTestJSON-752571955 tempest-DeleteServersTestJSON-752571955-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:42:37.166501 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-a6169e98-617d-40ae-bded-17e881ca9a89 tempest-DeleteServersTestJSON-752571955 tempest-DeleteServersTestJSON-752571955-project] [instance: 6cc17348-b41d-46ba-a1d6-9f80614b7596] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:42:37.267835 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-fb00b01b-06f2-4b4b-bb73-88f175113bd5 tempest-VolumesTestJSON-1049566844 tempest-VolumesTestJSON-1049566844-project] 10.222.0.64 "GET /compute/v2.1/os-volumes/252ad442-bdb1-4d57-894f-67b20a4879ce" status: 200 len: 351 microversion: 2.1 time: 0.210680 Oct 27 15:42:37.269579 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 2/3] 10.222.0.64 () {58 vars in 1244 bytes} [Wed Oct 27 15:42:37 2021] GET /compute/v2.1/os-volumes/252ad442-bdb1-4d57-894f-67b20a4879ce => generated 351 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 15:42:37.279711 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-0efd7350-5e9c-4d08-b5fa-add70580129e tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:42:37.281820 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-0efd7350-5e9c-4d08-b5fa-add70580129e tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] [instance: a4e225e4-7815-4f6a-b1e6-53edab3c1abd] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:42:37.553957 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-0efd7350-5e9c-4d08-b5fa-add70580129e tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0abe23cb5f314bc883ef7958b0ed9b5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fc48df471f247809d82ddf926bfdc6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:42:37.592404 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-0efd7350-5e9c-4d08-b5fa-add70580129e tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] 10.222.0.64 "GET /compute/v2.1/servers/a4e225e4-7815-4f6a-b1e6-53edab3c1abd" status: 200 len: 1217 microversion: 2.1 time: 0.320509 Oct 27 15:42:37.595348 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 3/4] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:42:37 2021] GET /compute/v2.1/servers/a4e225e4-7815-4f6a-b1e6-53edab3c1abd => generated 1217 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 15:42:37.854849 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-a6169e98-617d-40ae-bded-17e881ca9a89 tempest-DeleteServersTestJSON-752571955 tempest-DeleteServersTestJSON-752571955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf1a0e4ab3ab4008a25339e4eda7a48d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be9d7084d7ab4e408be53dd27f8748a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:42:37.896772 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-a6169e98-617d-40ae-bded-17e881ca9a89 tempest-DeleteServersTestJSON-752571955 tempest-DeleteServersTestJSON-752571955-project] 10.222.0.64 "GET /compute/v2.1/servers/6cc17348-b41d-46ba-a1d6-9f80614b7596" status: 200 len: 1215 microversion: 2.1 time: 0.753019 Oct 27 15:42:37.902756 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 2/5] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:42:37 2021] GET /compute/v2.1/servers/6cc17348-b41d-46ba-a1d6-9f80614b7596 => generated 1215 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 15:42:38.611978 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-7dc18822-ac8a-4097-8848-167d13eb8583 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:42:38.617305 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-7dc18822-ac8a-4097-8848-167d13eb8583 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] [instance: a4e225e4-7815-4f6a-b1e6-53edab3c1abd] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:42:38.775118 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-7dc18822-ac8a-4097-8848-167d13eb8583 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0abe23cb5f314bc883ef7958b0ed9b5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fc48df471f247809d82ddf926bfdc6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:42:38.792900 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-7dc18822-ac8a-4097-8848-167d13eb8583 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] 10.222.0.64 "GET /compute/v2.1/servers/a4e225e4-7815-4f6a-b1e6-53edab3c1abd" status: 200 len: 1217 microversion: 2.1 time: 0.184624 Oct 27 15:42:38.797464 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 4/6] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:42:38 2021] GET /compute/v2.1/servers/a4e225e4-7815-4f6a-b1e6-53edab3c1abd => generated 1217 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 15:42:38.921136 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-7b56ba66-0aa8-4881-aabe-d1fc1803ab1d tempest-DeleteServersTestJSON-752571955 tempest-DeleteServersTestJSON-752571955-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:42:38.921136 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-7b56ba66-0aa8-4881-aabe-d1fc1803ab1d tempest-DeleteServersTestJSON-752571955 tempest-DeleteServersTestJSON-752571955-project] [instance: 6cc17348-b41d-46ba-a1d6-9f80614b7596] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:42:39.063324 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-7b56ba66-0aa8-4881-aabe-d1fc1803ab1d tempest-DeleteServersTestJSON-752571955 tempest-DeleteServersTestJSON-752571955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf1a0e4ab3ab4008a25339e4eda7a48d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be9d7084d7ab4e408be53dd27f8748a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:42:39.074877 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-7b56ba66-0aa8-4881-aabe-d1fc1803ab1d tempest-DeleteServersTestJSON-752571955 tempest-DeleteServersTestJSON-752571955-project] 10.222.0.64 "GET /compute/v2.1/servers/6cc17348-b41d-46ba-a1d6-9f80614b7596" status: 200 len: 1215 microversion: 2.1 time: 0.159114 Oct 27 15:42:39.075464 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 3/7] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:42:38 2021] GET /compute/v2.1/servers/6cc17348-b41d-46ba-a1d6-9f80614b7596 => generated 1215 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 15:42:39.816218 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-e76daa1b-fcc2-439a-92f4-15dfacbe5b1a tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:42:39.820526 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-e76daa1b-fcc2-439a-92f4-15dfacbe5b1a tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] [instance: a4e225e4-7815-4f6a-b1e6-53edab3c1abd] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:42:39.828301 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-e76daa1b-fcc2-439a-92f4-15dfacbe5b1a tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:42:39.830527 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-e76daa1b-fcc2-439a-92f4-15dfacbe5b1a tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:42:39.832843 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-e76daa1b-fcc2-439a-92f4-15dfacbe5b1a tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:42:39.833531 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-e76daa1b-fcc2-439a-92f4-15dfacbe5b1a tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:42:40.093292 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-cbb10e54-c101-4fae-9eee-a0e5abc437f0 tempest-DeleteServersTestJSON-752571955 tempest-DeleteServersTestJSON-752571955-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:42:40.095400 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-cbb10e54-c101-4fae-9eee-a0e5abc437f0 tempest-DeleteServersTestJSON-752571955 tempest-DeleteServersTestJSON-752571955-project] [instance: 6cc17348-b41d-46ba-a1d6-9f80614b7596] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:42:40.112948 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-cbb10e54-c101-4fae-9eee-a0e5abc437f0 tempest-DeleteServersTestJSON-752571955 tempest-DeleteServersTestJSON-752571955-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:42:40.114326 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-cbb10e54-c101-4fae-9eee-a0e5abc437f0 tempest-DeleteServersTestJSON-752571955 tempest-DeleteServersTestJSON-752571955-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:42:40.117477 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-cbb10e54-c101-4fae-9eee-a0e5abc437f0 tempest-DeleteServersTestJSON-752571955 tempest-DeleteServersTestJSON-752571955-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:42:40.118277 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-cbb10e54-c101-4fae-9eee-a0e5abc437f0 tempest-DeleteServersTestJSON-752571955 tempest-DeleteServersTestJSON-752571955-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:42:40.263941 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-e76daa1b-fcc2-439a-92f4-15dfacbe5b1a tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0abe23cb5f314bc883ef7958b0ed9b5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fc48df471f247809d82ddf926bfdc6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:42:40.289848 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-e76daa1b-fcc2-439a-92f4-15dfacbe5b1a tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] 10.222.0.64 "GET /compute/v2.1/servers/a4e225e4-7815-4f6a-b1e6-53edab3c1abd" status: 200 len: 1221 microversion: 2.1 time: 0.478927 Oct 27 15:42:40.302945 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 5/8] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:42:39 2021] GET /compute/v2.1/servers/a4e225e4-7815-4f6a-b1e6-53edab3c1abd => generated 1221 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 15:42:40.429338 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-cbb10e54-c101-4fae-9eee-a0e5abc437f0 tempest-DeleteServersTestJSON-752571955 tempest-DeleteServersTestJSON-752571955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf1a0e4ab3ab4008a25339e4eda7a48d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be9d7084d7ab4e408be53dd27f8748a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:42:40.445166 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-cbb10e54-c101-4fae-9eee-a0e5abc437f0 tempest-DeleteServersTestJSON-752571955 tempest-DeleteServersTestJSON-752571955-project] 10.222.0.64 "GET /compute/v2.1/servers/6cc17348-b41d-46ba-a1d6-9f80614b7596" status: 200 len: 1219 microversion: 2.1 time: 0.356329 Oct 27 15:42:40.454369 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 4/9] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:42:40 2021] GET /compute/v2.1/servers/6cc17348-b41d-46ba-a1d6-9f80614b7596 => generated 1219 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 15:42:41.290547 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-0259445c-4c17-4443-bd8a-d7236b737118 tempest-VolumesTestJSON-1049566844 tempest-VolumesTestJSON-1049566844-project] Calling method '.version_select at 0x7fbc069d68b0>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:42:41.310523 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-b1cc23e0-3bd6-474b-be48-469ee2fd5352 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:42:41.311892 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-b1cc23e0-3bd6-474b-be48-469ee2fd5352 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] [instance: a4e225e4-7815-4f6a-b1e6-53edab3c1abd] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:42:41.326566 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-b1cc23e0-3bd6-474b-be48-469ee2fd5352 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:42:41.329568 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-b1cc23e0-3bd6-474b-be48-469ee2fd5352 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:42:41.330603 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-b1cc23e0-3bd6-474b-be48-469ee2fd5352 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:42:41.336494 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-b1cc23e0-3bd6-474b-be48-469ee2fd5352 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:42:41.433502 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-0259445c-4c17-4443-bd8a-d7236b737118 tempest-VolumesTestJSON-1049566844 tempest-VolumesTestJSON-1049566844-project] 10.222.0.64 "GET /compute/v2.1/os-volumes/7ae9eeef-7233-4bb6-848f-d0cf81abf09b" status: 200 len: 351 microversion: 2.1 time: 0.147559 Oct 27 15:42:41.434186 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 6/10] 10.222.0.64 () {58 vars in 1244 bytes} [Wed Oct 27 15:42:41 2021] GET /compute/v2.1/os-volumes/7ae9eeef-7233-4bb6-848f-d0cf81abf09b => generated 351 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 15:42:41.465542 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-043a218b-b7f7-4209-980c-a4f6e28b5538 tempest-DeleteServersTestJSON-752571955 tempest-DeleteServersTestJSON-752571955-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:42:41.472568 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-043a218b-b7f7-4209-980c-a4f6e28b5538 tempest-DeleteServersTestJSON-752571955 tempest-DeleteServersTestJSON-752571955-project] [instance: 6cc17348-b41d-46ba-a1d6-9f80614b7596] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:42:41.491555 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-043a218b-b7f7-4209-980c-a4f6e28b5538 tempest-DeleteServersTestJSON-752571955 tempest-DeleteServersTestJSON-752571955-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:42:41.493605 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-043a218b-b7f7-4209-980c-a4f6e28b5538 tempest-DeleteServersTestJSON-752571955 tempest-DeleteServersTestJSON-752571955-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:42:41.494410 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-043a218b-b7f7-4209-980c-a4f6e28b5538 tempest-DeleteServersTestJSON-752571955 tempest-DeleteServersTestJSON-752571955-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:42:41.497641 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-043a218b-b7f7-4209-980c-a4f6e28b5538 tempest-DeleteServersTestJSON-752571955 tempest-DeleteServersTestJSON-752571955-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:42:41.609400 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-b1cc23e0-3bd6-474b-be48-469ee2fd5352 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0abe23cb5f314bc883ef7958b0ed9b5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fc48df471f247809d82ddf926bfdc6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:42:41.620200 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-b1cc23e0-3bd6-474b-be48-469ee2fd5352 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] 10.222.0.64 "GET /compute/v2.1/servers/a4e225e4-7815-4f6a-b1e6-53edab3c1abd" status: 200 len: 1213 microversion: 2.1 time: 0.313250 Oct 27 15:42:41.630557 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 5/11] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:42:41 2021] GET /compute/v2.1/servers/a4e225e4-7815-4f6a-b1e6-53edab3c1abd => generated 1213 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 15:42:41.646575 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-043a218b-b7f7-4209-980c-a4f6e28b5538 tempest-DeleteServersTestJSON-752571955 tempest-DeleteServersTestJSON-752571955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf1a0e4ab3ab4008a25339e4eda7a48d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be9d7084d7ab4e408be53dd27f8748a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:42:41.668048 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-043a218b-b7f7-4209-980c-a4f6e28b5538 tempest-DeleteServersTestJSON-752571955 tempest-DeleteServersTestJSON-752571955-project] 10.222.0.64 "GET /compute/v2.1/servers/6cc17348-b41d-46ba-a1d6-9f80614b7596" status: 200 len: 1211 microversion: 2.1 time: 0.206758 Oct 27 15:42:41.670536 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 7/12] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:42:41 2021] GET /compute/v2.1/servers/6cc17348-b41d-46ba-a1d6-9f80614b7596 => generated 1211 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 15:42:41.851360 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-e815490e-6d39-41cc-93bf-e6b53de103f8 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-423458374", "imageRef": "b585ffbc-6a36-48c9-81b3-e26f9bd0fcba", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "0b177597-79d5-4c2d-b37e-cfbfcdd1361f"}]}} {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 15:42:41.962713 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.network.neutron [None req-e815490e-6d39-41cc-93bf-e6b53de103f8 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] validate_networks() for [('0b177597-79d5-4c2d-b37e-cfbfcdd1361f', None, None, None, None, None)] {{(pid=122225) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Oct 27 15:42:42.638605 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-d51d2938-1cc3-4661-adba-ec8f2951d81c tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:42:42.639900 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-d51d2938-1cc3-4661-adba-ec8f2951d81c tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] [instance: a4e225e4-7815-4f6a-b1e6-53edab3c1abd] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:42:42.653831 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-d51d2938-1cc3-4661-adba-ec8f2951d81c tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:42:42.655729 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-d51d2938-1cc3-4661-adba-ec8f2951d81c tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:42:42.659009 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-d51d2938-1cc3-4661-adba-ec8f2951d81c tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:42:42.661078 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-d51d2938-1cc3-4661-adba-ec8f2951d81c tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:42:42.841842 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-d51d2938-1cc3-4661-adba-ec8f2951d81c tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0abe23cb5f314bc883ef7958b0ed9b5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fc48df471f247809d82ddf926bfdc6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:42:42.858003 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-d51d2938-1cc3-4661-adba-ec8f2951d81c tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] 10.222.0.64 "GET /compute/v2.1/servers/a4e225e4-7815-4f6a-b1e6-53edab3c1abd" status: 200 len: 1277 microversion: 2.1 time: 0.224613 Oct 27 15:42:42.859073 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 8/13] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:42:42 2021] GET /compute/v2.1/servers/a4e225e4-7815-4f6a-b1e6-53edab3c1abd => generated 1277 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 15:42:42.868766 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-43dc8cd8-2124-46dd-af29-20cd04b47fb9 tempest-DeleteServersTestJSON-752571955 tempest-DeleteServersTestJSON-752571955-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:42:42.877602 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-43dc8cd8-2124-46dd-af29-20cd04b47fb9 tempest-DeleteServersTestJSON-752571955 tempest-DeleteServersTestJSON-752571955-project] [instance: 6cc17348-b41d-46ba-a1d6-9f80614b7596] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:42:42.903248 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-43dc8cd8-2124-46dd-af29-20cd04b47fb9 tempest-DeleteServersTestJSON-752571955 tempest-DeleteServersTestJSON-752571955-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:42:42.904056 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-43dc8cd8-2124-46dd-af29-20cd04b47fb9 tempest-DeleteServersTestJSON-752571955 tempest-DeleteServersTestJSON-752571955-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:42:42.904943 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-43dc8cd8-2124-46dd-af29-20cd04b47fb9 tempest-DeleteServersTestJSON-752571955 tempest-DeleteServersTestJSON-752571955-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:42:42.912554 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-43dc8cd8-2124-46dd-af29-20cd04b47fb9 tempest-DeleteServersTestJSON-752571955 tempest-DeleteServersTestJSON-752571955-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:42:43.156733 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-43dc8cd8-2124-46dd-af29-20cd04b47fb9 tempest-DeleteServersTestJSON-752571955 tempest-DeleteServersTestJSON-752571955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf1a0e4ab3ab4008a25339e4eda7a48d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be9d7084d7ab4e408be53dd27f8748a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:42:43.165793 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-43dc8cd8-2124-46dd-af29-20cd04b47fb9 tempest-DeleteServersTestJSON-752571955 tempest-DeleteServersTestJSON-752571955-project] 10.222.0.64 "GET /compute/v2.1/servers/6cc17348-b41d-46ba-a1d6-9f80614b7596" status: 200 len: 1267 microversion: 2.1 time: 0.304416 Oct 27 15:42:43.179109 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 9/14] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:42:42 2021] GET /compute/v2.1/servers/6cc17348-b41d-46ba-a1d6-9f80614b7596 => generated 1267 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 15:42:43.183879 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-c33daf01-31f2-4a35-84c4-f21544884746 tempest-VolumesTestJSON-1049566844 tempest-VolumesTestJSON-1049566844-project] Calling method '.version_select at 0x7fbc069d6ca0>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:42:43.319514 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-c33daf01-31f2-4a35-84c4-f21544884746 tempest-VolumesTestJSON-1049566844 tempest-VolumesTestJSON-1049566844-project] 10.222.0.64 "GET /compute/v2.1/os-volumes/b0911728-879a-431a-8829-c93da9177a82" status: 200 len: 350 microversion: 2.1 time: 0.139114 Oct 27 15:42:43.320592 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 10/15] 10.222.0.64 () {58 vars in 1244 bytes} [Wed Oct 27 15:42:43 2021] GET /compute/v2.1/os-volumes/b0911728-879a-431a-8829-c93da9177a82 => generated 350 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 15:42:43.333581 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-dfe002aa-290d-402b-b703-9d10aabe8c51 tempest-VolumesTestJSON-1049566844 tempest-VolumesTestJSON-1049566844-project] Calling method '.version_select at 0x7fbc06aa08b0>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:42:43.537956 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-dfe002aa-290d-402b-b703-9d10aabe8c51 tempest-VolumesTestJSON-1049566844 tempest-VolumesTestJSON-1049566844-project] 10.222.0.64 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.209463 Oct 27 15:42:43.539008 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 11/16] 10.222.0.64 () {58 vars in 1133 bytes} [Wed Oct 27 15:42:43 2021] GET /compute/v2.1/os-volumes => generated 1035 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 15:42:43.561430 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-42c3f158-760c-4a09-94b8-97a262a3d3c6 tempest-VolumesTestJSON-1049566844 tempest-VolumesTestJSON-1049566844-project] Calling method '.version_select at 0x7fbc06930820>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:42:43.785395 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-42c3f158-760c-4a09-94b8-97a262a3d3c6 tempest-VolumesTestJSON-1049566844 tempest-VolumesTestJSON-1049566844-project] 10.222.0.64 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.237562 Oct 27 15:42:43.793044 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 12/17] 10.222.0.64 () {58 vars in 1148 bytes} [Wed Oct 27 15:42:43 2021] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 15:42:43.798506 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-070ccebe-9dc2-4a07-b843-66270dd7b18e tempest-VolumesTestJSON-1049566844 tempest-VolumesTestJSON-1049566844-project] Calling method '.version_select at 0x7fbc06930dc0>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:42:43.818958 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.virt.hardware [None req-e815490e-6d39-41cc-93bf-e6b53de103f8 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Flavor limits 0:0:0 {{(pid=122225) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 15:42:43.820488 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.virt.hardware [None req-e815490e-6d39-41cc-93bf-e6b53de103f8 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Image limits 0:0:0 {{(pid=122225) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 15:42:43.821201 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.virt.hardware [None req-e815490e-6d39-41cc-93bf-e6b53de103f8 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Flavor pref 0:0:0 {{(pid=122225) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 15:42:43.823149 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.virt.hardware [None req-e815490e-6d39-41cc-93bf-e6b53de103f8 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Image pref 0:0:0 {{(pid=122225) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 15:42:43.823759 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.virt.hardware [None req-e815490e-6d39-41cc-93bf-e6b53de103f8 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122225) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 15:42:43.855740 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-e815490e-6d39-41cc-93bf-e6b53de103f8 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:42:43.870801 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-e815490e-6d39-41cc-93bf-e6b53de103f8 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:42:43.874671 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-e815490e-6d39-41cc-93bf-e6b53de103f8 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:42:43.880464 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-e815490e-6d39-41cc-93bf-e6b53de103f8 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:42:43.931340 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.quota [None req-e815490e-6d39-41cc-93bf-e6b53de103f8 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Getting quotas for project 00d7fcab5d3f465793d650f16c6ea8de. Resources: {'ram', 'instances', 'cores'} {{(pid=122225) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 27 15:42:43.940801 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.quota [None req-e815490e-6d39-41cc-93bf-e6b53de103f8 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Getting quotas for user 96b599f8890b4281a7e311cf37a039e1 and project 00d7fcab5d3f465793d650f16c6ea8de. Resources: {'ram', 'instances', 'cores'} {{(pid=122225) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 27 15:42:43.970690 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-e815490e-6d39-41cc-93bf-e6b53de103f8 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Going to run 1 instances... {{(pid=122225) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Oct 27 15:42:43.973848 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-e815490e-6d39-41cc-93bf-e6b53de103f8 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: 62c89161-c119-48b2-839d-712db798ff96] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b585ffbc-6a36-48c9-81b3-e26f9bd0fcba',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122225) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Oct 27 15:42:44.037377 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-070ccebe-9dc2-4a07-b843-66270dd7b18e tempest-VolumesTestJSON-1049566844 tempest-VolumesTestJSON-1049566844-project] 10.222.0.64 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.242294 Oct 27 15:42:44.040350 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 13/18] 10.222.0.64 () {58 vars in 1133 bytes} [Wed Oct 27 15:42:43 2021] GET /compute/v2.1/os-volumes => generated 1035 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 15:42:44.050969 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-71ba3ee2-dbf9-42c0-85db-f3f1e7986b39 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:42:44.054400 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-71ba3ee2-dbf9-42c0-85db-f3f1e7986b39 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] [instance: a4e225e4-7815-4f6a-b1e6-53edab3c1abd] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:42:44.068253 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-e815490e-6d39-41cc-93bf-e6b53de103f8 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.443493 Oct 27 15:42:44.070146 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 6/19] 10.222.0.64 () {60 vars in 1146 bytes} [Wed Oct 27 15:42:41 2021] POST /compute/v2.1/servers => generated 383 bytes in 2446 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 15:42:44.083017 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-71ba3ee2-dbf9-42c0-85db-f3f1e7986b39 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:42:44.083757 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-d083f785-29f8-4e08-bfdf-7aa42ff19f59 tempest-VolumesTestJSON-1049566844 tempest-VolumesTestJSON-1049566844-project] Calling method '.version_select at 0x7fbc069fe4c0>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:42:44.089274 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-71ba3ee2-dbf9-42c0-85db-f3f1e7986b39 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:42:44.092485 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-71ba3ee2-dbf9-42c0-85db-f3f1e7986b39 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:42:44.093265 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-71ba3ee2-dbf9-42c0-85db-f3f1e7986b39 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:42:44.375447 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-71ba3ee2-dbf9-42c0-85db-f3f1e7986b39 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0abe23cb5f314bc883ef7958b0ed9b5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fc48df471f247809d82ddf926bfdc6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:42:44.386706 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-71ba3ee2-dbf9-42c0-85db-f3f1e7986b39 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] 10.222.0.64 "GET /compute/v2.1/servers/a4e225e4-7815-4f6a-b1e6-53edab3c1abd" status: 200 len: 1275 microversion: 2.1 time: 0.343812 Oct 27 15:42:44.388558 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 14/20] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:42:44 2021] GET /compute/v2.1/servers/a4e225e4-7815-4f6a-b1e6-53edab3c1abd => generated 1275 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 15:42:44.403098 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-d035b781-755e-42c2-8341-c133e4fc2250 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:42:44.406694 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-d035b781-755e-42c2-8341-c133e4fc2250 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: 62c89161-c119-48b2-839d-712db798ff96] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:42:44.514976 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-d083f785-29f8-4e08-bfdf-7aa42ff19f59 tempest-VolumesTestJSON-1049566844 tempest-VolumesTestJSON-1049566844-project] 10.222.0.64 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.438268 Oct 27 15:42:44.516476 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 7/21] 10.222.0.64 () {58 vars in 1166 bytes} [Wed Oct 27 15:42:44 2021] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 15:42:44.521634 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-f1769aef-ef7a-4a16-8964-1a67c3696dbb tempest-DeleteServersTestJSON-752571955 tempest-DeleteServersTestJSON-752571955-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:42:44.522543 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-f1769aef-ef7a-4a16-8964-1a67c3696dbb tempest-DeleteServersTestJSON-752571955 tempest-DeleteServersTestJSON-752571955-project] [instance: 6cc17348-b41d-46ba-a1d6-9f80614b7596] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:42:44.537890 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-f1769aef-ef7a-4a16-8964-1a67c3696dbb tempest-DeleteServersTestJSON-752571955 tempest-DeleteServersTestJSON-752571955-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:42:44.541253 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-f1769aef-ef7a-4a16-8964-1a67c3696dbb tempest-DeleteServersTestJSON-752571955 tempest-DeleteServersTestJSON-752571955-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:42:44.542403 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-f1769aef-ef7a-4a16-8964-1a67c3696dbb tempest-DeleteServersTestJSON-752571955 tempest-DeleteServersTestJSON-752571955-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:42:44.543047 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-f1769aef-ef7a-4a16-8964-1a67c3696dbb tempest-DeleteServersTestJSON-752571955 tempest-DeleteServersTestJSON-752571955-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:42:44.570737 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-d035b781-755e-42c2-8341-c133e4fc2250 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96b599f8890b4281a7e311cf37a039e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d7fcab5d3f465793d650f16c6ea8de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:42:44.578272 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-d035b781-755e-42c2-8341-c133e4fc2250 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96" status: 200 len: 1221 microversion: 2.1 time: 0.188110 Oct 27 15:42:44.579468 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 15/22] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:42:44 2021] GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96 => generated 1221 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 15:42:44.589562 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-23bf7a34-beec-4975-bbc7-9cacbca7ba13 tempest-VolumesTestJSON-1049566844 tempest-VolumesTestJSON-1049566844-project] Calling method '.version_select at 0x7fbc06928040>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:42:44.880925 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-23bf7a34-beec-4975-bbc7-9cacbca7ba13 tempest-VolumesTestJSON-1049566844 tempest-VolumesTestJSON-1049566844-project] 10.222.0.64 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.297420 Oct 27 15:42:44.889103 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 16/23] 10.222.0.64 () {58 vars in 1169 bytes} [Wed Oct 27 15:42:44 2021] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 15:42:44.917613 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-f1769aef-ef7a-4a16-8964-1a67c3696dbb tempest-DeleteServersTestJSON-752571955 tempest-DeleteServersTestJSON-752571955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf1a0e4ab3ab4008a25339e4eda7a48d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be9d7084d7ab4e408be53dd27f8748a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:42:44.949561 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-f1769aef-ef7a-4a16-8964-1a67c3696dbb tempest-DeleteServersTestJSON-752571955 tempest-DeleteServersTestJSON-752571955-project] 10.222.0.64 "GET /compute/v2.1/servers/6cc17348-b41d-46ba-a1d6-9f80614b7596" status: 200 len: 1273 microversion: 2.1 time: 0.429511 Oct 27 15:42:44.953048 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 8/24] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:42:44 2021] GET /compute/v2.1/servers/6cc17348-b41d-46ba-a1d6-9f80614b7596 => generated 1273 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 15:42:44.971230 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-c9659886-2891-42d5-9710-e22a714e9558 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-677001609", "imageRef": "b585ffbc-6a36-48c9-81b3-e26f9bd0fcba", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "0b177597-79d5-4c2d-b37e-cfbfcdd1361f"}]}} {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 15:42:45.076794 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-37f7f6f1-8a4d-43ce-9c45-e88ae2898d62 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Action: 'create', calling method: .version_select at 0x7fbc08518550>, body: {"keypair": {"name": "tempest-keypair-1925595656"}} {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 15:42:45.139335 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.network.neutron [None req-c9659886-2891-42d5-9710-e22a714e9558 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] validate_networks() for [('0b177597-79d5-4c2d-b37e-cfbfcdd1361f', None, None, None, None, None)] {{(pid=122225) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Oct 27 15:42:45.226318 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.quota [None req-37f7f6f1-8a4d-43ce-9c45-e88ae2898d62 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Getting quotas for project 230ec93c7707410da240669b0a3e26a0. Resources: {'key_pairs'} {{(pid=122224) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 27 15:42:45.262827 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.quota [None req-37f7f6f1-8a4d-43ce-9c45-e88ae2898d62 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Getting quotas for user ad48647323604612934a420a1accc6e8 and project 230ec93c7707410da240669b0a3e26a0. Resources: {'key_pairs'} {{(pid=122224) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 27 15:42:46.189824 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.quota [None req-37f7f6f1-8a4d-43ce-9c45-e88ae2898d62 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Getting quotas for project 230ec93c7707410da240669b0a3e26a0. Resources: {'key_pairs'} {{(pid=122224) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 27 15:42:46.199783 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.quota [None req-37f7f6f1-8a4d-43ce-9c45-e88ae2898d62 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Getting quotas for user ad48647323604612934a420a1accc6e8 and project 230ec93c7707410da240669b0a3e26a0. Resources: {'key_pairs'} {{(pid=122224) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 27 15:42:46.279992 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-37f7f6f1-8a4d-43ce-9c45-e88ae2898d62 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "POST /compute/v2.1/os-keypairs" status: 201 len: 2316 microversion: 2.20 time: 1.396981 Oct 27 15:42:46.301244 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 17/25] 10.222.0.64 () {62 vars in 1198 bytes} [Wed Oct 27 15:42:44 2021] POST /compute/v2.1/os-keypairs => generated 2316 bytes in 1419 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Oct 27 15:42:46.306107 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-96a44f27-efe8-46df-92ce-c2fcfca60182 tempest-VolumesTestJSON-1049566844 tempest-VolumesTestJSON-1049566844-project] Calling method '.version_select at 0x7fbc06aa08b0>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:42:46.804602 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-96a44f27-efe8-46df-92ce-c2fcfca60182 tempest-VolumesTestJSON-1049566844 tempest-VolumesTestJSON-1049566844-project] 10.222.0.64 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.502020 Oct 27 15:42:46.805183 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 18/26] 10.222.0.64 () {58 vars in 1154 bytes} [Wed Oct 27 15:42:46 2021] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 15:42:46.815086 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-c1b89693-2d1d-4e39-a2cc-f2714368d97c tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:42:46.815897 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-c1b89693-2d1d-4e39-a2cc-f2714368d97c tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] [instance: a4e225e4-7815-4f6a-b1e6-53edab3c1abd] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:42:46.837531 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-c1b89693-2d1d-4e39-a2cc-f2714368d97c tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:42:46.838000 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-c1b89693-2d1d-4e39-a2cc-f2714368d97c tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:42:46.838798 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-c1b89693-2d1d-4e39-a2cc-f2714368d97c tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:42:46.839232 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-c1b89693-2d1d-4e39-a2cc-f2714368d97c tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:42:47.106759 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-c1b89693-2d1d-4e39-a2cc-f2714368d97c tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0abe23cb5f314bc883ef7958b0ed9b5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fc48df471f247809d82ddf926bfdc6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:42:47.142204 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-c1b89693-2d1d-4e39-a2cc-f2714368d97c tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] 10.222.0.64 "GET /compute/v2.1/servers/a4e225e4-7815-4f6a-b1e6-53edab3c1abd" status: 200 len: 1275 microversion: 2.1 time: 0.335843 Oct 27 15:42:47.142888 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 19/27] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:42:46 2021] GET /compute/v2.1/servers/a4e225e4-7815-4f6a-b1e6-53edab3c1abd => generated 1275 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 15:42:47.160229 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-fa5d9603-5efd-48a3-8ea3-9385d290d242 tempest-DeleteServersTestJSON-752571955 tempest-DeleteServersTestJSON-752571955-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:42:47.161235 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-fa5d9603-5efd-48a3-8ea3-9385d290d242 tempest-DeleteServersTestJSON-752571955 tempest-DeleteServersTestJSON-752571955-project] [instance: 6cc17348-b41d-46ba-a1d6-9f80614b7596] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:42:47.175617 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-fa5d9603-5efd-48a3-8ea3-9385d290d242 tempest-DeleteServersTestJSON-752571955 tempest-DeleteServersTestJSON-752571955-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:42:47.176245 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-fa5d9603-5efd-48a3-8ea3-9385d290d242 tempest-DeleteServersTestJSON-752571955 tempest-DeleteServersTestJSON-752571955-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:42:47.177225 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-fa5d9603-5efd-48a3-8ea3-9385d290d242 tempest-DeleteServersTestJSON-752571955 tempest-DeleteServersTestJSON-752571955-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:42:47.177665 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-fa5d9603-5efd-48a3-8ea3-9385d290d242 tempest-DeleteServersTestJSON-752571955 tempest-DeleteServersTestJSON-752571955-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:42:47.307912 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-fa5d9603-5efd-48a3-8ea3-9385d290d242 tempest-DeleteServersTestJSON-752571955 tempest-DeleteServersTestJSON-752571955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf1a0e4ab3ab4008a25339e4eda7a48d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be9d7084d7ab4e408be53dd27f8748a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:42:47.317137 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-fa5d9603-5efd-48a3-8ea3-9385d290d242 tempest-DeleteServersTestJSON-752571955 tempest-DeleteServersTestJSON-752571955-project] 10.222.0.64 "GET /compute/v2.1/servers/6cc17348-b41d-46ba-a1d6-9f80614b7596" status: 200 len: 1273 microversion: 2.1 time: 0.171490 Oct 27 15:42:47.317731 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 20/28] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:42:47 2021] GET /compute/v2.1/servers/6cc17348-b41d-46ba-a1d6-9f80614b7596 => generated 1273 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 15:42:47.344920 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-d49fe118-6c61-48e6-9759-2386a7e48585 tempest-VolumesTestJSON-1049566844 tempest-VolumesTestJSON-1049566844-project] Calling method '.version_select at 0x7fbc060f8a60>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:42:47.646428 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-d49fe118-6c61-48e6-9759-2386a7e48585 tempest-VolumesTestJSON-1049566844 tempest-VolumesTestJSON-1049566844-project] 10.222.0.64 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.322266 Oct 27 15:42:47.647002 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 21/29] 10.222.0.64 () {58 vars in 1187 bytes} [Wed Oct 27 15:42:47 2021] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 15:42:47.662054 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-98476b5a-bc1d-41ce-9f0d-b8b8ae0e233d tempest-VolumesTestJSON-1049566844 tempest-VolumesTestJSON-1049566844-project] Calling method '.version_select at 0x7fbc0693d040>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:42:47.754859 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-98476b5a-bc1d-41ce-9f0d-b8b8ae0e233d tempest-VolumesTestJSON-1049566844 tempest-VolumesTestJSON-1049566844-project] 10.222.0.64 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.099761 Oct 27 15:42:47.755707 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 22/30] 10.222.0.64 () {58 vars in 1154 bytes} [Wed Oct 27 15:42:47 2021] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 15:42:47.758820 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.virt.hardware [None req-c9659886-2891-42d5-9710-e22a714e9558 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Flavor limits 0:0:0 {{(pid=122225) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 15:42:47.759291 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.virt.hardware [None req-c9659886-2891-42d5-9710-e22a714e9558 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Image limits 0:0:0 {{(pid=122225) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 15:42:47.759687 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.virt.hardware [None req-c9659886-2891-42d5-9710-e22a714e9558 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Flavor pref 0:0:0 {{(pid=122225) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 15:42:47.760121 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.virt.hardware [None req-c9659886-2891-42d5-9710-e22a714e9558 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Image pref 0:0:0 {{(pid=122225) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 15:42:47.760524 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.virt.hardware [None req-c9659886-2891-42d5-9710-e22a714e9558 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122225) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 15:42:47.774453 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-c9659886-2891-42d5-9710-e22a714e9558 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:42:47.774910 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-c9659886-2891-42d5-9710-e22a714e9558 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:42:47.775817 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-c9659886-2891-42d5-9710-e22a714e9558 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:42:47.776185 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-c9659886-2891-42d5-9710-e22a714e9558 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:42:47.811298 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.quota [None req-c9659886-2891-42d5-9710-e22a714e9558 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Getting quotas for project 00d7fcab5d3f465793d650f16c6ea8de. Resources: {'ram', 'instances', 'cores'} {{(pid=122225) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 27 15:42:47.832420 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.quota [None req-c9659886-2891-42d5-9710-e22a714e9558 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Getting quotas for user 96b599f8890b4281a7e311cf37a039e1 and project 00d7fcab5d3f465793d650f16c6ea8de. Resources: {'ram', 'instances', 'cores'} {{(pid=122225) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 27 15:42:47.846805 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-c9659886-2891-42d5-9710-e22a714e9558 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Going to run 1 instances... {{(pid=122225) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Oct 27 15:42:47.849415 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-c9659886-2891-42d5-9710-e22a714e9558 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: bced4f24-572a-4316-97e8-3ceedc61a621] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b585ffbc-6a36-48c9-81b3-e26f9bd0fcba',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122225) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Oct 27 15:42:47.911630 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-c9659886-2891-42d5-9710-e22a714e9558 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.957340 Oct 27 15:42:47.918415 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 9/31] 10.222.0.64 () {60 vars in 1146 bytes} [Wed Oct 27 15:42:44 2021] POST /compute/v2.1/servers => generated 383 bytes in 2965 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 15:42:47.923022 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-eeece49c-d839-4072-94b5-191628b434d2 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:42:47.923877 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-eeece49c-d839-4072-94b5-191628b434d2 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: bced4f24-572a-4316-97e8-3ceedc61a621] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:42:48.021388 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-eeece49c-d839-4072-94b5-191628b434d2 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96b599f8890b4281a7e311cf37a039e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d7fcab5d3f465793d650f16c6ea8de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:42:48.036365 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-eeece49c-d839-4072-94b5-191628b434d2 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/bced4f24-572a-4316-97e8-3ceedc61a621" status: 200 len: 1221 microversion: 2.1 time: 0.117122 Oct 27 15:42:48.039767 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 23/32] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:42:47 2021] GET /compute/v2.1/servers/bced4f24-572a-4316-97e8-3ceedc61a621 => generated 1221 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 15:42:48.161537 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-d4473c3f-39df-47e6-b520-ea5643acfcb2 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:42:48.162164 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-d4473c3f-39df-47e6-b520-ea5643acfcb2 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] [instance: a4e225e4-7815-4f6a-b1e6-53edab3c1abd] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:42:48.174138 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-d4473c3f-39df-47e6-b520-ea5643acfcb2 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:42:48.175513 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-d4473c3f-39df-47e6-b520-ea5643acfcb2 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:42:48.176651 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-d4473c3f-39df-47e6-b520-ea5643acfcb2 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:42:48.177273 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-d4473c3f-39df-47e6-b520-ea5643acfcb2 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:42:48.336929 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-966c3e4c-6319-4d8e-b023-177dbed5231f tempest-DeleteServersTestJSON-752571955 tempest-DeleteServersTestJSON-752571955-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:42:48.339233 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-966c3e4c-6319-4d8e-b023-177dbed5231f tempest-DeleteServersTestJSON-752571955 tempest-DeleteServersTestJSON-752571955-project] [instance: 6cc17348-b41d-46ba-a1d6-9f80614b7596] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:42:48.349095 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-966c3e4c-6319-4d8e-b023-177dbed5231f tempest-DeleteServersTestJSON-752571955 tempest-DeleteServersTestJSON-752571955-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:42:48.351145 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-966c3e4c-6319-4d8e-b023-177dbed5231f tempest-DeleteServersTestJSON-752571955 tempest-DeleteServersTestJSON-752571955-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:42:48.352147 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-966c3e4c-6319-4d8e-b023-177dbed5231f tempest-DeleteServersTestJSON-752571955 tempest-DeleteServersTestJSON-752571955-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:42:48.352729 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-966c3e4c-6319-4d8e-b023-177dbed5231f tempest-DeleteServersTestJSON-752571955 tempest-DeleteServersTestJSON-752571955-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:42:48.552856 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-d4473c3f-39df-47e6-b520-ea5643acfcb2 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0abe23cb5f314bc883ef7958b0ed9b5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fc48df471f247809d82ddf926bfdc6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:42:48.564649 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-d4473c3f-39df-47e6-b520-ea5643acfcb2 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] 10.222.0.64 "GET /compute/v2.1/servers/a4e225e4-7815-4f6a-b1e6-53edab3c1abd" status: 200 len: 1317 microversion: 2.1 time: 0.408454 Oct 27 15:42:48.566155 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 10/33] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:42:48 2021] GET /compute/v2.1/servers/a4e225e4-7815-4f6a-b1e6-53edab3c1abd => generated 1317 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 15:42:48.651209 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-966c3e4c-6319-4d8e-b023-177dbed5231f tempest-DeleteServersTestJSON-752571955 tempest-DeleteServersTestJSON-752571955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf1a0e4ab3ab4008a25339e4eda7a48d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be9d7084d7ab4e408be53dd27f8748a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:42:48.678686 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-966c3e4c-6319-4d8e-b023-177dbed5231f tempest-DeleteServersTestJSON-752571955 tempest-DeleteServersTestJSON-752571955-project] 10.222.0.64 "GET /compute/v2.1/servers/6cc17348-b41d-46ba-a1d6-9f80614b7596" status: 200 len: 1315 microversion: 2.1 time: 0.343901 Oct 27 15:42:48.679660 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 24/34] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:42:48 2021] GET /compute/v2.1/servers/6cc17348-b41d-46ba-a1d6-9f80614b7596 => generated 1315 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 15:42:49.054404 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-ab12f795-29a4-43a7-8def-6b018e605974 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:42:49.055061 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-ab12f795-29a4-43a7-8def-6b018e605974 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: bced4f24-572a-4316-97e8-3ceedc61a621] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:42:49.066015 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-ab12f795-29a4-43a7-8def-6b018e605974 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:42:49.067637 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-ab12f795-29a4-43a7-8def-6b018e605974 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:42:49.068768 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-ab12f795-29a4-43a7-8def-6b018e605974 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:42:49.069235 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-ab12f795-29a4-43a7-8def-6b018e605974 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:42:49.196524 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-ab12f795-29a4-43a7-8def-6b018e605974 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96b599f8890b4281a7e311cf37a039e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d7fcab5d3f465793d650f16c6ea8de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:42:49.203662 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-ab12f795-29a4-43a7-8def-6b018e605974 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/bced4f24-572a-4316-97e8-3ceedc61a621" status: 200 len: 1225 microversion: 2.1 time: 0.153183 Oct 27 15:42:49.204250 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 11/35] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:42:49 2021] GET /compute/v2.1/servers/bced4f24-572a-4316-97e8-3ceedc61a621 => generated 1225 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 15:42:49.581732 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-4facc542-1305-4dda-8047-77476eae748b tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:42:49.583044 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-4facc542-1305-4dda-8047-77476eae748b tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] [instance: a4e225e4-7815-4f6a-b1e6-53edab3c1abd] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:42:49.589195 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-4facc542-1305-4dda-8047-77476eae748b tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:42:49.589634 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-4facc542-1305-4dda-8047-77476eae748b tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:42:49.590394 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-4facc542-1305-4dda-8047-77476eae748b tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:42:49.590819 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-4facc542-1305-4dda-8047-77476eae748b tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:42:49.695899 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-5e4db7d8-3c77-41f9-8f59-14207e9b8fa4 tempest-DeleteServersTestJSON-752571955 tempest-DeleteServersTestJSON-752571955-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:42:49.696512 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-5e4db7d8-3c77-41f9-8f59-14207e9b8fa4 tempest-DeleteServersTestJSON-752571955 tempest-DeleteServersTestJSON-752571955-project] [instance: 6cc17348-b41d-46ba-a1d6-9f80614b7596] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:42:49.704482 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-5e4db7d8-3c77-41f9-8f59-14207e9b8fa4 tempest-DeleteServersTestJSON-752571955 tempest-DeleteServersTestJSON-752571955-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:42:49.704933 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-5e4db7d8-3c77-41f9-8f59-14207e9b8fa4 tempest-DeleteServersTestJSON-752571955 tempest-DeleteServersTestJSON-752571955-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:42:49.705878 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-5e4db7d8-3c77-41f9-8f59-14207e9b8fa4 tempest-DeleteServersTestJSON-752571955 tempest-DeleteServersTestJSON-752571955-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:42:49.706377 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-5e4db7d8-3c77-41f9-8f59-14207e9b8fa4 tempest-DeleteServersTestJSON-752571955 tempest-DeleteServersTestJSON-752571955-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:42:49.786030 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-4facc542-1305-4dda-8047-77476eae748b tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0abe23cb5f314bc883ef7958b0ed9b5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fc48df471f247809d82ddf926bfdc6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:42:49.794723 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-4facc542-1305-4dda-8047-77476eae748b tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] 10.222.0.64 "GET /compute/v2.1/servers/a4e225e4-7815-4f6a-b1e6-53edab3c1abd" status: 200 len: 1317 microversion: 2.1 time: 0.216870 Oct 27 15:42:49.795933 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 25/36] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:42:49 2021] GET /compute/v2.1/servers/a4e225e4-7815-4f6a-b1e6-53edab3c1abd => generated 1317 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 15:42:50.231953 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-f17118b7-d9c2-45e5-b019-2d27b849beff tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:42:50.234616 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-f17118b7-d9c2-45e5-b019-2d27b849beff tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: bced4f24-572a-4316-97e8-3ceedc61a621] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:42:50.241031 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-f17118b7-d9c2-45e5-b019-2d27b849beff tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:42:50.241467 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-f17118b7-d9c2-45e5-b019-2d27b849beff tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:42:50.242251 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-f17118b7-d9c2-45e5-b019-2d27b849beff tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:42:50.242683 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-f17118b7-d9c2-45e5-b019-2d27b849beff tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:42:50.329651 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-5e4db7d8-3c77-41f9-8f59-14207e9b8fa4 tempest-DeleteServersTestJSON-752571955 tempest-DeleteServersTestJSON-752571955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf1a0e4ab3ab4008a25339e4eda7a48d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be9d7084d7ab4e408be53dd27f8748a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:42:50.340330 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-5e4db7d8-3c77-41f9-8f59-14207e9b8fa4 tempest-DeleteServersTestJSON-752571955 tempest-DeleteServersTestJSON-752571955-project] 10.222.0.64 "GET /compute/v2.1/servers/6cc17348-b41d-46ba-a1d6-9f80614b7596" status: 200 len: 1315 microversion: 2.1 time: 0.647969 Oct 27 15:42:50.341578 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 12/37] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:42:49 2021] GET /compute/v2.1/servers/6cc17348-b41d-46ba-a1d6-9f80614b7596 => generated 1315 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 15:42:50.486729 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-f17118b7-d9c2-45e5-b019-2d27b849beff tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96b599f8890b4281a7e311cf37a039e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d7fcab5d3f465793d650f16c6ea8de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:42:50.502949 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-f17118b7-d9c2-45e5-b019-2d27b849beff tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/bced4f24-572a-4316-97e8-3ceedc61a621" status: 200 len: 1225 microversion: 2.1 time: 0.278779 Oct 27 15:42:50.516032 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 26/38] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:42:50 2021] GET /compute/v2.1/servers/bced4f24-572a-4316-97e8-3ceedc61a621 => generated 1225 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 15:42:50.700537 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-3f74e9b0-ffcc-4666-ac0a-de0571b97158 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1215724564", "imageRef": "b585ffbc-6a36-48c9-81b3-e26f9bd0fcba", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "8d1899d8-4d9e-4203-b7a3-8e2aac0591d6"}], "security_groups": [{"name": "tempest-securitygroup--1564271014"}], "key_name": "tempest-keypair-1925595656", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 15:42:50.812841 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-82efd7e7-eaa4-4e4d-99e5-ee7db7211080 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:42:50.813599 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-82efd7e7-eaa4-4e4d-99e5-ee7db7211080 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] [instance: a4e225e4-7815-4f6a-b1e6-53edab3c1abd] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:42:50.824640 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-82efd7e7-eaa4-4e4d-99e5-ee7db7211080 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:42:50.833254 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-82efd7e7-eaa4-4e4d-99e5-ee7db7211080 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:42:50.838895 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-82efd7e7-eaa4-4e4d-99e5-ee7db7211080 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:42:50.840100 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-82efd7e7-eaa4-4e4d-99e5-ee7db7211080 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:42:51.073016 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.network.neutron [None req-3f74e9b0-ffcc-4666-ac0a-de0571b97158 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] validate_networks() for [('8d1899d8-4d9e-4203-b7a3-8e2aac0591d6', None, None, None, None, None)] {{(pid=122225) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Oct 27 15:42:51.123546 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-82efd7e7-eaa4-4e4d-99e5-ee7db7211080 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0abe23cb5f314bc883ef7958b0ed9b5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fc48df471f247809d82ddf926bfdc6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:42:51.135771 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-82efd7e7-eaa4-4e4d-99e5-ee7db7211080 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] 10.222.0.64 "GET /compute/v2.1/servers/a4e225e4-7815-4f6a-b1e6-53edab3c1abd" status: 200 len: 1317 microversion: 2.1 time: 0.325269 Oct 27 15:42:51.136027 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 27/39] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:42:50 2021] GET /compute/v2.1/servers/a4e225e4-7815-4f6a-b1e6-53edab3c1abd => generated 1317 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 15:42:51.358188 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-b94c439f-3bbc-4733-bb35-0adc17551805 tempest-DeleteServersTestJSON-752571955 tempest-DeleteServersTestJSON-752571955-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:42:51.359065 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-b94c439f-3bbc-4733-bb35-0adc17551805 tempest-DeleteServersTestJSON-752571955 tempest-DeleteServersTestJSON-752571955-project] [instance: 6cc17348-b41d-46ba-a1d6-9f80614b7596] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:42:51.372871 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-b94c439f-3bbc-4733-bb35-0adc17551805 tempest-DeleteServersTestJSON-752571955 tempest-DeleteServersTestJSON-752571955-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:42:51.374759 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-b94c439f-3bbc-4733-bb35-0adc17551805 tempest-DeleteServersTestJSON-752571955 tempest-DeleteServersTestJSON-752571955-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:42:51.377183 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-b94c439f-3bbc-4733-bb35-0adc17551805 tempest-DeleteServersTestJSON-752571955 tempest-DeleteServersTestJSON-752571955-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:42:51.378392 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-b94c439f-3bbc-4733-bb35-0adc17551805 tempest-DeleteServersTestJSON-752571955 tempest-DeleteServersTestJSON-752571955-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:42:51.762600 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-b94c439f-3bbc-4733-bb35-0adc17551805 tempest-DeleteServersTestJSON-752571955 tempest-DeleteServersTestJSON-752571955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf1a0e4ab3ab4008a25339e4eda7a48d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be9d7084d7ab4e408be53dd27f8748a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:42:51.785311 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-b94c439f-3bbc-4733-bb35-0adc17551805 tempest-DeleteServersTestJSON-752571955 tempest-DeleteServersTestJSON-752571955-project] 10.222.0.64 "GET /compute/v2.1/servers/6cc17348-b41d-46ba-a1d6-9f80614b7596" status: 200 len: 1315 microversion: 2.1 time: 0.426161 Oct 27 15:42:51.785311 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 28/40] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:42:51 2021] GET /compute/v2.1/servers/6cc17348-b41d-46ba-a1d6-9f80614b7596 => generated 1315 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 15:42:51.797314 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-92e6a1ce-6c7c-45bc-9ac0-ccd6ef7fef1d tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:42:51.797938 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-92e6a1ce-6c7c-45bc-9ac0-ccd6ef7fef1d tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: bced4f24-572a-4316-97e8-3ceedc61a621] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:42:51.826743 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-92e6a1ce-6c7c-45bc-9ac0-ccd6ef7fef1d tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:42:51.827427 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-92e6a1ce-6c7c-45bc-9ac0-ccd6ef7fef1d tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:42:51.828013 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-92e6a1ce-6c7c-45bc-9ac0-ccd6ef7fef1d tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:42:51.828458 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-92e6a1ce-6c7c-45bc-9ac0-ccd6ef7fef1d tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:42:52.047626 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-92e6a1ce-6c7c-45bc-9ac0-ccd6ef7fef1d tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96b599f8890b4281a7e311cf37a039e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d7fcab5d3f465793d650f16c6ea8de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:42:52.089507 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-92e6a1ce-6c7c-45bc-9ac0-ccd6ef7fef1d tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/bced4f24-572a-4316-97e8-3ceedc61a621" status: 200 len: 1225 microversion: 2.1 time: 0.296689 Oct 27 15:42:52.109869 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 29/41] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:42:51 2021] GET /compute/v2.1/servers/bced4f24-572a-4316-97e8-3ceedc61a621 => generated 1225 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 15:42:52.152529 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-65015bb2-8977-4ee3-84c3-12238c118a67 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:42:52.153228 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-65015bb2-8977-4ee3-84c3-12238c118a67 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] [instance: a4e225e4-7815-4f6a-b1e6-53edab3c1abd] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:42:52.179928 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-65015bb2-8977-4ee3-84c3-12238c118a67 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:42:52.181854 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-65015bb2-8977-4ee3-84c3-12238c118a67 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:42:52.182700 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-65015bb2-8977-4ee3-84c3-12238c118a67 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:42:52.183141 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-65015bb2-8977-4ee3-84c3-12238c118a67 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:42:52.539612 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-65015bb2-8977-4ee3-84c3-12238c118a67 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0abe23cb5f314bc883ef7958b0ed9b5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fc48df471f247809d82ddf926bfdc6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:42:52.551569 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-65015bb2-8977-4ee3-84c3-12238c118a67 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] 10.222.0.64 "GET /compute/v2.1/servers/a4e225e4-7815-4f6a-b1e6-53edab3c1abd" status: 200 len: 1317 microversion: 2.1 time: 0.404502 Oct 27 15:42:52.569061 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 30/42] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:42:52 2021] GET /compute/v2.1/servers/a4e225e4-7815-4f6a-b1e6-53edab3c1abd => generated 1317 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 15:42:52.802947 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-d653a281-13c5-438b-9935-9df6cd2adf38 tempest-DeleteServersTestJSON-752571955 tempest-DeleteServersTestJSON-752571955-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:42:52.804425 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-d653a281-13c5-438b-9935-9df6cd2adf38 tempest-DeleteServersTestJSON-752571955 tempest-DeleteServersTestJSON-752571955-project] [instance: 6cc17348-b41d-46ba-a1d6-9f80614b7596] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:42:52.843477 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-d653a281-13c5-438b-9935-9df6cd2adf38 tempest-DeleteServersTestJSON-752571955 tempest-DeleteServersTestJSON-752571955-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:42:52.851884 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-d653a281-13c5-438b-9935-9df6cd2adf38 tempest-DeleteServersTestJSON-752571955 tempest-DeleteServersTestJSON-752571955-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:42:52.853234 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-d653a281-13c5-438b-9935-9df6cd2adf38 tempest-DeleteServersTestJSON-752571955 tempest-DeleteServersTestJSON-752571955-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:42:52.856440 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-d653a281-13c5-438b-9935-9df6cd2adf38 tempest-DeleteServersTestJSON-752571955 tempest-DeleteServersTestJSON-752571955-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:42:52.927838 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.virt.hardware [None req-3f74e9b0-ffcc-4666-ac0a-de0571b97158 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Flavor limits 0:0:0 {{(pid=122225) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 15:42:52.927838 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.virt.hardware [None req-3f74e9b0-ffcc-4666-ac0a-de0571b97158 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Image limits 0:0:0 {{(pid=122225) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 15:42:52.927838 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.virt.hardware [None req-3f74e9b0-ffcc-4666-ac0a-de0571b97158 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Flavor pref 0:0:0 {{(pid=122225) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 15:42:52.927838 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.virt.hardware [None req-3f74e9b0-ffcc-4666-ac0a-de0571b97158 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Image pref 0:0:0 {{(pid=122225) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 15:42:52.927838 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.virt.hardware [None req-3f74e9b0-ffcc-4666-ac0a-de0571b97158 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122225) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 15:42:52.949718 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-3f74e9b0-ffcc-4666-ac0a-de0571b97158 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:42:52.950166 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-3f74e9b0-ffcc-4666-ac0a-de0571b97158 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:42:52.950960 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-3f74e9b0-ffcc-4666-ac0a-de0571b97158 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:42:52.951392 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-3f74e9b0-ffcc-4666-ac0a-de0571b97158 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:42:53.013015 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.quota [None req-3f74e9b0-ffcc-4666-ac0a-de0571b97158 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Getting quotas for project 230ec93c7707410da240669b0a3e26a0. Resources: {'ram', 'instances', 'cores'} {{(pid=122225) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 27 15:42:53.022469 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.quota [None req-3f74e9b0-ffcc-4666-ac0a-de0571b97158 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Getting quotas for user ad48647323604612934a420a1accc6e8 and project 230ec93c7707410da240669b0a3e26a0. Resources: {'ram', 'instances', 'cores'} {{(pid=122225) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 27 15:42:53.052431 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-3f74e9b0-ffcc-4666-ac0a-de0571b97158 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Going to run 1 instances... {{(pid=122225) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Oct 27 15:42:53.054684 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-3f74e9b0-ffcc-4666-ac0a-de0571b97158 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b585ffbc-6a36-48c9-81b3-e26f9bd0fcba',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122225) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Oct 27 15:42:53.126810 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-d653a281-13c5-438b-9935-9df6cd2adf38 tempest-DeleteServersTestJSON-752571955 tempest-DeleteServersTestJSON-752571955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf1a0e4ab3ab4008a25339e4eda7a48d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be9d7084d7ab4e408be53dd27f8748a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:42:53.135396 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-d653a281-13c5-438b-9935-9df6cd2adf38 tempest-DeleteServersTestJSON-752571955 tempest-DeleteServersTestJSON-752571955-project] 10.222.0.64 "GET /compute/v2.1/servers/6cc17348-b41d-46ba-a1d6-9f80614b7596" status: 200 len: 1315 microversion: 2.1 time: 0.340659 Oct 27 15:42:53.143937 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 31/43] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:42:52 2021] GET /compute/v2.1/servers/6cc17348-b41d-46ba-a1d6-9f80614b7596 => generated 1315 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 15:42:53.151279 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-bbf968bd-03d2-4a27-84f9-1f686cf6d4ae tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:42:53.154863 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-bbf968bd-03d2-4a27-84f9-1f686cf6d4ae tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: bced4f24-572a-4316-97e8-3ceedc61a621] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:42:53.164880 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-bbf968bd-03d2-4a27-84f9-1f686cf6d4ae tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:42:53.169427 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-bbf968bd-03d2-4a27-84f9-1f686cf6d4ae tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:42:53.176657 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-bbf968bd-03d2-4a27-84f9-1f686cf6d4ae tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:42:53.190649 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-3f74e9b0-ffcc-4666-ac0a-de0571b97158 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 2.494351 Oct 27 15:42:53.197750 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-bbf968bd-03d2-4a27-84f9-1f686cf6d4ae tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:42:53.221818 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 13/44] 10.222.0.64 () {62 vars in 1187 bytes} [Wed Oct 27 15:42:50 2021] POST /compute/v2.1/servers => generated 402 bytes in 2525 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 27 15:42:53.227443 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-03dccd56-e686-4c7e-abb2-977fb430fb0b tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:42:53.250297 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-03dccd56-e686-4c7e-abb2-977fb430fb0b tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:42:53.403318 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-bbf968bd-03d2-4a27-84f9-1f686cf6d4ae tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96b599f8890b4281a7e311cf37a039e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d7fcab5d3f465793d650f16c6ea8de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:42:53.414505 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-bbf968bd-03d2-4a27-84f9-1f686cf6d4ae tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/bced4f24-572a-4316-97e8-3ceedc61a621" status: 200 len: 1273 microversion: 2.1 time: 0.269053 Oct 27 15:42:53.426971 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 32/45] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:42:53 2021] GET /compute/v2.1/servers/bced4f24-572a-4316-97e8-3ceedc61a621 => generated 1273 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 15:42:53.585622 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-9c3e1ec2-ab6c-43c0-86ca-08230d72093d tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:42:53.586543 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-9c3e1ec2-ab6c-43c0-86ca-08230d72093d tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] [instance: a4e225e4-7815-4f6a-b1e6-53edab3c1abd] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:42:53.597670 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-9c3e1ec2-ab6c-43c0-86ca-08230d72093d tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:42:53.606569 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-9c3e1ec2-ab6c-43c0-86ca-08230d72093d tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:42:53.607639 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-9c3e1ec2-ab6c-43c0-86ca-08230d72093d tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:42:53.608497 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-9c3e1ec2-ab6c-43c0-86ca-08230d72093d tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:42:53.927971 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-03dccd56-e686-4c7e-abb2-977fb430fb0b tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:42:53.953780 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-03dccd56-e686-4c7e-abb2-977fb430fb0b tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:42:53.962020 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-03dccd56-e686-4c7e-abb2-977fb430fb0b tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:42:53.967996 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-03dccd56-e686-4c7e-abb2-977fb430fb0b tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672" status: 200 len: 1282 microversion: 2.20 time: 0.740391 Oct 27 15:42:53.968842 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 14/46] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Oct 27 15:42:53 2021] GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672 => generated 1282 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 15:42:54.072690 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-9c3e1ec2-ab6c-43c0-86ca-08230d72093d tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0abe23cb5f314bc883ef7958b0ed9b5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fc48df471f247809d82ddf926bfdc6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:42:54.098012 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-9c3e1ec2-ab6c-43c0-86ca-08230d72093d tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] 10.222.0.64 "GET /compute/v2.1/servers/a4e225e4-7815-4f6a-b1e6-53edab3c1abd" status: 200 len: 1317 microversion: 2.1 time: 0.521179 Oct 27 15:42:54.122055 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 33/47] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:42:53 2021] GET /compute/v2.1/servers/a4e225e4-7815-4f6a-b1e6-53edab3c1abd => generated 1317 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 15:42:54.160603 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-923c9c83-1b20-48d0-9628-c07e881c3db5 tempest-DeleteServersTestJSON-752571955 tempest-DeleteServersTestJSON-752571955-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:42:54.161222 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-923c9c83-1b20-48d0-9628-c07e881c3db5 tempest-DeleteServersTestJSON-752571955 tempest-DeleteServersTestJSON-752571955-project] [instance: 6cc17348-b41d-46ba-a1d6-9f80614b7596] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:42:54.175817 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-923c9c83-1b20-48d0-9628-c07e881c3db5 tempest-DeleteServersTestJSON-752571955 tempest-DeleteServersTestJSON-752571955-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:42:54.176288 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-923c9c83-1b20-48d0-9628-c07e881c3db5 tempest-DeleteServersTestJSON-752571955 tempest-DeleteServersTestJSON-752571955-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:42:54.177084 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-923c9c83-1b20-48d0-9628-c07e881c3db5 tempest-DeleteServersTestJSON-752571955 tempest-DeleteServersTestJSON-752571955-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:42:54.177523 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-923c9c83-1b20-48d0-9628-c07e881c3db5 tempest-DeleteServersTestJSON-752571955 tempest-DeleteServersTestJSON-752571955-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:42:54.435005 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-c87683ab-3186-405a-b0a7-3338543ba3a0 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:42:54.435625 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-c87683ab-3186-405a-b0a7-3338543ba3a0 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: bced4f24-572a-4316-97e8-3ceedc61a621] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:42:54.455921 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-c87683ab-3186-405a-b0a7-3338543ba3a0 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:42:54.458723 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-c87683ab-3186-405a-b0a7-3338543ba3a0 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:42:54.461051 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-c87683ab-3186-405a-b0a7-3338543ba3a0 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:42:54.463966 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-c87683ab-3186-405a-b0a7-3338543ba3a0 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:42:54.693244 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-c87683ab-3186-405a-b0a7-3338543ba3a0 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96b599f8890b4281a7e311cf37a039e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d7fcab5d3f465793d650f16c6ea8de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:42:54.706662 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-c87683ab-3186-405a-b0a7-3338543ba3a0 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/bced4f24-572a-4316-97e8-3ceedc61a621" status: 200 len: 1279 microversion: 2.1 time: 0.275705 Oct 27 15:42:54.716765 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 34/48] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:42:54 2021] GET /compute/v2.1/servers/bced4f24-572a-4316-97e8-3ceedc61a621 => generated 1279 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 15:42:54.988143 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-f60caa1b-6531-4e53-92cb-2e69c327d2a6 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:42:54.989247 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-f60caa1b-6531-4e53-92cb-2e69c327d2a6 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:42:55.011649 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-f60caa1b-6531-4e53-92cb-2e69c327d2a6 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:42:55.012784 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-f60caa1b-6531-4e53-92cb-2e69c327d2a6 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:42:55.021529 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-f60caa1b-6531-4e53-92cb-2e69c327d2a6 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:42:55.023094 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-f60caa1b-6531-4e53-92cb-2e69c327d2a6 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:42:55.145002 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-f60caa1b-6531-4e53-92cb-2e69c327d2a6 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:42:55.177547 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-f60caa1b-6531-4e53-92cb-2e69c327d2a6 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:42:55.181572 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-f60caa1b-6531-4e53-92cb-2e69c327d2a6 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:42:55.185519 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-f60caa1b-6531-4e53-92cb-2e69c327d2a6 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672" status: 200 len: 1278 microversion: 2.20 time: 0.202402 Oct 27 15:42:55.186485 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 35/49] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Oct 27 15:42:54 2021] GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672 => generated 1278 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 15:42:55.199665 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-69a6b63b-a052-4191-a85a-966d18880dfd tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:42:55.200332 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-69a6b63b-a052-4191-a85a-966d18880dfd tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] [instance: a4e225e4-7815-4f6a-b1e6-53edab3c1abd] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:42:55.211831 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-69a6b63b-a052-4191-a85a-966d18880dfd tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:42:55.212616 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-69a6b63b-a052-4191-a85a-966d18880dfd tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:42:55.213572 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-69a6b63b-a052-4191-a85a-966d18880dfd tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:42:55.214185 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-69a6b63b-a052-4191-a85a-966d18880dfd tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:42:55.333324 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-923c9c83-1b20-48d0-9628-c07e881c3db5 tempest-DeleteServersTestJSON-752571955 tempest-DeleteServersTestJSON-752571955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf1a0e4ab3ab4008a25339e4eda7a48d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be9d7084d7ab4e408be53dd27f8748a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:42:55.348852 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-923c9c83-1b20-48d0-9628-c07e881c3db5 tempest-DeleteServersTestJSON-752571955 tempest-DeleteServersTestJSON-752571955-project] 10.222.0.64 "GET /compute/v2.1/servers/6cc17348-b41d-46ba-a1d6-9f80614b7596" status: 200 len: 1315 microversion: 2.1 time: 1.186078 Oct 27 15:42:55.355145 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 15/50] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:42:54 2021] GET /compute/v2.1/servers/6cc17348-b41d-46ba-a1d6-9f80614b7596 => generated 1315 bytes in 1199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 15:42:55.512394 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-69a6b63b-a052-4191-a85a-966d18880dfd tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0abe23cb5f314bc883ef7958b0ed9b5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fc48df471f247809d82ddf926bfdc6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:42:55.523077 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-69a6b63b-a052-4191-a85a-966d18880dfd tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] 10.222.0.64 "GET /compute/v2.1/servers/a4e225e4-7815-4f6a-b1e6-53edab3c1abd" status: 200 len: 1317 microversion: 2.1 time: 0.333011 Oct 27 15:42:55.527134 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 36/51] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:42:55 2021] GET /compute/v2.1/servers/a4e225e4-7815-4f6a-b1e6-53edab3c1abd => generated 1317 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 15:42:55.734284 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-4ee9f80c-a128-4176-a9f2-056087b4c061 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:42:55.735888 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-4ee9f80c-a128-4176-a9f2-056087b4c061 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: bced4f24-572a-4316-97e8-3ceedc61a621] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:42:55.767527 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-4ee9f80c-a128-4176-a9f2-056087b4c061 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:42:55.772783 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-4ee9f80c-a128-4176-a9f2-056087b4c061 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:42:55.774023 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-4ee9f80c-a128-4176-a9f2-056087b4c061 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:42:55.774653 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-4ee9f80c-a128-4176-a9f2-056087b4c061 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:42:56.204073 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-f8f5b82a-a2a7-43ae-8fa6-19aff78ff396 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:42:56.204710 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-f8f5b82a-a2a7-43ae-8fa6-19aff78ff396 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:42:56.212810 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-f8f5b82a-a2a7-43ae-8fa6-19aff78ff396 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:42:56.213300 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-f8f5b82a-a2a7-43ae-8fa6-19aff78ff396 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:42:56.214850 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-f8f5b82a-a2a7-43ae-8fa6-19aff78ff396 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:42:56.220197 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-f8f5b82a-a2a7-43ae-8fa6-19aff78ff396 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:42:56.342095 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-f8f5b82a-a2a7-43ae-8fa6-19aff78ff396 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:42:56.359189 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-f8f5b82a-a2a7-43ae-8fa6-19aff78ff396 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:42:56.387549 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-f8f5b82a-a2a7-43ae-8fa6-19aff78ff396 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:42:56.390161 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-f8f5b82a-a2a7-43ae-8fa6-19aff78ff396 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672" status: 200 len: 1278 microversion: 2.20 time: 0.189717 Oct 27 15:42:56.394205 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 37/52] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Oct 27 15:42:56 2021] GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672 => generated 1278 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 15:42:56.399439 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-aa2537dd-b2b9-4c34-9dcd-dd3f7660dad7 tempest-DeleteServersTestJSON-752571955 tempest-DeleteServersTestJSON-752571955-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:42:56.419993 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-aa2537dd-b2b9-4c34-9dcd-dd3f7660dad7 tempest-DeleteServersTestJSON-752571955 tempest-DeleteServersTestJSON-752571955-project] [instance: 6cc17348-b41d-46ba-a1d6-9f80614b7596] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:42:56.441328 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-aa2537dd-b2b9-4c34-9dcd-dd3f7660dad7 tempest-DeleteServersTestJSON-752571955 tempest-DeleteServersTestJSON-752571955-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:42:56.442063 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-aa2537dd-b2b9-4c34-9dcd-dd3f7660dad7 tempest-DeleteServersTestJSON-752571955 tempest-DeleteServersTestJSON-752571955-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:42:56.443953 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-aa2537dd-b2b9-4c34-9dcd-dd3f7660dad7 tempest-DeleteServersTestJSON-752571955 tempest-DeleteServersTestJSON-752571955-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:42:56.445592 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-aa2537dd-b2b9-4c34-9dcd-dd3f7660dad7 tempest-DeleteServersTestJSON-752571955 tempest-DeleteServersTestJSON-752571955-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:42:56.864559 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-aa2537dd-b2b9-4c34-9dcd-dd3f7660dad7 tempest-DeleteServersTestJSON-752571955 tempest-DeleteServersTestJSON-752571955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf1a0e4ab3ab4008a25339e4eda7a48d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be9d7084d7ab4e408be53dd27f8748a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:42:56.873663 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-aa2537dd-b2b9-4c34-9dcd-dd3f7660dad7 tempest-DeleteServersTestJSON-752571955 tempest-DeleteServersTestJSON-752571955-project] 10.222.0.64 "GET /compute/v2.1/servers/6cc17348-b41d-46ba-a1d6-9f80614b7596" status: 200 len: 1315 microversion: 2.1 time: 0.476766 Oct 27 15:42:56.873663 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 38/53] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:42:56 2021] GET /compute/v2.1/servers/6cc17348-b41d-46ba-a1d6-9f80614b7596 => generated 1315 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 15:42:56.878403 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-495d721b-a903-4226-ada2-bd4b7abbd9e5 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:42:56.890667 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-495d721b-a903-4226-ada2-bd4b7abbd9e5 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] [instance: a4e225e4-7815-4f6a-b1e6-53edab3c1abd] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:42:56.911432 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-495d721b-a903-4226-ada2-bd4b7abbd9e5 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:42:56.920497 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-495d721b-a903-4226-ada2-bd4b7abbd9e5 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:42:56.922713 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-495d721b-a903-4226-ada2-bd4b7abbd9e5 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:42:56.923324 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-495d721b-a903-4226-ada2-bd4b7abbd9e5 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:42:57.207592 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-495d721b-a903-4226-ada2-bd4b7abbd9e5 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0abe23cb5f314bc883ef7958b0ed9b5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fc48df471f247809d82ddf926bfdc6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:42:57.220013 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-495d721b-a903-4226-ada2-bd4b7abbd9e5 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] 10.222.0.64 "GET /compute/v2.1/servers/a4e225e4-7815-4f6a-b1e6-53edab3c1abd" status: 200 len: 1317 microversion: 2.1 time: 0.345280 Oct 27 15:42:57.221065 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 39/54] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:42:56 2021] GET /compute/v2.1/servers/a4e225e4-7815-4f6a-b1e6-53edab3c1abd => generated 1317 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 15:42:57.316030 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-4ee9f80c-a128-4176-a9f2-056087b4c061 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96b599f8890b4281a7e311cf37a039e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d7fcab5d3f465793d650f16c6ea8de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:42:57.326324 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-4ee9f80c-a128-4176-a9f2-056087b4c061 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/bced4f24-572a-4316-97e8-3ceedc61a621" status: 200 len: 1321 microversion: 2.1 time: 1.598239 Oct 27 15:42:57.330241 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 16/55] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:42:55 2021] GET /compute/v2.1/servers/bced4f24-572a-4316-97e8-3ceedc61a621 => generated 1321 bytes in 1603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 15:42:57.412641 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-522fe9d4-b767-4cc8-9ecf-09fc63d43d23 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:42:57.413714 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-522fe9d4-b767-4cc8-9ecf-09fc63d43d23 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:42:57.436527 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-522fe9d4-b767-4cc8-9ecf-09fc63d43d23 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:42:57.437397 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-522fe9d4-b767-4cc8-9ecf-09fc63d43d23 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:42:57.438508 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-522fe9d4-b767-4cc8-9ecf-09fc63d43d23 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:42:57.439092 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-522fe9d4-b767-4cc8-9ecf-09fc63d43d23 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:42:57.619652 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-522fe9d4-b767-4cc8-9ecf-09fc63d43d23 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:42:57.634878 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-522fe9d4-b767-4cc8-9ecf-09fc63d43d23 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:42:57.644969 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-522fe9d4-b767-4cc8-9ecf-09fc63d43d23 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:42:57.649135 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-522fe9d4-b767-4cc8-9ecf-09fc63d43d23 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672" status: 200 len: 1334 microversion: 2.20 time: 0.241437 Oct 27 15:42:57.652284 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 40/56] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Oct 27 15:42:57 2021] GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672 => generated 1334 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 15:42:57.894713 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-0c28a9e8-2ef1-4e1f-8d31-458031e1ea88 tempest-DeleteServersTestJSON-752571955 tempest-DeleteServersTestJSON-752571955-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:42:57.896378 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-0c28a9e8-2ef1-4e1f-8d31-458031e1ea88 tempest-DeleteServersTestJSON-752571955 tempest-DeleteServersTestJSON-752571955-project] [instance: 6cc17348-b41d-46ba-a1d6-9f80614b7596] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:42:57.908302 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-0c28a9e8-2ef1-4e1f-8d31-458031e1ea88 tempest-DeleteServersTestJSON-752571955 tempest-DeleteServersTestJSON-752571955-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:42:57.911063 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-0c28a9e8-2ef1-4e1f-8d31-458031e1ea88 tempest-DeleteServersTestJSON-752571955 tempest-DeleteServersTestJSON-752571955-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:42:57.914302 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-0c28a9e8-2ef1-4e1f-8d31-458031e1ea88 tempest-DeleteServersTestJSON-752571955 tempest-DeleteServersTestJSON-752571955-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:42:57.915106 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-0c28a9e8-2ef1-4e1f-8d31-458031e1ea88 tempest-DeleteServersTestJSON-752571955 tempest-DeleteServersTestJSON-752571955-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:42:58.237387 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-f3444932-639b-4d17-90f0-01c5500e874e tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:42:58.238578 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-f3444932-639b-4d17-90f0-01c5500e874e tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] [instance: a4e225e4-7815-4f6a-b1e6-53edab3c1abd] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:42:58.248850 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-f3444932-639b-4d17-90f0-01c5500e874e tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:42:58.249751 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-f3444932-639b-4d17-90f0-01c5500e874e tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:42:58.250881 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-f3444932-639b-4d17-90f0-01c5500e874e tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:42:58.251319 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-f3444932-639b-4d17-90f0-01c5500e874e tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:42:58.582138 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-0c28a9e8-2ef1-4e1f-8d31-458031e1ea88 tempest-DeleteServersTestJSON-752571955 tempest-DeleteServersTestJSON-752571955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf1a0e4ab3ab4008a25339e4eda7a48d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be9d7084d7ab4e408be53dd27f8748a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:42:58.585254 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-f3444932-639b-4d17-90f0-01c5500e874e tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0abe23cb5f314bc883ef7958b0ed9b5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fc48df471f247809d82ddf926bfdc6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:42:58.599971 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-f3444932-639b-4d17-90f0-01c5500e874e tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] 10.222.0.64 "GET /compute/v2.1/servers/a4e225e4-7815-4f6a-b1e6-53edab3c1abd" status: 200 len: 1317 microversion: 2.1 time: 0.366333 Oct 27 15:42:58.613679 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-0c28a9e8-2ef1-4e1f-8d31-458031e1ea88 tempest-DeleteServersTestJSON-752571955 tempest-DeleteServersTestJSON-752571955-project] 10.222.0.64 "GET /compute/v2.1/servers/6cc17348-b41d-46ba-a1d6-9f80614b7596" status: 200 len: 1315 microversion: 2.1 time: 0.724238 Oct 27 15:42:58.614631 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 41/57] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:42:58 2021] GET /compute/v2.1/servers/a4e225e4-7815-4f6a-b1e6-53edab3c1abd => generated 1317 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 15:42:58.619329 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-d075587b-ea26-4e9a-9410-f1ba57c300f7 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:42:58.620587 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 17/58] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:42:57 2021] GET /compute/v2.1/servers/6cc17348-b41d-46ba-a1d6-9f80614b7596 => generated 1315 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 15:42:58.626868 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-d075587b-ea26-4e9a-9410-f1ba57c300f7 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: bced4f24-572a-4316-97e8-3ceedc61a621] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:42:58.634035 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-d075587b-ea26-4e9a-9410-f1ba57c300f7 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:42:58.635246 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-d075587b-ea26-4e9a-9410-f1ba57c300f7 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:42:58.636235 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-d075587b-ea26-4e9a-9410-f1ba57c300f7 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:42:58.636811 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-d075587b-ea26-4e9a-9410-f1ba57c300f7 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:42:58.813719 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [req-6d104fb7-fc2c-433c-bdd8-841baab79e45 req-e1b4eff1-60d4-4212-93c6-aaafe41b936b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a4e225e4-7815-4f6a-b1e6-53edab3c1abd", "tag": "fb349725-2f48-49da-a6bd-4dd4cd255a4f"}]} {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 15:42:58.816429 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 27 15:42:58.816429 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: warnings.warn(msg) Oct 27 15:42:58.838350 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [req-6d104fb7-fc2c-433c-bdd8-841baab79e45 req-e1b4eff1-60d4-4212-93c6-aaafe41b936b service nova] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:42:58.838350 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [req-6d104fb7-fc2c-433c-bdd8-841baab79e45 req-e1b4eff1-60d4-4212-93c6-aaafe41b936b service nova] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:42:58.869408 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.compute.server_external_events [req-6d104fb7-fc2c-433c-bdd8-841baab79e45 req-e1b4eff1-60d4-4212-93c6-aaafe41b936b service nova] Creating event network-changed:fb349725-2f48-49da-a6bd-4dd4cd255a4f for instance a4e225e4-7815-4f6a-b1e6-53edab3c1abd on hv-cinder-80070 Oct 27 15:42:58.869932 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [req-6d104fb7-fc2c-433c-bdd8-841baab79e45 req-e1b4eff1-60d4-4212-93c6-aaafe41b936b service nova] Acquired lock "compute-rpcapi-router" {{(pid=122225) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:266}} Oct 27 15:42:58.871053 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-f0caf7ae-b435-4900-9f31-22cbc4d49fc3 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:42:58.871492 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-f0caf7ae-b435-4900-9f31-22cbc4d49fc3 None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:42:58.872302 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-f0caf7ae-b435-4900-9f31-22cbc4d49fc3 None None] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:42:58.872733 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-f0caf7ae-b435-4900-9f31-22cbc4d49fc3 None None] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:42:58.891665 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.compute.rpcapi [None req-f0caf7ae-b435-4900-9f31-22cbc4d49fc3 None None] Automatically selected compute RPC version 6.0 from minimum service version 60 Oct 27 15:42:58.892592 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-f0caf7ae-b435-4900-9f31-22cbc4d49fc3 None None] Releasing lock "compute-rpcapi-router" {{(pid=122225) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:282}} Oct 27 15:42:58.906915 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-d075587b-ea26-4e9a-9410-f1ba57c300f7 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96b599f8890b4281a7e311cf37a039e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d7fcab5d3f465793d650f16c6ea8de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:42:58.932978 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-d075587b-ea26-4e9a-9410-f1ba57c300f7 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/bced4f24-572a-4316-97e8-3ceedc61a621" status: 200 len: 1321 microversion: 2.1 time: 0.317034 Oct 27 15:42:58.936956 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 42/59] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:42:58 2021] GET /compute/v2.1/servers/bced4f24-572a-4316-97e8-3ceedc61a621 => generated 1321 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 15:42:58.938524 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-f0caf7ae-b435-4900-9f31-22cbc4d49fc3 None None] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.316508 Oct 27 15:42:58.939118 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 18/60] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Oct 27 15:42:58 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 15:42:58.951821 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-2e639f83-6cb2-4ae6-bf7c-16048bdea9d8 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:42:58.954137 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-2e639f83-6cb2-4ae6-bf7c-16048bdea9d8 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:42:58.969165 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-2e639f83-6cb2-4ae6-bf7c-16048bdea9d8 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:42:58.969604 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-2e639f83-6cb2-4ae6-bf7c-16048bdea9d8 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:42:58.972436 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-2e639f83-6cb2-4ae6-bf7c-16048bdea9d8 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:42:58.972874 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-2e639f83-6cb2-4ae6-bf7c-16048bdea9d8 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:42:59.084295 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-2e639f83-6cb2-4ae6-bf7c-16048bdea9d8 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:42:59.098033 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-2e639f83-6cb2-4ae6-bf7c-16048bdea9d8 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:42:59.101259 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-2e639f83-6cb2-4ae6-bf7c-16048bdea9d8 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:42:59.102478 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-2e639f83-6cb2-4ae6-bf7c-16048bdea9d8 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672" status: 200 len: 1334 microversion: 2.20 time: 0.164332 Oct 27 15:42:59.116317 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 43/61] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Oct 27 15:42:58 2021] GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672 => generated 1334 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 15:42:59.620764 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-dc8f7ed7-51ec-464c-a909-831fe7d69b66 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:42:59.622211 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-dc8f7ed7-51ec-464c-a909-831fe7d69b66 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] [instance: a4e225e4-7815-4f6a-b1e6-53edab3c1abd] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:42:59.631193 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-dc8f7ed7-51ec-464c-a909-831fe7d69b66 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:42:59.632048 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-dc8f7ed7-51ec-464c-a909-831fe7d69b66 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:42:59.633198 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-dc8f7ed7-51ec-464c-a909-831fe7d69b66 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:42:59.633824 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-dc8f7ed7-51ec-464c-a909-831fe7d69b66 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:42:59.635841 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-c7dd6935-3e0c-4660-8893-b0d64a3e81bc tempest-DeleteServersTestJSON-752571955 tempest-DeleteServersTestJSON-752571955-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:42:59.636484 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-c7dd6935-3e0c-4660-8893-b0d64a3e81bc tempest-DeleteServersTestJSON-752571955 tempest-DeleteServersTestJSON-752571955-project] [instance: 6cc17348-b41d-46ba-a1d6-9f80614b7596] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:42:59.643709 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-c7dd6935-3e0c-4660-8893-b0d64a3e81bc tempest-DeleteServersTestJSON-752571955 tempest-DeleteServersTestJSON-752571955-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:42:59.647073 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-c7dd6935-3e0c-4660-8893-b0d64a3e81bc tempest-DeleteServersTestJSON-752571955 tempest-DeleteServersTestJSON-752571955-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:42:59.654029 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-c7dd6935-3e0c-4660-8893-b0d64a3e81bc tempest-DeleteServersTestJSON-752571955 tempest-DeleteServersTestJSON-752571955-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:42:59.654489 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-c7dd6935-3e0c-4660-8893-b0d64a3e81bc tempest-DeleteServersTestJSON-752571955 tempest-DeleteServersTestJSON-752571955-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:42:59.845102 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-dc8f7ed7-51ec-464c-a909-831fe7d69b66 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0abe23cb5f314bc883ef7958b0ed9b5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fc48df471f247809d82ddf926bfdc6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:42:59.858101 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-dc8f7ed7-51ec-464c-a909-831fe7d69b66 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] 10.222.0.64 "GET /compute/v2.1/servers/a4e225e4-7815-4f6a-b1e6-53edab3c1abd" status: 200 len: 1317 microversion: 2.1 time: 0.243670 Oct 27 15:42:59.858691 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 19/62] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:42:59 2021] GET /compute/v2.1/servers/a4e225e4-7815-4f6a-b1e6-53edab3c1abd => generated 1317 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 15:42:59.863610 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-c7dd6935-3e0c-4660-8893-b0d64a3e81bc tempest-DeleteServersTestJSON-752571955 tempest-DeleteServersTestJSON-752571955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf1a0e4ab3ab4008a25339e4eda7a48d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be9d7084d7ab4e408be53dd27f8748a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:42:59.870726 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-c7dd6935-3e0c-4660-8893-b0d64a3e81bc tempest-DeleteServersTestJSON-752571955 tempest-DeleteServersTestJSON-752571955-project] 10.222.0.64 "GET /compute/v2.1/servers/6cc17348-b41d-46ba-a1d6-9f80614b7596" status: 200 len: 1315 microversion: 2.1 time: 0.238698 Oct 27 15:42:59.871284 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 44/63] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:42:59 2021] GET /compute/v2.1/servers/6cc17348-b41d-46ba-a1d6-9f80614b7596 => generated 1315 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 15:42:59.951098 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-988b2372-5c31-4ce9-a497-9bef01dfaecd tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:42:59.951899 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-988b2372-5c31-4ce9-a497-9bef01dfaecd tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: bced4f24-572a-4316-97e8-3ceedc61a621] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:42:59.960051 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-988b2372-5c31-4ce9-a497-9bef01dfaecd tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:42:59.960708 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-988b2372-5c31-4ce9-a497-9bef01dfaecd tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:42:59.961783 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-988b2372-5c31-4ce9-a497-9bef01dfaecd tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:42:59.962516 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-988b2372-5c31-4ce9-a497-9bef01dfaecd tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:43:00.120925 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-1b387f9c-2203-4eb3-9916-ac91bb2e6853 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:43:00.121702 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-1b387f9c-2203-4eb3-9916-ac91bb2e6853 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:43:00.122598 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-988b2372-5c31-4ce9-a497-9bef01dfaecd tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96b599f8890b4281a7e311cf37a039e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d7fcab5d3f465793d650f16c6ea8de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:43:00.132915 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-988b2372-5c31-4ce9-a497-9bef01dfaecd tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/bced4f24-572a-4316-97e8-3ceedc61a621" status: 200 len: 1321 microversion: 2.1 time: 0.185856 Oct 27 15:43:00.133497 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 20/64] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:42:59 2021] GET /compute/v2.1/servers/bced4f24-572a-4316-97e8-3ceedc61a621 => generated 1321 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 15:43:00.139029 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-1b387f9c-2203-4eb3-9916-ac91bb2e6853 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:43:00.140535 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-1b387f9c-2203-4eb3-9916-ac91bb2e6853 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:43:00.141480 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-1b387f9c-2203-4eb3-9916-ac91bb2e6853 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:43:00.142065 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-1b387f9c-2203-4eb3-9916-ac91bb2e6853 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:43:00.206234 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-1b387f9c-2203-4eb3-9916-ac91bb2e6853 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:43:00.215572 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-1b387f9c-2203-4eb3-9916-ac91bb2e6853 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:43:00.218625 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-1b387f9c-2203-4eb3-9916-ac91bb2e6853 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:43:00.218625 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-1b387f9c-2203-4eb3-9916-ac91bb2e6853 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672" status: 200 len: 1334 microversion: 2.20 time: 0.101292 Oct 27 15:43:00.224631 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 45/65] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Oct 27 15:43:00 2021] GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672 => generated 1334 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 15:43:00.875103 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-b97049b0-3b2b-4020-a0fa-bd19e21194f6 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:43:00.875616 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-b97049b0-3b2b-4020-a0fa-bd19e21194f6 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] [instance: a4e225e4-7815-4f6a-b1e6-53edab3c1abd] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:43:00.890488 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-8d1d1b0f-c0a3-48de-ae66-d21dcee174f9 tempest-DeleteServersTestJSON-752571955 tempest-DeleteServersTestJSON-752571955-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:43:00.891686 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-8d1d1b0f-c0a3-48de-ae66-d21dcee174f9 tempest-DeleteServersTestJSON-752571955 tempest-DeleteServersTestJSON-752571955-project] [instance: 6cc17348-b41d-46ba-a1d6-9f80614b7596] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:43:00.900416 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-8d1d1b0f-c0a3-48de-ae66-d21dcee174f9 tempest-DeleteServersTestJSON-752571955 tempest-DeleteServersTestJSON-752571955-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:43:00.903592 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-b97049b0-3b2b-4020-a0fa-bd19e21194f6 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:43:00.904322 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-b97049b0-3b2b-4020-a0fa-bd19e21194f6 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:43:00.904969 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-8d1d1b0f-c0a3-48de-ae66-d21dcee174f9 tempest-DeleteServersTestJSON-752571955 tempest-DeleteServersTestJSON-752571955-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:43:00.905945 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-b97049b0-3b2b-4020-a0fa-bd19e21194f6 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:43:00.907065 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-8d1d1b0f-c0a3-48de-ae66-d21dcee174f9 tempest-DeleteServersTestJSON-752571955 tempest-DeleteServersTestJSON-752571955-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:43:00.907945 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-b97049b0-3b2b-4020-a0fa-bd19e21194f6 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:43:00.909104 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-8d1d1b0f-c0a3-48de-ae66-d21dcee174f9 tempest-DeleteServersTestJSON-752571955 tempest-DeleteServersTestJSON-752571955-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:43:01.278654 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-8d1d1b0f-c0a3-48de-ae66-d21dcee174f9 tempest-DeleteServersTestJSON-752571955 tempest-DeleteServersTestJSON-752571955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf1a0e4ab3ab4008a25339e4eda7a48d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be9d7084d7ab4e408be53dd27f8748a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:43:01.287823 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-8d1d1b0f-c0a3-48de-ae66-d21dcee174f9 tempest-DeleteServersTestJSON-752571955 tempest-DeleteServersTestJSON-752571955-project] 10.222.0.64 "GET /compute/v2.1/servers/6cc17348-b41d-46ba-a1d6-9f80614b7596" status: 200 len: 1315 microversion: 2.1 time: 0.403388 Oct 27 15:43:01.294810 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 46/66] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:43:00 2021] GET /compute/v2.1/servers/6cc17348-b41d-46ba-a1d6-9f80614b7596 => generated 1315 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 15:43:01.299889 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [req-ac7d0d01-b65a-4f58-9c57-432f368692bf req-ae7a01cd-b6d6-4a39-8645-8825c73f8425 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6cc17348-b41d-46ba-a1d6-9f80614b7596", "tag": "e85edc27-86b1-4171-baec-a08e7231cb2d"}]} {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 15:43:01.308097 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 27 15:43:01.308097 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: warnings.warn(msg) Oct 27 15:43:01.330999 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [req-ac7d0d01-b65a-4f58-9c57-432f368692bf req-ae7a01cd-b6d6-4a39-8645-8825c73f8425 service nova] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:43:01.332750 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [req-ac7d0d01-b65a-4f58-9c57-432f368692bf req-ae7a01cd-b6d6-4a39-8645-8825c73f8425 service nova] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:43:01.364660 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.compute.server_external_events [req-ac7d0d01-b65a-4f58-9c57-432f368692bf req-ae7a01cd-b6d6-4a39-8645-8825c73f8425 service nova] Creating event network-changed:e85edc27-86b1-4171-baec-a08e7231cb2d for instance 6cc17348-b41d-46ba-a1d6-9f80614b7596 on hv-cinder-80070 Oct 27 15:43:01.365268 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [req-ac7d0d01-b65a-4f58-9c57-432f368692bf req-ae7a01cd-b6d6-4a39-8645-8825c73f8425 service nova] Acquired lock "compute-rpcapi-router" {{(pid=122224) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:266}} Oct 27 15:43:01.366480 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-d9e82c98-9082-4cf4-8114-0337a24503d1 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:43:01.366989 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-d9e82c98-9082-4cf4-8114-0337a24503d1 None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:43:01.367867 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-d9e82c98-9082-4cf4-8114-0337a24503d1 None None] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:43:01.368374 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-d9e82c98-9082-4cf4-8114-0337a24503d1 None None] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:43:01.379288 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.compute.rpcapi [None req-d9e82c98-9082-4cf4-8114-0337a24503d1 None None] Automatically selected compute RPC version 6.0 from minimum service version 60 Oct 27 15:43:01.380305 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-d9e82c98-9082-4cf4-8114-0337a24503d1 None None] Releasing lock "compute-rpcapi-router" {{(pid=122224) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:282}} Oct 27 15:43:01.423729 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-d9e82c98-9082-4cf4-8114-0337a24503d1 None None] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.127366 Oct 27 15:43:01.425409 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 47/67] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Oct 27 15:43:01 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 15:43:01.430618 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-84c57922-751a-4be9-bf2f-530acd10931a tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:43:01.431318 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-84c57922-751a-4be9-bf2f-530acd10931a tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: bced4f24-572a-4316-97e8-3ceedc61a621] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:43:01.445852 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-84c57922-751a-4be9-bf2f-530acd10931a tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:43:01.446305 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-84c57922-751a-4be9-bf2f-530acd10931a tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:43:01.447092 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-84c57922-751a-4be9-bf2f-530acd10931a tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:43:01.447526 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-84c57922-751a-4be9-bf2f-530acd10931a tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:43:01.560009 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-b97049b0-3b2b-4020-a0fa-bd19e21194f6 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0abe23cb5f314bc883ef7958b0ed9b5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fc48df471f247809d82ddf926bfdc6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:43:01.581402 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-b97049b0-3b2b-4020-a0fa-bd19e21194f6 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] 10.222.0.64 "GET /compute/v2.1/servers/a4e225e4-7815-4f6a-b1e6-53edab3c1abd" status: 200 len: 1317 microversion: 2.1 time: 0.707131 Oct 27 15:43:01.582394 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 21/68] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:43:00 2021] GET /compute/v2.1/servers/a4e225e4-7815-4f6a-b1e6-53edab3c1abd => generated 1317 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 15:43:01.588518 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-0173d92c-5734-4767-8df7-8cc2687d81ca tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:43:01.589357 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-0173d92c-5734-4767-8df7-8cc2687d81ca tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:43:01.598016 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-0173d92c-5734-4767-8df7-8cc2687d81ca tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:43:01.600021 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-0173d92c-5734-4767-8df7-8cc2687d81ca tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:43:01.601619 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-0173d92c-5734-4767-8df7-8cc2687d81ca tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:43:01.602072 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-0173d92c-5734-4767-8df7-8cc2687d81ca tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:43:01.845309 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-84c57922-751a-4be9-bf2f-530acd10931a tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96b599f8890b4281a7e311cf37a039e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d7fcab5d3f465793d650f16c6ea8de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:43:01.855475 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-84c57922-751a-4be9-bf2f-530acd10931a tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/bced4f24-572a-4316-97e8-3ceedc61a621" status: 200 len: 1321 microversion: 2.1 time: 0.428834 Oct 27 15:43:01.867385 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 48/69] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:43:01 2021] GET /compute/v2.1/servers/bced4f24-572a-4316-97e8-3ceedc61a621 => generated 1321 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 15:43:01.944496 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-0173d92c-5734-4767-8df7-8cc2687d81ca tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:43:01.953712 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-0173d92c-5734-4767-8df7-8cc2687d81ca tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:43:01.955619 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-0173d92c-5734-4767-8df7-8cc2687d81ca tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:43:01.956868 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-0173d92c-5734-4767-8df7-8cc2687d81ca tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672" status: 200 len: 1340 microversion: 2.20 time: 0.373056 Oct 27 15:43:01.957507 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 22/70] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Oct 27 15:43:01 2021] GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672 => generated 1340 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 15:43:02.313595 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-9ccea5db-5c1b-4ec2-9dd2-fb82a599dd9e tempest-DeleteServersTestJSON-752571955 tempest-DeleteServersTestJSON-752571955-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:43:02.315014 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-9ccea5db-5c1b-4ec2-9dd2-fb82a599dd9e tempest-DeleteServersTestJSON-752571955 tempest-DeleteServersTestJSON-752571955-project] [instance: 6cc17348-b41d-46ba-a1d6-9f80614b7596] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:43:02.322573 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-9ccea5db-5c1b-4ec2-9dd2-fb82a599dd9e tempest-DeleteServersTestJSON-752571955 tempest-DeleteServersTestJSON-752571955-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:43:02.323121 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-9ccea5db-5c1b-4ec2-9dd2-fb82a599dd9e tempest-DeleteServersTestJSON-752571955 tempest-DeleteServersTestJSON-752571955-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:43:02.324135 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-9ccea5db-5c1b-4ec2-9dd2-fb82a599dd9e tempest-DeleteServersTestJSON-752571955 tempest-DeleteServersTestJSON-752571955-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:43:02.324754 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-9ccea5db-5c1b-4ec2-9dd2-fb82a599dd9e tempest-DeleteServersTestJSON-752571955 tempest-DeleteServersTestJSON-752571955-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:43:02.605945 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-9ccea5db-5c1b-4ec2-9dd2-fb82a599dd9e tempest-DeleteServersTestJSON-752571955 tempest-DeleteServersTestJSON-752571955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf1a0e4ab3ab4008a25339e4eda7a48d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be9d7084d7ab4e408be53dd27f8748a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:43:02.608244 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-bfd1a24f-cc3a-431a-ba81-ce92fb20d337 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:43:02.608916 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-bfd1a24f-cc3a-431a-ba81-ce92fb20d337 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] [instance: a4e225e4-7815-4f6a-b1e6-53edab3c1abd] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:43:02.616595 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-9ccea5db-5c1b-4ec2-9dd2-fb82a599dd9e tempest-DeleteServersTestJSON-752571955 tempest-DeleteServersTestJSON-752571955-project] 10.222.0.64 "GET /compute/v2.1/servers/6cc17348-b41d-46ba-a1d6-9f80614b7596" status: 200 len: 1315 microversion: 2.1 time: 0.307472 Oct 27 15:43:02.622988 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-bfd1a24f-cc3a-431a-ba81-ce92fb20d337 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:43:02.623690 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 49/71] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:43:02 2021] GET /compute/v2.1/servers/6cc17348-b41d-46ba-a1d6-9f80614b7596 => generated 1315 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 15:43:02.626541 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-bfd1a24f-cc3a-431a-ba81-ce92fb20d337 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:43:02.633187 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-bfd1a24f-cc3a-431a-ba81-ce92fb20d337 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:43:02.634094 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-bfd1a24f-cc3a-431a-ba81-ce92fb20d337 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:43:02.876681 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-2d0f54ec-2372-4cda-b509-4cd3fded9c21 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:43:02.878918 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-2d0f54ec-2372-4cda-b509-4cd3fded9c21 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: bced4f24-572a-4316-97e8-3ceedc61a621] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:43:02.890411 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-2d0f54ec-2372-4cda-b509-4cd3fded9c21 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:43:02.893467 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-2d0f54ec-2372-4cda-b509-4cd3fded9c21 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:43:02.895183 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-2d0f54ec-2372-4cda-b509-4cd3fded9c21 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:43:02.897299 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-2d0f54ec-2372-4cda-b509-4cd3fded9c21 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:43:03.199083 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-bfd1a24f-cc3a-431a-ba81-ce92fb20d337 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0abe23cb5f314bc883ef7958b0ed9b5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fc48df471f247809d82ddf926bfdc6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:43:03.207360 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-bfd1a24f-cc3a-431a-ba81-ce92fb20d337 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] 10.222.0.64 "GET /compute/v2.1/servers/a4e225e4-7815-4f6a-b1e6-53edab3c1abd" status: 200 len: 1317 microversion: 2.1 time: 0.612655 Oct 27 15:43:03.211961 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 23/72] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:43:02 2021] GET /compute/v2.1/servers/a4e225e4-7815-4f6a-b1e6-53edab3c1abd => generated 1317 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 15:43:03.228753 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-0775f490-2e3c-46d7-9de9-cd903ce1c562 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:43:03.229399 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-0775f490-2e3c-46d7-9de9-cd903ce1c562 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:43:03.235292 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-0775f490-2e3c-46d7-9de9-cd903ce1c562 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:43:03.235745 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-0775f490-2e3c-46d7-9de9-cd903ce1c562 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:43:03.236512 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-2d0f54ec-2372-4cda-b509-4cd3fded9c21 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96b599f8890b4281a7e311cf37a039e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d7fcab5d3f465793d650f16c6ea8de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:43:03.237255 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-0775f490-2e3c-46d7-9de9-cd903ce1c562 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:43:03.237255 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-0775f490-2e3c-46d7-9de9-cd903ce1c562 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:43:03.256414 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-2d0f54ec-2372-4cda-b509-4cd3fded9c21 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/bced4f24-572a-4316-97e8-3ceedc61a621" status: 200 len: 1321 microversion: 2.1 time: 0.386758 Oct 27 15:43:03.266454 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 50/73] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:43:02 2021] GET /compute/v2.1/servers/bced4f24-572a-4316-97e8-3ceedc61a621 => generated 1321 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 15:43:03.641127 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-0753b560-5087-4a8c-9761-e906f1f9b87a tempest-DeleteServersTestJSON-752571955 tempest-DeleteServersTestJSON-752571955-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:43:03.643314 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-0753b560-5087-4a8c-9761-e906f1f9b87a tempest-DeleteServersTestJSON-752571955 tempest-DeleteServersTestJSON-752571955-project] [instance: 6cc17348-b41d-46ba-a1d6-9f80614b7596] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:43:03.654956 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-0753b560-5087-4a8c-9761-e906f1f9b87a tempest-DeleteServersTestJSON-752571955 tempest-DeleteServersTestJSON-752571955-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:43:03.659577 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-0753b560-5087-4a8c-9761-e906f1f9b87a tempest-DeleteServersTestJSON-752571955 tempest-DeleteServersTestJSON-752571955-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:43:03.661357 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-0753b560-5087-4a8c-9761-e906f1f9b87a tempest-DeleteServersTestJSON-752571955 tempest-DeleteServersTestJSON-752571955-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:43:03.662115 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-0753b560-5087-4a8c-9761-e906f1f9b87a tempest-DeleteServersTestJSON-752571955 tempest-DeleteServersTestJSON-752571955-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:43:03.785773 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-0775f490-2e3c-46d7-9de9-cd903ce1c562 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:43:03.795350 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-0775f490-2e3c-46d7-9de9-cd903ce1c562 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:43:03.796898 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-0775f490-2e3c-46d7-9de9-cd903ce1c562 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:43:03.809716 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-0775f490-2e3c-46d7-9de9-cd903ce1c562 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672" status: 200 len: 1408 microversion: 2.20 time: 0.596617 Oct 27 15:43:03.810301 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 24/74] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Oct 27 15:43:03 2021] GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672 => generated 1408 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 15:43:03.818796 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [req-ead9a8d1-6f19-428e-9417-b3a12ba843fa req-2b2890f4-4a73-4648-83a8-778b59d239c0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bced4f24-572a-4316-97e8-3ceedc61a621", "tag": "4638d661-d8d4-4d3b-ac20-f85ec470f7f4"}]} {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 15:43:03.820426 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 27 15:43:03.820426 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: warnings.warn(msg) Oct 27 15:43:03.839870 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [req-ead9a8d1-6f19-428e-9417-b3a12ba843fa req-2b2890f4-4a73-4648-83a8-778b59d239c0 service nova] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:43:03.840247 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [req-ead9a8d1-6f19-428e-9417-b3a12ba843fa req-2b2890f4-4a73-4648-83a8-778b59d239c0 service nova] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:43:03.852331 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.compute.server_external_events [req-ead9a8d1-6f19-428e-9417-b3a12ba843fa req-2b2890f4-4a73-4648-83a8-778b59d239c0 service nova] Creating event network-changed:4638d661-d8d4-4d3b-ac20-f85ec470f7f4 for instance bced4f24-572a-4316-97e8-3ceedc61a621 on hv-cinder-80070 Oct 27 15:43:03.857582 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [req-ead9a8d1-6f19-428e-9417-b3a12ba843fa req-2b2890f4-4a73-4648-83a8-778b59d239c0 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045079 Oct 27 15:43:03.858699 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 25/75] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Oct 27 15:43:03 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 15:43:04.080765 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-0753b560-5087-4a8c-9761-e906f1f9b87a tempest-DeleteServersTestJSON-752571955 tempest-DeleteServersTestJSON-752571955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf1a0e4ab3ab4008a25339e4eda7a48d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be9d7084d7ab4e408be53dd27f8748a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:43:04.089047 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-0753b560-5087-4a8c-9761-e906f1f9b87a tempest-DeleteServersTestJSON-752571955 tempest-DeleteServersTestJSON-752571955-project] 10.222.0.64 "GET /compute/v2.1/servers/6cc17348-b41d-46ba-a1d6-9f80614b7596" status: 200 len: 1315 microversion: 2.1 time: 0.452706 Oct 27 15:43:04.099286 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 51/76] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:43:03 2021] GET /compute/v2.1/servers/6cc17348-b41d-46ba-a1d6-9f80614b7596 => generated 1315 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 15:43:04.223966 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-a37a70dc-9119-4a2a-a3b8-82e3d48af5f1 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:43:04.224582 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-a37a70dc-9119-4a2a-a3b8-82e3d48af5f1 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] [instance: a4e225e4-7815-4f6a-b1e6-53edab3c1abd] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:43:04.234690 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-a37a70dc-9119-4a2a-a3b8-82e3d48af5f1 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:43:04.235135 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-a37a70dc-9119-4a2a-a3b8-82e3d48af5f1 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:43:04.245575 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-a37a70dc-9119-4a2a-a3b8-82e3d48af5f1 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:43:04.246388 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-a37a70dc-9119-4a2a-a3b8-82e3d48af5f1 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:43:04.246526 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [req-cfed2110-125d-4c20-86cd-d467c4583919 req-665c49dd-9f7e-4fdd-a87c-ad8819af0bb8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a115c672-012e-4e45-b5c9-4427e7b66672", "tag": "c9ac335c-5a25-416c-803f-ac2f3d462176"}]} {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 15:43:04.248744 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 27 15:43:04.248744 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: warnings.warn(msg) Oct 27 15:43:04.257555 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [req-cfed2110-125d-4c20-86cd-d467c4583919 req-665c49dd-9f7e-4fdd-a87c-ad8819af0bb8 service nova] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:43:04.258137 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [req-cfed2110-125d-4c20-86cd-d467c4583919 req-665c49dd-9f7e-4fdd-a87c-ad8819af0bb8 service nova] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:43:04.271828 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.compute.server_external_events [req-cfed2110-125d-4c20-86cd-d467c4583919 req-665c49dd-9f7e-4fdd-a87c-ad8819af0bb8 service nova] Creating event network-changed:c9ac335c-5a25-416c-803f-ac2f3d462176 for instance a115c672-012e-4e45-b5c9-4427e7b66672 on hv-cinder-80070 Oct 27 15:43:04.276630 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [req-cfed2110-125d-4c20-86cd-d467c4583919 req-665c49dd-9f7e-4fdd-a87c-ad8819af0bb8 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090970 Oct 27 15:43:04.277310 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 26/77] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Oct 27 15:43:04 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 15:43:04.282814 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-0aa0e4de-c492-4d77-8a2d-1496a67a99e9 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:43:04.284199 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-0aa0e4de-c492-4d77-8a2d-1496a67a99e9 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: bced4f24-572a-4316-97e8-3ceedc61a621] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:43:04.291234 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-0aa0e4de-c492-4d77-8a2d-1496a67a99e9 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:43:04.291781 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-0aa0e4de-c492-4d77-8a2d-1496a67a99e9 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:43:04.292752 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-0aa0e4de-c492-4d77-8a2d-1496a67a99e9 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:43:04.293270 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-0aa0e4de-c492-4d77-8a2d-1496a67a99e9 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:43:04.396487 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-a37a70dc-9119-4a2a-a3b8-82e3d48af5f1 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0abe23cb5f314bc883ef7958b0ed9b5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fc48df471f247809d82ddf926bfdc6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:43:04.405029 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-a37a70dc-9119-4a2a-a3b8-82e3d48af5f1 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] 10.222.0.64 "GET /compute/v2.1/servers/a4e225e4-7815-4f6a-b1e6-53edab3c1abd" status: 200 len: 1317 microversion: 2.1 time: 0.184617 Oct 27 15:43:04.405709 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 52/78] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:43:04 2021] GET /compute/v2.1/servers/a4e225e4-7815-4f6a-b1e6-53edab3c1abd => generated 1317 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 15:43:04.626431 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-0aa0e4de-c492-4d77-8a2d-1496a67a99e9 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96b599f8890b4281a7e311cf37a039e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d7fcab5d3f465793d650f16c6ea8de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:43:04.633978 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-0aa0e4de-c492-4d77-8a2d-1496a67a99e9 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/bced4f24-572a-4316-97e8-3ceedc61a621" status: 200 len: 1321 microversion: 2.1 time: 0.355088 Oct 27 15:43:04.634624 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 27/79] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:43:04 2021] GET /compute/v2.1/servers/bced4f24-572a-4316-97e8-3ceedc61a621 => generated 1321 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 15:43:04.827166 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-d51df920-70ff-4b22-8648-061e694aca44 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:43:04.827760 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-d51df920-70ff-4b22-8648-061e694aca44 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:43:04.834021 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-d51df920-70ff-4b22-8648-061e694aca44 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:43:04.834463 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-d51df920-70ff-4b22-8648-061e694aca44 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:43:04.835211 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-d51df920-70ff-4b22-8648-061e694aca44 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:43:04.835831 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-d51df920-70ff-4b22-8648-061e694aca44 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:43:05.106828 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-8c507618-86ce-40a3-aa95-f14fffa3c0ba tempest-DeleteServersTestJSON-752571955 tempest-DeleteServersTestJSON-752571955-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:43:05.107788 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-8c507618-86ce-40a3-aa95-f14fffa3c0ba tempest-DeleteServersTestJSON-752571955 tempest-DeleteServersTestJSON-752571955-project] [instance: 6cc17348-b41d-46ba-a1d6-9f80614b7596] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:43:05.114143 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-8c507618-86ce-40a3-aa95-f14fffa3c0ba tempest-DeleteServersTestJSON-752571955 tempest-DeleteServersTestJSON-752571955-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:43:05.114866 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-8c507618-86ce-40a3-aa95-f14fffa3c0ba tempest-DeleteServersTestJSON-752571955 tempest-DeleteServersTestJSON-752571955-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:43:05.115986 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-8c507618-86ce-40a3-aa95-f14fffa3c0ba tempest-DeleteServersTestJSON-752571955 tempest-DeleteServersTestJSON-752571955-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:43:05.116603 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-8c507618-86ce-40a3-aa95-f14fffa3c0ba tempest-DeleteServersTestJSON-752571955 tempest-DeleteServersTestJSON-752571955-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:43:05.137333 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-d51df920-70ff-4b22-8648-061e694aca44 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:43:05.158655 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-d51df920-70ff-4b22-8648-061e694aca44 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:43:05.160271 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-d51df920-70ff-4b22-8648-061e694aca44 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:43:05.161443 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-d51df920-70ff-4b22-8648-061e694aca44 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672" status: 200 len: 1408 microversion: 2.20 time: 0.337877 Oct 27 15:43:05.178467 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 53/80] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Oct 27 15:43:04 2021] GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672 => generated 1408 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 15:43:05.344125 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-8c507618-86ce-40a3-aa95-f14fffa3c0ba tempest-DeleteServersTestJSON-752571955 tempest-DeleteServersTestJSON-752571955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf1a0e4ab3ab4008a25339e4eda7a48d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be9d7084d7ab4e408be53dd27f8748a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:43:05.354277 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-8c507618-86ce-40a3-aa95-f14fffa3c0ba tempest-DeleteServersTestJSON-752571955 tempest-DeleteServersTestJSON-752571955-project] 10.222.0.64 "GET /compute/v2.1/servers/6cc17348-b41d-46ba-a1d6-9f80614b7596" status: 200 len: 1315 microversion: 2.1 time: 0.251904 Oct 27 15:43:05.355171 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 28/81] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:43:05 2021] GET /compute/v2.1/servers/6cc17348-b41d-46ba-a1d6-9f80614b7596 => generated 1315 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 15:43:05.424943 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-fefad33e-4f4a-4fb0-8ccd-483e26f2244d tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:43:05.425559 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-fefad33e-4f4a-4fb0-8ccd-483e26f2244d tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] [instance: a4e225e4-7815-4f6a-b1e6-53edab3c1abd] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:43:05.431623 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-fefad33e-4f4a-4fb0-8ccd-483e26f2244d tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:43:05.432242 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-fefad33e-4f4a-4fb0-8ccd-483e26f2244d tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:43:05.433017 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-fefad33e-4f4a-4fb0-8ccd-483e26f2244d tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:43:05.433453 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-fefad33e-4f4a-4fb0-8ccd-483e26f2244d tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:43:05.562994 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-fefad33e-4f4a-4fb0-8ccd-483e26f2244d tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0abe23cb5f314bc883ef7958b0ed9b5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fc48df471f247809d82ddf926bfdc6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:43:05.572221 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-fefad33e-4f4a-4fb0-8ccd-483e26f2244d tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] 10.222.0.64 "GET /compute/v2.1/servers/a4e225e4-7815-4f6a-b1e6-53edab3c1abd" status: 200 len: 1317 microversion: 2.1 time: 0.153224 Oct 27 15:43:05.572839 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 54/82] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:43:05 2021] GET /compute/v2.1/servers/a4e225e4-7815-4f6a-b1e6-53edab3c1abd => generated 1317 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 15:43:05.654249 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-29225a21-e66c-4182-9d24-ce8745af7bb5 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:43:05.654879 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-29225a21-e66c-4182-9d24-ce8745af7bb5 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: bced4f24-572a-4316-97e8-3ceedc61a621] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:43:05.662499 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-29225a21-e66c-4182-9d24-ce8745af7bb5 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:43:05.662939 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-29225a21-e66c-4182-9d24-ce8745af7bb5 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:43:05.664228 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-29225a21-e66c-4182-9d24-ce8745af7bb5 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:43:05.664879 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-29225a21-e66c-4182-9d24-ce8745af7bb5 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:43:05.795720 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-29225a21-e66c-4182-9d24-ce8745af7bb5 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96b599f8890b4281a7e311cf37a039e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d7fcab5d3f465793d650f16c6ea8de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:43:05.803616 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-29225a21-e66c-4182-9d24-ce8745af7bb5 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/bced4f24-572a-4316-97e8-3ceedc61a621" status: 200 len: 1321 microversion: 2.1 time: 0.153008 Oct 27 15:43:05.804904 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 29/83] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:43:05 2021] GET /compute/v2.1/servers/bced4f24-572a-4316-97e8-3ceedc61a621 => generated 1321 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 15:43:05.876532 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [req-9b41e342-3f9e-41d6-886a-7091be6860c9 req-4d618bcc-60b4-4d3b-9dbf-8c276cb95b56 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "62c89161-c119-48b2-839d-712db798ff96", "tag": "f24ff64f-4146-482c-b9d5-4ee7e53b36d2"}]} {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 15:43:05.878718 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 27 15:43:05.878718 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: warnings.warn(msg) Oct 27 15:43:05.890176 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [req-9b41e342-3f9e-41d6-886a-7091be6860c9 req-4d618bcc-60b4-4d3b-9dbf-8c276cb95b56 service nova] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:43:05.890662 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [req-9b41e342-3f9e-41d6-886a-7091be6860c9 req-4d618bcc-60b4-4d3b-9dbf-8c276cb95b56 service nova] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:43:05.902703 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.compute.server_external_events [req-9b41e342-3f9e-41d6-886a-7091be6860c9 req-4d618bcc-60b4-4d3b-9dbf-8c276cb95b56 service nova] Creating event network-changed:f24ff64f-4146-482c-b9d5-4ee7e53b36d2 for instance 62c89161-c119-48b2-839d-712db798ff96 on hv-cinder-80070 Oct 27 15:43:05.908143 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [req-9b41e342-3f9e-41d6-886a-7091be6860c9 req-4d618bcc-60b4-4d3b-9dbf-8c276cb95b56 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035411 Oct 27 15:43:05.908995 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 55/84] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Oct 27 15:43:05 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 15:43:06.184184 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-c7a63f3c-ed60-45ba-bb3d-c7ef043f47fd tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:43:06.184822 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-c7a63f3c-ed60-45ba-bb3d-c7ef043f47fd tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:43:06.194229 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-c7a63f3c-ed60-45ba-bb3d-c7ef043f47fd tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:43:06.194678 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-c7a63f3c-ed60-45ba-bb3d-c7ef043f47fd tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:43:06.195693 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-c7a63f3c-ed60-45ba-bb3d-c7ef043f47fd tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:43:06.196267 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-c7a63f3c-ed60-45ba-bb3d-c7ef043f47fd tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:43:06.389153 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-40a60a62-beec-4fdc-a4a1-47ae50ff9204 tempest-DeleteServersTestJSON-752571955 tempest-DeleteServersTestJSON-752571955-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:43:06.390255 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-40a60a62-beec-4fdc-a4a1-47ae50ff9204 tempest-DeleteServersTestJSON-752571955 tempest-DeleteServersTestJSON-752571955-project] [instance: 6cc17348-b41d-46ba-a1d6-9f80614b7596] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:43:06.406811 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-40a60a62-beec-4fdc-a4a1-47ae50ff9204 tempest-DeleteServersTestJSON-752571955 tempest-DeleteServersTestJSON-752571955-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:43:06.409260 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-40a60a62-beec-4fdc-a4a1-47ae50ff9204 tempest-DeleteServersTestJSON-752571955 tempest-DeleteServersTestJSON-752571955-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:43:06.411640 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-40a60a62-beec-4fdc-a4a1-47ae50ff9204 tempest-DeleteServersTestJSON-752571955 tempest-DeleteServersTestJSON-752571955-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:43:06.412912 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-40a60a62-beec-4fdc-a4a1-47ae50ff9204 tempest-DeleteServersTestJSON-752571955 tempest-DeleteServersTestJSON-752571955-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:43:06.690684 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-40a60a62-beec-4fdc-a4a1-47ae50ff9204 tempest-DeleteServersTestJSON-752571955 tempest-DeleteServersTestJSON-752571955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf1a0e4ab3ab4008a25339e4eda7a48d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be9d7084d7ab4e408be53dd27f8748a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:43:06.702464 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-40a60a62-beec-4fdc-a4a1-47ae50ff9204 tempest-DeleteServersTestJSON-752571955 tempest-DeleteServersTestJSON-752571955-project] 10.222.0.64 "GET /compute/v2.1/servers/6cc17348-b41d-46ba-a1d6-9f80614b7596" status: 200 len: 1315 microversion: 2.1 time: 0.333474 Oct 27 15:43:06.703266 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 56/85] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:43:06 2021] GET /compute/v2.1/servers/6cc17348-b41d-46ba-a1d6-9f80614b7596 => generated 1315 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 15:43:06.708428 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-84521231-fe8c-4727-8983-8f5adfdac246 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:43:06.709019 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-84521231-fe8c-4727-8983-8f5adfdac246 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] [instance: a4e225e4-7815-4f6a-b1e6-53edab3c1abd] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:43:06.716357 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-84521231-fe8c-4727-8983-8f5adfdac246 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:43:06.716960 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-84521231-fe8c-4727-8983-8f5adfdac246 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:43:06.718016 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-84521231-fe8c-4727-8983-8f5adfdac246 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:43:06.718633 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-84521231-fe8c-4727-8983-8f5adfdac246 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:43:06.729482 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-c7a63f3c-ed60-45ba-bb3d-c7ef043f47fd tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:43:06.743325 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-c7a63f3c-ed60-45ba-bb3d-c7ef043f47fd tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:43:06.748117 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-c7a63f3c-ed60-45ba-bb3d-c7ef043f47fd tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:43:06.751927 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-c7a63f3c-ed60-45ba-bb3d-c7ef043f47fd tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672" status: 200 len: 1408 microversion: 2.20 time: 0.571918 Oct 27 15:43:06.753294 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 30/86] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Oct 27 15:43:06 2021] GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672 => generated 1408 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 15:43:06.821054 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-9413c149-ab05-46aa-b3e9-3d286ef4b0e1 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:43:06.822088 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-9413c149-ab05-46aa-b3e9-3d286ef4b0e1 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: bced4f24-572a-4316-97e8-3ceedc61a621] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:43:06.829083 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-9413c149-ab05-46aa-b3e9-3d286ef4b0e1 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:43:06.829811 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-9413c149-ab05-46aa-b3e9-3d286ef4b0e1 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:43:06.832105 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-9413c149-ab05-46aa-b3e9-3d286ef4b0e1 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:43:06.833317 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-9413c149-ab05-46aa-b3e9-3d286ef4b0e1 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:43:06.866182 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-84521231-fe8c-4727-8983-8f5adfdac246 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0abe23cb5f314bc883ef7958b0ed9b5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fc48df471f247809d82ddf926bfdc6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:43:06.882007 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-84521231-fe8c-4727-8983-8f5adfdac246 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] 10.222.0.64 "GET /compute/v2.1/servers/a4e225e4-7815-4f6a-b1e6-53edab3c1abd" status: 200 len: 1317 microversion: 2.1 time: 0.177041 Oct 27 15:43:06.891886 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 57/87] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:43:06 2021] GET /compute/v2.1/servers/a4e225e4-7815-4f6a-b1e6-53edab3c1abd => generated 1317 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 15:43:07.054315 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-9413c149-ab05-46aa-b3e9-3d286ef4b0e1 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96b599f8890b4281a7e311cf37a039e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d7fcab5d3f465793d650f16c6ea8de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:43:07.062686 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-9413c149-ab05-46aa-b3e9-3d286ef4b0e1 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/bced4f24-572a-4316-97e8-3ceedc61a621" status: 200 len: 1321 microversion: 2.1 time: 0.244473 Oct 27 15:43:07.063731 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 31/88] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:43:06 2021] GET /compute/v2.1/servers/bced4f24-572a-4316-97e8-3ceedc61a621 => generated 1321 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 15:43:07.719047 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-54b17018-b43e-4a0a-8608-bbfaf3fbd4bd tempest-DeleteServersTestJSON-752571955 tempest-DeleteServersTestJSON-752571955-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:43:07.719905 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-54b17018-b43e-4a0a-8608-bbfaf3fbd4bd tempest-DeleteServersTestJSON-752571955 tempest-DeleteServersTestJSON-752571955-project] [instance: 6cc17348-b41d-46ba-a1d6-9f80614b7596] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:43:07.728426 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-54b17018-b43e-4a0a-8608-bbfaf3fbd4bd tempest-DeleteServersTestJSON-752571955 tempest-DeleteServersTestJSON-752571955-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:43:07.729344 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-54b17018-b43e-4a0a-8608-bbfaf3fbd4bd tempest-DeleteServersTestJSON-752571955 tempest-DeleteServersTestJSON-752571955-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:43:07.730332 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-54b17018-b43e-4a0a-8608-bbfaf3fbd4bd tempest-DeleteServersTestJSON-752571955 tempest-DeleteServersTestJSON-752571955-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:43:07.730914 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-54b17018-b43e-4a0a-8608-bbfaf3fbd4bd tempest-DeleteServersTestJSON-752571955 tempest-DeleteServersTestJSON-752571955-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:43:07.771030 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-16f158cf-5bd5-40a1-ab6d-e48dd4e70bd0 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:43:07.771633 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-16f158cf-5bd5-40a1-ab6d-e48dd4e70bd0 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:43:07.778716 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-16f158cf-5bd5-40a1-ab6d-e48dd4e70bd0 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:43:07.779359 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-16f158cf-5bd5-40a1-ab6d-e48dd4e70bd0 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:43:07.780305 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-16f158cf-5bd5-40a1-ab6d-e48dd4e70bd0 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:43:07.780877 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-16f158cf-5bd5-40a1-ab6d-e48dd4e70bd0 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:43:07.887446 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-54b17018-b43e-4a0a-8608-bbfaf3fbd4bd tempest-DeleteServersTestJSON-752571955 tempest-DeleteServersTestJSON-752571955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf1a0e4ab3ab4008a25339e4eda7a48d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be9d7084d7ab4e408be53dd27f8748a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:43:07.896648 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-54b17018-b43e-4a0a-8608-bbfaf3fbd4bd tempest-DeleteServersTestJSON-752571955 tempest-DeleteServersTestJSON-752571955-project] 10.222.0.64 "GET /compute/v2.1/servers/6cc17348-b41d-46ba-a1d6-9f80614b7596" status: 200 len: 1315 microversion: 2.1 time: 0.181689 Oct 27 15:43:07.897381 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 58/89] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:43:07 2021] GET /compute/v2.1/servers/6cc17348-b41d-46ba-a1d6-9f80614b7596 => generated 1315 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 15:43:07.906415 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-def5bd5b-2654-45fa-b2ac-01165abf03db tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:43:07.907029 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-def5bd5b-2654-45fa-b2ac-01165abf03db tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] [instance: a4e225e4-7815-4f6a-b1e6-53edab3c1abd] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:43:07.915717 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-def5bd5b-2654-45fa-b2ac-01165abf03db tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:43:07.916229 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-def5bd5b-2654-45fa-b2ac-01165abf03db tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:43:07.917137 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-def5bd5b-2654-45fa-b2ac-01165abf03db tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:43:07.917578 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-def5bd5b-2654-45fa-b2ac-01165abf03db tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:43:07.945702 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-16f158cf-5bd5-40a1-ab6d-e48dd4e70bd0 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:43:07.954598 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-16f158cf-5bd5-40a1-ab6d-e48dd4e70bd0 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:43:07.958196 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-16f158cf-5bd5-40a1-ab6d-e48dd4e70bd0 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:43:07.959391 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-16f158cf-5bd5-40a1-ab6d-e48dd4e70bd0 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672" status: 200 len: 1408 microversion: 2.20 time: 0.192780 Oct 27 15:43:07.972070 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 32/90] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Oct 27 15:43:07 2021] GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672 => generated 1408 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 15:43:08.055672 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-def5bd5b-2654-45fa-b2ac-01165abf03db tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0abe23cb5f314bc883ef7958b0ed9b5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fc48df471f247809d82ddf926bfdc6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:43:08.063934 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-def5bd5b-2654-45fa-b2ac-01165abf03db tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] 10.222.0.64 "GET /compute/v2.1/servers/a4e225e4-7815-4f6a-b1e6-53edab3c1abd" status: 200 len: 1317 microversion: 2.1 time: 0.162540 Oct 27 15:43:08.064549 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 59/91] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:43:07 2021] GET /compute/v2.1/servers/a4e225e4-7815-4f6a-b1e6-53edab3c1abd => generated 1317 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 15:43:08.080504 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-91412d9a-e2a9-494e-908e-c440a1f33806 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:43:08.081189 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-91412d9a-e2a9-494e-908e-c440a1f33806 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: bced4f24-572a-4316-97e8-3ceedc61a621] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:43:08.087560 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-91412d9a-e2a9-494e-908e-c440a1f33806 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:43:08.088243 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-91412d9a-e2a9-494e-908e-c440a1f33806 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:43:08.089048 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-91412d9a-e2a9-494e-908e-c440a1f33806 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:43:08.089445 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-91412d9a-e2a9-494e-908e-c440a1f33806 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:43:08.224734 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-91412d9a-e2a9-494e-908e-c440a1f33806 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96b599f8890b4281a7e311cf37a039e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d7fcab5d3f465793d650f16c6ea8de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:43:08.232566 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-91412d9a-e2a9-494e-908e-c440a1f33806 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/bced4f24-572a-4316-97e8-3ceedc61a621" status: 200 len: 1321 microversion: 2.1 time: 0.155960 Oct 27 15:43:08.235908 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 33/92] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:43:08 2021] GET /compute/v2.1/servers/bced4f24-572a-4316-97e8-3ceedc61a621 => generated 1321 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 15:43:08.913961 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-575a60d1-6190-46b6-8a8e-8711a732f0cf tempest-DeleteServersTestJSON-752571955 tempest-DeleteServersTestJSON-752571955-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:43:08.915226 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-575a60d1-6190-46b6-8a8e-8711a732f0cf tempest-DeleteServersTestJSON-752571955 tempest-DeleteServersTestJSON-752571955-project] [instance: 6cc17348-b41d-46ba-a1d6-9f80614b7596] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:43:08.923673 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-575a60d1-6190-46b6-8a8e-8711a732f0cf tempest-DeleteServersTestJSON-752571955 tempest-DeleteServersTestJSON-752571955-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:43:08.924848 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-575a60d1-6190-46b6-8a8e-8711a732f0cf tempest-DeleteServersTestJSON-752571955 tempest-DeleteServersTestJSON-752571955-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:43:08.925707 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-575a60d1-6190-46b6-8a8e-8711a732f0cf tempest-DeleteServersTestJSON-752571955 tempest-DeleteServersTestJSON-752571955-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:43:08.926561 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-575a60d1-6190-46b6-8a8e-8711a732f0cf tempest-DeleteServersTestJSON-752571955 tempest-DeleteServersTestJSON-752571955-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:43:08.978887 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-8595e968-585b-4b20-8314-1fa673017e54 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:43:08.979503 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-8595e968-585b-4b20-8314-1fa673017e54 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:43:08.985393 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-8595e968-585b-4b20-8314-1fa673017e54 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:43:08.986051 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-8595e968-585b-4b20-8314-1fa673017e54 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:43:08.987622 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-8595e968-585b-4b20-8314-1fa673017e54 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:43:08.988134 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-8595e968-585b-4b20-8314-1fa673017e54 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:43:09.052284 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-575a60d1-6190-46b6-8a8e-8711a732f0cf tempest-DeleteServersTestJSON-752571955 tempest-DeleteServersTestJSON-752571955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf1a0e4ab3ab4008a25339e4eda7a48d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be9d7084d7ab4e408be53dd27f8748a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:43:09.059572 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-575a60d1-6190-46b6-8a8e-8711a732f0cf tempest-DeleteServersTestJSON-752571955 tempest-DeleteServersTestJSON-752571955-project] 10.222.0.64 "GET /compute/v2.1/servers/6cc17348-b41d-46ba-a1d6-9f80614b7596" status: 200 len: 1315 microversion: 2.1 time: 0.149210 Oct 27 15:43:09.060184 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 60/93] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:43:08 2021] GET /compute/v2.1/servers/6cc17348-b41d-46ba-a1d6-9f80614b7596 => generated 1315 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 15:43:09.081032 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-f4ffbe85-e3a1-40a5-b470-c45e7e7e5766 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:43:09.081791 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-f4ffbe85-e3a1-40a5-b470-c45e7e7e5766 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] [instance: a4e225e4-7815-4f6a-b1e6-53edab3c1abd] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:43:09.088934 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-f4ffbe85-e3a1-40a5-b470-c45e7e7e5766 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:43:09.089438 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-f4ffbe85-e3a1-40a5-b470-c45e7e7e5766 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:43:09.090467 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-f4ffbe85-e3a1-40a5-b470-c45e7e7e5766 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:43:09.091172 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-f4ffbe85-e3a1-40a5-b470-c45e7e7e5766 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:43:09.123530 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-8595e968-585b-4b20-8314-1fa673017e54 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:43:09.132464 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-8595e968-585b-4b20-8314-1fa673017e54 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:43:09.133980 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-8595e968-585b-4b20-8314-1fa673017e54 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:43:09.135096 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-8595e968-585b-4b20-8314-1fa673017e54 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672" status: 200 len: 1408 microversion: 2.20 time: 0.160312 Oct 27 15:43:09.135665 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 34/94] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Oct 27 15:43:08 2021] GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672 => generated 1408 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 15:43:09.218840 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-f4ffbe85-e3a1-40a5-b470-c45e7e7e5766 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0abe23cb5f314bc883ef7958b0ed9b5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fc48df471f247809d82ddf926bfdc6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:43:09.226370 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-f4ffbe85-e3a1-40a5-b470-c45e7e7e5766 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] 10.222.0.64 "GET /compute/v2.1/servers/a4e225e4-7815-4f6a-b1e6-53edab3c1abd" status: 200 len: 1317 microversion: 2.1 time: 0.149880 Oct 27 15:43:09.226943 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 61/95] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:43:09 2021] GET /compute/v2.1/servers/a4e225e4-7815-4f6a-b1e6-53edab3c1abd => generated 1317 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 15:43:09.249186 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-ecb0379a-6180-4d79-82f0-75a5bc7e9218 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:43:09.249825 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-ecb0379a-6180-4d79-82f0-75a5bc7e9218 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: bced4f24-572a-4316-97e8-3ceedc61a621] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:43:09.256395 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-ecb0379a-6180-4d79-82f0-75a5bc7e9218 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:43:09.256837 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-ecb0379a-6180-4d79-82f0-75a5bc7e9218 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:43:09.257597 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-ecb0379a-6180-4d79-82f0-75a5bc7e9218 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:43:09.258032 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-ecb0379a-6180-4d79-82f0-75a5bc7e9218 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:43:09.584151 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-ecb0379a-6180-4d79-82f0-75a5bc7e9218 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96b599f8890b4281a7e311cf37a039e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d7fcab5d3f465793d650f16c6ea8de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:43:09.594805 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-ecb0379a-6180-4d79-82f0-75a5bc7e9218 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/bced4f24-572a-4316-97e8-3ceedc61a621" status: 200 len: 1321 microversion: 2.1 time: 0.349058 Oct 27 15:43:09.596754 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 35/96] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:43:09 2021] GET /compute/v2.1/servers/bced4f24-572a-4316-97e8-3ceedc61a621 => generated 1321 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 15:43:10.078056 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-dadcc3dd-3dc9-4b29-8f7b-766a5dd1d3ca tempest-DeleteServersTestJSON-752571955 tempest-DeleteServersTestJSON-752571955-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:43:10.080678 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-dadcc3dd-3dc9-4b29-8f7b-766a5dd1d3ca tempest-DeleteServersTestJSON-752571955 tempest-DeleteServersTestJSON-752571955-project] [instance: 6cc17348-b41d-46ba-a1d6-9f80614b7596] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:43:10.091875 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-dadcc3dd-3dc9-4b29-8f7b-766a5dd1d3ca tempest-DeleteServersTestJSON-752571955 tempest-DeleteServersTestJSON-752571955-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:43:10.092973 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-dadcc3dd-3dc9-4b29-8f7b-766a5dd1d3ca tempest-DeleteServersTestJSON-752571955 tempest-DeleteServersTestJSON-752571955-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:43:10.094870 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-dadcc3dd-3dc9-4b29-8f7b-766a5dd1d3ca tempest-DeleteServersTestJSON-752571955 tempest-DeleteServersTestJSON-752571955-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:43:10.099745 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-dadcc3dd-3dc9-4b29-8f7b-766a5dd1d3ca tempest-DeleteServersTestJSON-752571955 tempest-DeleteServersTestJSON-752571955-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:43:10.153589 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-3179ff45-a136-45ff-a6ea-3b2562693c6e tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:43:10.157178 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-3179ff45-a136-45ff-a6ea-3b2562693c6e tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:43:10.179218 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-3179ff45-a136-45ff-a6ea-3b2562693c6e tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:43:10.181658 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-3179ff45-a136-45ff-a6ea-3b2562693c6e tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:43:10.183376 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-3179ff45-a136-45ff-a6ea-3b2562693c6e tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:43:10.184454 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-3179ff45-a136-45ff-a6ea-3b2562693c6e tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:43:10.520622 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-dadcc3dd-3dc9-4b29-8f7b-766a5dd1d3ca tempest-DeleteServersTestJSON-752571955 tempest-DeleteServersTestJSON-752571955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf1a0e4ab3ab4008a25339e4eda7a48d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be9d7084d7ab4e408be53dd27f8748a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:43:10.533750 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-dadcc3dd-3dc9-4b29-8f7b-766a5dd1d3ca tempest-DeleteServersTestJSON-752571955 tempest-DeleteServersTestJSON-752571955-project] 10.222.0.64 "GET /compute/v2.1/servers/6cc17348-b41d-46ba-a1d6-9f80614b7596" status: 200 len: 1315 microversion: 2.1 time: 0.460152 Oct 27 15:43:10.538810 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 62/97] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:43:10 2021] GET /compute/v2.1/servers/6cc17348-b41d-46ba-a1d6-9f80614b7596 => generated 1315 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 15:43:10.552550 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-b4e8cd39-5fc6-43ce-9664-20f73e78f2e4 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:43:10.553531 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-b4e8cd39-5fc6-43ce-9664-20f73e78f2e4 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] [instance: a4e225e4-7815-4f6a-b1e6-53edab3c1abd] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:43:10.574160 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-b4e8cd39-5fc6-43ce-9664-20f73e78f2e4 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:43:10.577087 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-b4e8cd39-5fc6-43ce-9664-20f73e78f2e4 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:43:10.580729 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-b4e8cd39-5fc6-43ce-9664-20f73e78f2e4 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:43:10.581825 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-b4e8cd39-5fc6-43ce-9664-20f73e78f2e4 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:43:10.892107 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-b4e8cd39-5fc6-43ce-9664-20f73e78f2e4 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0abe23cb5f314bc883ef7958b0ed9b5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fc48df471f247809d82ddf926bfdc6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:43:10.904235 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-b4e8cd39-5fc6-43ce-9664-20f73e78f2e4 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] 10.222.0.64 "GET /compute/v2.1/servers/a4e225e4-7815-4f6a-b1e6-53edab3c1abd" status: 200 len: 1317 microversion: 2.1 time: 0.361806 Oct 27 15:43:10.915784 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 63/98] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:43:10 2021] GET /compute/v2.1/servers/a4e225e4-7815-4f6a-b1e6-53edab3c1abd => generated 1317 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 15:43:10.924647 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-0849c95c-d19a-42c7-ba72-4e15bd7c113f tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:43:10.925439 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-0849c95c-d19a-42c7-ba72-4e15bd7c113f tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: bced4f24-572a-4316-97e8-3ceedc61a621] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:43:10.932422 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-0849c95c-d19a-42c7-ba72-4e15bd7c113f tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:43:10.933133 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-0849c95c-d19a-42c7-ba72-4e15bd7c113f tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:43:10.934082 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-0849c95c-d19a-42c7-ba72-4e15bd7c113f tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:43:10.934836 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-0849c95c-d19a-42c7-ba72-4e15bd7c113f tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:43:11.031470 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-3179ff45-a136-45ff-a6ea-3b2562693c6e tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:43:11.041299 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-3179ff45-a136-45ff-a6ea-3b2562693c6e tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:43:11.043056 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-3179ff45-a136-45ff-a6ea-3b2562693c6e tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:43:11.044476 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-3179ff45-a136-45ff-a6ea-3b2562693c6e tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672" status: 200 len: 1408 microversion: 2.20 time: 0.894772 Oct 27 15:43:11.057486 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 36/99] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Oct 27 15:43:10 2021] GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672 => generated 1408 bytes in 908 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 15:43:11.219019 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-0849c95c-d19a-42c7-ba72-4e15bd7c113f tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96b599f8890b4281a7e311cf37a039e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d7fcab5d3f465793d650f16c6ea8de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:43:11.228642 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-0849c95c-d19a-42c7-ba72-4e15bd7c113f tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/bced4f24-572a-4316-97e8-3ceedc61a621" status: 200 len: 1321 microversion: 2.1 time: 0.311367 Oct 27 15:43:11.229217 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 64/100] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:43:10 2021] GET /compute/v2.1/servers/bced4f24-572a-4316-97e8-3ceedc61a621 => generated 1321 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 15:43:11.554775 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-78cb0dce-46d2-4397-8bec-fa1a06935829 tempest-DeleteServersTestJSON-752571955 tempest-DeleteServersTestJSON-752571955-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:43:11.555750 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-78cb0dce-46d2-4397-8bec-fa1a06935829 tempest-DeleteServersTestJSON-752571955 tempest-DeleteServersTestJSON-752571955-project] [instance: 6cc17348-b41d-46ba-a1d6-9f80614b7596] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:43:11.561482 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-78cb0dce-46d2-4397-8bec-fa1a06935829 tempest-DeleteServersTestJSON-752571955 tempest-DeleteServersTestJSON-752571955-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:43:11.561923 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-78cb0dce-46d2-4397-8bec-fa1a06935829 tempest-DeleteServersTestJSON-752571955 tempest-DeleteServersTestJSON-752571955-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:43:11.562682 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-78cb0dce-46d2-4397-8bec-fa1a06935829 tempest-DeleteServersTestJSON-752571955 tempest-DeleteServersTestJSON-752571955-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:43:11.563106 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-78cb0dce-46d2-4397-8bec-fa1a06935829 tempest-DeleteServersTestJSON-752571955 tempest-DeleteServersTestJSON-752571955-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:43:11.748788 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-78cb0dce-46d2-4397-8bec-fa1a06935829 tempest-DeleteServersTestJSON-752571955 tempest-DeleteServersTestJSON-752571955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf1a0e4ab3ab4008a25339e4eda7a48d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be9d7084d7ab4e408be53dd27f8748a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:43:11.756712 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-78cb0dce-46d2-4397-8bec-fa1a06935829 tempest-DeleteServersTestJSON-752571955 tempest-DeleteServersTestJSON-752571955-project] 10.222.0.64 "GET /compute/v2.1/servers/6cc17348-b41d-46ba-a1d6-9f80614b7596" status: 200 len: 1315 microversion: 2.1 time: 0.205562 Oct 27 15:43:11.765997 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 37/101] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:43:11 2021] GET /compute/v2.1/servers/6cc17348-b41d-46ba-a1d6-9f80614b7596 => generated 1315 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 15:43:11.923312 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-e351a4e4-c423-483b-ba0b-4374a8b4cf36 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:43:11.924026 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-e351a4e4-c423-483b-ba0b-4374a8b4cf36 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] [instance: a4e225e4-7815-4f6a-b1e6-53edab3c1abd] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:43:11.933729 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-e351a4e4-c423-483b-ba0b-4374a8b4cf36 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:43:11.934888 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-e351a4e4-c423-483b-ba0b-4374a8b4cf36 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:43:11.942161 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-e351a4e4-c423-483b-ba0b-4374a8b4cf36 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:43:11.942906 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-e351a4e4-c423-483b-ba0b-4374a8b4cf36 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:43:12.062210 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-1d1fbeba-49d0-4503-9957-0a44be436f5e tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:43:12.062814 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-1d1fbeba-49d0-4503-9957-0a44be436f5e tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:43:12.072067 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-1d1fbeba-49d0-4503-9957-0a44be436f5e tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:43:12.072516 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-1d1fbeba-49d0-4503-9957-0a44be436f5e tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:43:12.076984 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-1d1fbeba-49d0-4503-9957-0a44be436f5e tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:43:12.077481 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-1d1fbeba-49d0-4503-9957-0a44be436f5e tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:43:12.106204 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-e351a4e4-c423-483b-ba0b-4374a8b4cf36 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0abe23cb5f314bc883ef7958b0ed9b5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fc48df471f247809d82ddf926bfdc6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:43:12.117220 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-e351a4e4-c423-483b-ba0b-4374a8b4cf36 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] 10.222.0.64 "GET /compute/v2.1/servers/a4e225e4-7815-4f6a-b1e6-53edab3c1abd" status: 200 len: 1317 microversion: 2.1 time: 0.196873 Oct 27 15:43:12.118268 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 65/102] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:43:11 2021] GET /compute/v2.1/servers/a4e225e4-7815-4f6a-b1e6-53edab3c1abd => generated 1317 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 15:43:12.246855 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-a6d89808-e74f-4bed-93d9-0b0b53cd9f6e tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:43:12.247492 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-a6d89808-e74f-4bed-93d9-0b0b53cd9f6e tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: bced4f24-572a-4316-97e8-3ceedc61a621] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:43:12.264218 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-a6d89808-e74f-4bed-93d9-0b0b53cd9f6e tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:43:12.264674 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-a6d89808-e74f-4bed-93d9-0b0b53cd9f6e tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:43:12.265551 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-a6d89808-e74f-4bed-93d9-0b0b53cd9f6e tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:43:12.265979 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-a6d89808-e74f-4bed-93d9-0b0b53cd9f6e tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:43:12.351681 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-1d1fbeba-49d0-4503-9957-0a44be436f5e tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:43:12.368525 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-1d1fbeba-49d0-4503-9957-0a44be436f5e tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:43:12.371697 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-1d1fbeba-49d0-4503-9957-0a44be436f5e tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:43:12.377660 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-1d1fbeba-49d0-4503-9957-0a44be436f5e tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672" status: 200 len: 1408 microversion: 2.20 time: 0.317021 Oct 27 15:43:12.380948 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 38/103] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Oct 27 15:43:12 2021] GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672 => generated 1408 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 15:43:12.773908 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-5b1f3c43-2f23-4995-a3bf-9cf23acb2fe3 tempest-DeleteServersTestJSON-752571955 tempest-DeleteServersTestJSON-752571955-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:43:12.774748 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-5b1f3c43-2f23-4995-a3bf-9cf23acb2fe3 tempest-DeleteServersTestJSON-752571955 tempest-DeleteServersTestJSON-752571955-project] [instance: 6cc17348-b41d-46ba-a1d6-9f80614b7596] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:43:12.784511 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-5b1f3c43-2f23-4995-a3bf-9cf23acb2fe3 tempest-DeleteServersTestJSON-752571955 tempest-DeleteServersTestJSON-752571955-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:43:12.794409 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-5b1f3c43-2f23-4995-a3bf-9cf23acb2fe3 tempest-DeleteServersTestJSON-752571955 tempest-DeleteServersTestJSON-752571955-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:43:12.799216 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-5b1f3c43-2f23-4995-a3bf-9cf23acb2fe3 tempest-DeleteServersTestJSON-752571955 tempest-DeleteServersTestJSON-752571955-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:43:12.799829 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-5b1f3c43-2f23-4995-a3bf-9cf23acb2fe3 tempest-DeleteServersTestJSON-752571955 tempest-DeleteServersTestJSON-752571955-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:43:12.803349 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-a6d89808-e74f-4bed-93d9-0b0b53cd9f6e tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96b599f8890b4281a7e311cf37a039e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d7fcab5d3f465793d650f16c6ea8de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:43:12.813814 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-a6d89808-e74f-4bed-93d9-0b0b53cd9f6e tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/bced4f24-572a-4316-97e8-3ceedc61a621" status: 200 len: 1321 microversion: 2.1 time: 0.570471 Oct 27 15:43:12.815803 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 66/104] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:43:12 2021] GET /compute/v2.1/servers/bced4f24-572a-4316-97e8-3ceedc61a621 => generated 1321 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 15:43:13.060975 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-5b1f3c43-2f23-4995-a3bf-9cf23acb2fe3 tempest-DeleteServersTestJSON-752571955 tempest-DeleteServersTestJSON-752571955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf1a0e4ab3ab4008a25339e4eda7a48d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be9d7084d7ab4e408be53dd27f8748a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:43:13.076996 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-5b1f3c43-2f23-4995-a3bf-9cf23acb2fe3 tempest-DeleteServersTestJSON-752571955 tempest-DeleteServersTestJSON-752571955-project] 10.222.0.64 "GET /compute/v2.1/servers/6cc17348-b41d-46ba-a1d6-9f80614b7596" status: 200 len: 1315 microversion: 2.1 time: 0.306763 Oct 27 15:43:13.088959 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [req-423d5430-9bfb-45a1-b449-0c9b078cc7d6 req-22270677-9055-4d73-aaca-3f22d2f21c75 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6cc17348-b41d-46ba-a1d6-9f80614b7596", "name": "network-vif-plugged", "status": "completed", "tag": "e85edc27-86b1-4171-baec-a08e7231cb2d"}]} {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 15:43:13.091296 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 39/105] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:43:12 2021] GET /compute/v2.1/servers/6cc17348-b41d-46ba-a1d6-9f80614b7596 => generated 1315 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 15:43:13.093171 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 27 15:43:13.093171 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: warnings.warn(msg) Oct 27 15:43:13.112551 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [req-423d5430-9bfb-45a1-b449-0c9b078cc7d6 req-22270677-9055-4d73-aaca-3f22d2f21c75 service nova] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:43:13.113157 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [req-423d5430-9bfb-45a1-b449-0c9b078cc7d6 req-22270677-9055-4d73-aaca-3f22d2f21c75 service nova] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:43:13.135044 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.compute.server_external_events [req-423d5430-9bfb-45a1-b449-0c9b078cc7d6 req-22270677-9055-4d73-aaca-3f22d2f21c75 service nova] Creating event network-vif-plugged:e85edc27-86b1-4171-baec-a08e7231cb2d for instance 6cc17348-b41d-46ba-a1d6-9f80614b7596 on hv-cinder-80070 Oct 27 15:43:13.137841 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-7dfae836-e970-45a3-b31a-7ca9c09cc4f3 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:43:13.138564 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-7dfae836-e970-45a3-b31a-7ca9c09cc4f3 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] [instance: a4e225e4-7815-4f6a-b1e6-53edab3c1abd] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:43:13.143927 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [req-423d5430-9bfb-45a1-b449-0c9b078cc7d6 req-22270677-9055-4d73-aaca-3f22d2f21c75 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.263221 Oct 27 15:43:13.147413 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 67/106] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Oct 27 15:43:12 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 15:43:13.150377 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-7dfae836-e970-45a3-b31a-7ca9c09cc4f3 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:43:13.151050 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-7dfae836-e970-45a3-b31a-7ca9c09cc4f3 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:43:13.154198 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-7dfae836-e970-45a3-b31a-7ca9c09cc4f3 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:43:13.154656 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-7dfae836-e970-45a3-b31a-7ca9c09cc4f3 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:43:13.313838 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-7dfae836-e970-45a3-b31a-7ca9c09cc4f3 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0abe23cb5f314bc883ef7958b0ed9b5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fc48df471f247809d82ddf926bfdc6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:43:13.323799 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-7dfae836-e970-45a3-b31a-7ca9c09cc4f3 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] 10.222.0.64 "GET /compute/v2.1/servers/a4e225e4-7815-4f6a-b1e6-53edab3c1abd" status: 200 len: 1317 microversion: 2.1 time: 0.193011 Oct 27 15:43:13.324482 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 40/107] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:43:13 2021] GET /compute/v2.1/servers/a4e225e4-7815-4f6a-b1e6-53edab3c1abd => generated 1317 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 15:43:13.399164 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-4f142961-6be4-427f-9191-47d051975386 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:43:13.399875 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-4f142961-6be4-427f-9191-47d051975386 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:43:13.410477 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-4f142961-6be4-427f-9191-47d051975386 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:43:13.411753 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-4f142961-6be4-427f-9191-47d051975386 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:43:13.413059 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-4f142961-6be4-427f-9191-47d051975386 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:43:13.413970 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-4f142961-6be4-427f-9191-47d051975386 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:43:13.557328 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-4f142961-6be4-427f-9191-47d051975386 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:43:13.566619 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-4f142961-6be4-427f-9191-47d051975386 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:43:13.568173 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-4f142961-6be4-427f-9191-47d051975386 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:43:13.569359 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-4f142961-6be4-427f-9191-47d051975386 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672" status: 200 len: 1408 microversion: 2.20 time: 0.174450 Oct 27 15:43:13.569923 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 68/108] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Oct 27 15:43:13 2021] GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672 => generated 1408 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 15:43:13.835513 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-19fc9786-0fc4-4eff-b266-026c1044b444 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:43:13.836245 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-19fc9786-0fc4-4eff-b266-026c1044b444 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: bced4f24-572a-4316-97e8-3ceedc61a621] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:43:13.842554 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-19fc9786-0fc4-4eff-b266-026c1044b444 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:43:13.843047 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-19fc9786-0fc4-4eff-b266-026c1044b444 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:43:13.843968 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-19fc9786-0fc4-4eff-b266-026c1044b444 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:43:13.844443 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-19fc9786-0fc4-4eff-b266-026c1044b444 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:43:14.050009 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-19fc9786-0fc4-4eff-b266-026c1044b444 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96b599f8890b4281a7e311cf37a039e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d7fcab5d3f465793d650f16c6ea8de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:43:14.062900 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-19fc9786-0fc4-4eff-b266-026c1044b444 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/bced4f24-572a-4316-97e8-3ceedc61a621" status: 200 len: 1321 microversion: 2.1 time: 0.231164 Oct 27 15:43:14.068583 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 41/109] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:43:13 2021] GET /compute/v2.1/servers/bced4f24-572a-4316-97e8-3ceedc61a621 => generated 1321 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 15:43:14.104131 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-a75e8efb-6006-4c59-9c52-caf8339a176f tempest-DeleteServersTestJSON-752571955 tempest-DeleteServersTestJSON-752571955-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:43:14.104658 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-a75e8efb-6006-4c59-9c52-caf8339a176f tempest-DeleteServersTestJSON-752571955 tempest-DeleteServersTestJSON-752571955-project] [instance: 6cc17348-b41d-46ba-a1d6-9f80614b7596] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:43:14.121334 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-a75e8efb-6006-4c59-9c52-caf8339a176f tempest-DeleteServersTestJSON-752571955 tempest-DeleteServersTestJSON-752571955-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:43:14.122925 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-a75e8efb-6006-4c59-9c52-caf8339a176f tempest-DeleteServersTestJSON-752571955 tempest-DeleteServersTestJSON-752571955-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:43:14.125003 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-a75e8efb-6006-4c59-9c52-caf8339a176f tempest-DeleteServersTestJSON-752571955 tempest-DeleteServersTestJSON-752571955-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:43:14.125632 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-a75e8efb-6006-4c59-9c52-caf8339a176f tempest-DeleteServersTestJSON-752571955 tempest-DeleteServersTestJSON-752571955-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:43:14.335514 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-a75e8efb-6006-4c59-9c52-caf8339a176f tempest-DeleteServersTestJSON-752571955 tempest-DeleteServersTestJSON-752571955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf1a0e4ab3ab4008a25339e4eda7a48d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be9d7084d7ab4e408be53dd27f8748a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:43:14.343920 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-589e85db-e727-47f0-8182-833d17b83a21 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:43:14.344614 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-a75e8efb-6006-4c59-9c52-caf8339a176f tempest-DeleteServersTestJSON-752571955 tempest-DeleteServersTestJSON-752571955-project] 10.222.0.64 "GET /compute/v2.1/servers/6cc17348-b41d-46ba-a1d6-9f80614b7596" status: 200 len: 1315 microversion: 2.1 time: 0.249547 Oct 27 15:43:14.345559 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 69/110] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:43:14 2021] GET /compute/v2.1/servers/6cc17348-b41d-46ba-a1d6-9f80614b7596 => generated 1315 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 15:43:14.347217 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-589e85db-e727-47f0-8182-833d17b83a21 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] [instance: a4e225e4-7815-4f6a-b1e6-53edab3c1abd] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:43:14.354013 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-589e85db-e727-47f0-8182-833d17b83a21 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:43:14.354481 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-589e85db-e727-47f0-8182-833d17b83a21 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:43:14.356230 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-589e85db-e727-47f0-8182-833d17b83a21 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:43:14.357115 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-589e85db-e727-47f0-8182-833d17b83a21 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:43:14.512122 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-589e85db-e727-47f0-8182-833d17b83a21 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0abe23cb5f314bc883ef7958b0ed9b5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fc48df471f247809d82ddf926bfdc6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:43:14.521248 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-589e85db-e727-47f0-8182-833d17b83a21 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] 10.222.0.64 "GET /compute/v2.1/servers/a4e225e4-7815-4f6a-b1e6-53edab3c1abd" status: 200 len: 1317 microversion: 2.1 time: 0.183268 Oct 27 15:43:14.524190 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 42/111] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:43:14 2021] GET /compute/v2.1/servers/a4e225e4-7815-4f6a-b1e6-53edab3c1abd => generated 1317 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 15:43:14.587504 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-494d1751-e304-46c7-8cfa-441855c5147d tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:43:14.588126 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-494d1751-e304-46c7-8cfa-441855c5147d tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:43:14.593988 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-494d1751-e304-46c7-8cfa-441855c5147d tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:43:14.594805 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-494d1751-e304-46c7-8cfa-441855c5147d tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:43:14.595822 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-494d1751-e304-46c7-8cfa-441855c5147d tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:43:14.596420 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-494d1751-e304-46c7-8cfa-441855c5147d tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:43:14.754108 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-494d1751-e304-46c7-8cfa-441855c5147d tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:43:14.763603 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-494d1751-e304-46c7-8cfa-441855c5147d tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:43:14.766027 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-494d1751-e304-46c7-8cfa-441855c5147d tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:43:14.767524 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-494d1751-e304-46c7-8cfa-441855c5147d tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672" status: 200 len: 1408 microversion: 2.20 time: 0.183612 Oct 27 15:43:14.768275 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 70/112] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Oct 27 15:43:14 2021] GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672 => generated 1408 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 15:43:15.076390 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-348d69cd-1403-4247-bab5-7025e7dbcb65 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:43:15.077058 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-348d69cd-1403-4247-bab5-7025e7dbcb65 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: bced4f24-572a-4316-97e8-3ceedc61a621] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:43:15.091967 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-348d69cd-1403-4247-bab5-7025e7dbcb65 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:43:15.092675 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-348d69cd-1403-4247-bab5-7025e7dbcb65 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:43:15.093780 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-348d69cd-1403-4247-bab5-7025e7dbcb65 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:43:15.094215 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-348d69cd-1403-4247-bab5-7025e7dbcb65 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:43:15.170534 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [req-3c06d8c3-19eb-4aed-ab1c-43c9d5e69f80 req-b16fb6ea-6f28-4f05-adc8-364f66e8c7a9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a4e225e4-7815-4f6a-b1e6-53edab3c1abd", "name": "network-vif-plugged", "status": "completed", "tag": "fb349725-2f48-49da-a6bd-4dd4cd255a4f"}, {"server_uuid": "62c89161-c119-48b2-839d-712db798ff96", "name": "network-vif-plugged", "status": "completed", "tag": "f24ff64f-4146-482c-b9d5-4ee7e53b36d2"}]} {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 15:43:15.172559 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 27 15:43:15.172559 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: warnings.warn(msg) Oct 27 15:43:15.191501 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [req-3c06d8c3-19eb-4aed-ab1c-43c9d5e69f80 req-b16fb6ea-6f28-4f05-adc8-364f66e8c7a9 service nova] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:43:15.192295 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [req-3c06d8c3-19eb-4aed-ab1c-43c9d5e69f80 req-b16fb6ea-6f28-4f05-adc8-364f66e8c7a9 service nova] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:43:15.223073 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.compute.server_external_events [req-3c06d8c3-19eb-4aed-ab1c-43c9d5e69f80 req-b16fb6ea-6f28-4f05-adc8-364f66e8c7a9 service nova] Creating event network-vif-plugged:fb349725-2f48-49da-a6bd-4dd4cd255a4f for instance a4e225e4-7815-4f6a-b1e6-53edab3c1abd on hv-cinder-80070 Oct 27 15:43:15.223787 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.compute.server_external_events [req-3c06d8c3-19eb-4aed-ab1c-43c9d5e69f80 req-b16fb6ea-6f28-4f05-adc8-364f66e8c7a9 service nova] Creating event network-vif-plugged:f24ff64f-4146-482c-b9d5-4ee7e53b36d2 for instance 62c89161-c119-48b2-839d-712db798ff96 on hv-cinder-80070 Oct 27 15:43:15.239892 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [req-3c06d8c3-19eb-4aed-ab1c-43c9d5e69f80 req-b16fb6ea-6f28-4f05-adc8-364f66e8c7a9 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.073489 Oct 27 15:43:15.240521 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 71/113] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Oct 27 15:43:15 2021] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 15:43:15.259534 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-348d69cd-1403-4247-bab5-7025e7dbcb65 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96b599f8890b4281a7e311cf37a039e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d7fcab5d3f465793d650f16c6ea8de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:43:15.276549 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-348d69cd-1403-4247-bab5-7025e7dbcb65 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/bced4f24-572a-4316-97e8-3ceedc61a621" status: 200 len: 1321 microversion: 2.1 time: 0.199508 Oct 27 15:43:15.277236 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 43/114] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:43:15 2021] GET /compute/v2.1/servers/bced4f24-572a-4316-97e8-3ceedc61a621 => generated 1321 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 15:43:15.364115 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-2fa2a604-7101-4a46-a661-e12735b47f02 tempest-DeleteServersTestJSON-752571955 tempest-DeleteServersTestJSON-752571955-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:43:15.364802 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-2fa2a604-7101-4a46-a661-e12735b47f02 tempest-DeleteServersTestJSON-752571955 tempest-DeleteServersTestJSON-752571955-project] [instance: 6cc17348-b41d-46ba-a1d6-9f80614b7596] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:43:15.372449 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-2fa2a604-7101-4a46-a661-e12735b47f02 tempest-DeleteServersTestJSON-752571955 tempest-DeleteServersTestJSON-752571955-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:43:15.372889 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-2fa2a604-7101-4a46-a661-e12735b47f02 tempest-DeleteServersTestJSON-752571955 tempest-DeleteServersTestJSON-752571955-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:43:15.383499 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-2fa2a604-7101-4a46-a661-e12735b47f02 tempest-DeleteServersTestJSON-752571955 tempest-DeleteServersTestJSON-752571955-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:43:15.390145 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-2fa2a604-7101-4a46-a661-e12735b47f02 tempest-DeleteServersTestJSON-752571955 tempest-DeleteServersTestJSON-752571955-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:43:15.539212 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-e0f57a17-48ee-4b22-9615-b7a776ac05f6 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:43:15.540208 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-e0f57a17-48ee-4b22-9615-b7a776ac05f6 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] [instance: a4e225e4-7815-4f6a-b1e6-53edab3c1abd] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:43:15.549259 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-e0f57a17-48ee-4b22-9615-b7a776ac05f6 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:43:15.554944 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-e0f57a17-48ee-4b22-9615-b7a776ac05f6 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:43:15.560735 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-e0f57a17-48ee-4b22-9615-b7a776ac05f6 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:43:15.561438 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-e0f57a17-48ee-4b22-9615-b7a776ac05f6 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:43:15.715027 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-2fa2a604-7101-4a46-a661-e12735b47f02 tempest-DeleteServersTestJSON-752571955 tempest-DeleteServersTestJSON-752571955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf1a0e4ab3ab4008a25339e4eda7a48d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be9d7084d7ab4e408be53dd27f8748a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:43:15.734543 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-2fa2a604-7101-4a46-a661-e12735b47f02 tempest-DeleteServersTestJSON-752571955 tempest-DeleteServersTestJSON-752571955-project] 10.222.0.64 "GET /compute/v2.1/servers/6cc17348-b41d-46ba-a1d6-9f80614b7596" status: 200 len: 1315 microversion: 2.1 time: 0.365343 Oct 27 15:43:15.735464 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 72/115] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:43:15 2021] GET /compute/v2.1/servers/6cc17348-b41d-46ba-a1d6-9f80614b7596 => generated 1315 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 15:43:15.790235 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-03dd1714-c93a-4b89-a56e-ef38c83757fa tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:43:15.791180 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-03dd1714-c93a-4b89-a56e-ef38c83757fa tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:43:15.805183 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-03dd1714-c93a-4b89-a56e-ef38c83757fa tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:43:15.806735 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-03dd1714-c93a-4b89-a56e-ef38c83757fa tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:43:15.808883 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-03dd1714-c93a-4b89-a56e-ef38c83757fa tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:43:15.811220 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-03dd1714-c93a-4b89-a56e-ef38c83757fa tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:43:15.903664 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-e0f57a17-48ee-4b22-9615-b7a776ac05f6 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0abe23cb5f314bc883ef7958b0ed9b5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fc48df471f247809d82ddf926bfdc6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:43:15.917238 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-e0f57a17-48ee-4b22-9615-b7a776ac05f6 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] 10.222.0.64 "GET /compute/v2.1/servers/a4e225e4-7815-4f6a-b1e6-53edab3c1abd" status: 200 len: 1317 microversion: 2.1 time: 0.383258 Oct 27 15:43:15.920816 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 44/116] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:43:15 2021] GET /compute/v2.1/servers/a4e225e4-7815-4f6a-b1e6-53edab3c1abd => generated 1317 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 15:43:16.059764 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-03dd1714-c93a-4b89-a56e-ef38c83757fa tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:43:16.068562 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-03dd1714-c93a-4b89-a56e-ef38c83757fa tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:43:16.070598 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-03dd1714-c93a-4b89-a56e-ef38c83757fa tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:43:16.072859 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-03dd1714-c93a-4b89-a56e-ef38c83757fa tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672" status: 200 len: 1408 microversion: 2.20 time: 0.290210 Oct 27 15:43:16.074247 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 73/117] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Oct 27 15:43:15 2021] GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672 => generated 1408 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 15:43:16.294529 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-dddf18b1-d567-45a5-9388-8e03d6f90c14 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:43:16.295137 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-dddf18b1-d567-45a5-9388-8e03d6f90c14 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: bced4f24-572a-4316-97e8-3ceedc61a621] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:43:16.303495 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-dddf18b1-d567-45a5-9388-8e03d6f90c14 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:43:16.307314 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-dddf18b1-d567-45a5-9388-8e03d6f90c14 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:43:16.308152 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-dddf18b1-d567-45a5-9388-8e03d6f90c14 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:43:16.308611 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-dddf18b1-d567-45a5-9388-8e03d6f90c14 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:43:16.536348 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-dddf18b1-d567-45a5-9388-8e03d6f90c14 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96b599f8890b4281a7e311cf37a039e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d7fcab5d3f465793d650f16c6ea8de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:43:16.544569 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-dddf18b1-d567-45a5-9388-8e03d6f90c14 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/bced4f24-572a-4316-97e8-3ceedc61a621" status: 200 len: 1321 microversion: 2.1 time: 0.253850 Oct 27 15:43:16.545146 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 45/118] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:43:16 2021] GET /compute/v2.1/servers/bced4f24-572a-4316-97e8-3ceedc61a621 => generated 1321 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 15:43:16.754102 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-4677569e-8874-438e-a144-370b27db6658 tempest-DeleteServersTestJSON-752571955 tempest-DeleteServersTestJSON-752571955-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:43:16.754102 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-4677569e-8874-438e-a144-370b27db6658 tempest-DeleteServersTestJSON-752571955 tempest-DeleteServersTestJSON-752571955-project] [instance: 6cc17348-b41d-46ba-a1d6-9f80614b7596] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:43:16.759383 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-4677569e-8874-438e-a144-370b27db6658 tempest-DeleteServersTestJSON-752571955 tempest-DeleteServersTestJSON-752571955-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:43:16.759822 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-4677569e-8874-438e-a144-370b27db6658 tempest-DeleteServersTestJSON-752571955 tempest-DeleteServersTestJSON-752571955-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:43:16.760819 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-4677569e-8874-438e-a144-370b27db6658 tempest-DeleteServersTestJSON-752571955 tempest-DeleteServersTestJSON-752571955-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:43:16.761452 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-4677569e-8874-438e-a144-370b27db6658 tempest-DeleteServersTestJSON-752571955 tempest-DeleteServersTestJSON-752571955-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:43:16.937907 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-b6c7990b-0f79-4df1-86f1-87ae07869741 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:43:16.938854 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-b6c7990b-0f79-4df1-86f1-87ae07869741 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] [instance: a4e225e4-7815-4f6a-b1e6-53edab3c1abd] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:43:16.949168 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-b6c7990b-0f79-4df1-86f1-87ae07869741 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:43:16.950020 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-b6c7990b-0f79-4df1-86f1-87ae07869741 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:43:16.951282 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-b6c7990b-0f79-4df1-86f1-87ae07869741 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:43:16.951927 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-b6c7990b-0f79-4df1-86f1-87ae07869741 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:43:16.960778 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-4677569e-8874-438e-a144-370b27db6658 tempest-DeleteServersTestJSON-752571955 tempest-DeleteServersTestJSON-752571955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf1a0e4ab3ab4008a25339e4eda7a48d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be9d7084d7ab4e408be53dd27f8748a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:43:16.972661 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-4677569e-8874-438e-a144-370b27db6658 tempest-DeleteServersTestJSON-752571955 tempest-DeleteServersTestJSON-752571955-project] 10.222.0.64 "GET /compute/v2.1/servers/6cc17348-b41d-46ba-a1d6-9f80614b7596" status: 200 len: 1502 microversion: 2.1 time: 0.223766 Oct 27 15:43:16.974461 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 74/119] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:43:16 2021] GET /compute/v2.1/servers/6cc17348-b41d-46ba-a1d6-9f80614b7596 => generated 1502 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 15:43:17.094591 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-c3b7170c-52f5-45a0-8169-8adf377997f5 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:43:17.097748 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-c3b7170c-52f5-45a0-8169-8adf377997f5 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:43:17.106519 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-b6c7990b-0f79-4df1-86f1-87ae07869741 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0abe23cb5f314bc883ef7958b0ed9b5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fc48df471f247809d82ddf926bfdc6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:43:17.113325 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-c3b7170c-52f5-45a0-8169-8adf377997f5 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:43:17.113773 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-c3b7170c-52f5-45a0-8169-8adf377997f5 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:43:17.114857 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-b6c7990b-0f79-4df1-86f1-87ae07869741 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] 10.222.0.64 "GET /compute/v2.1/servers/a4e225e4-7815-4f6a-b1e6-53edab3c1abd" status: 200 len: 1317 microversion: 2.1 time: 0.181124 Oct 27 15:43:17.115134 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-c3b7170c-52f5-45a0-8169-8adf377997f5 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:43:17.115442 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 46/120] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:43:16 2021] GET /compute/v2.1/servers/a4e225e4-7815-4f6a-b1e6-53edab3c1abd => generated 1317 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 15:43:17.115586 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-c3b7170c-52f5-45a0-8169-8adf377997f5 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:43:17.311699 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-c3b7170c-52f5-45a0-8169-8adf377997f5 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:43:17.331166 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-c3b7170c-52f5-45a0-8169-8adf377997f5 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:43:17.335262 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-c3b7170c-52f5-45a0-8169-8adf377997f5 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:43:17.338145 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-c3b7170c-52f5-45a0-8169-8adf377997f5 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672" status: 200 len: 1408 microversion: 2.20 time: 0.248745 Oct 27 15:43:17.340116 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 75/121] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Oct 27 15:43:17 2021] GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672 => generated 1408 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 15:43:17.560565 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-94fa6701-e5b7-49c9-9d05-59382f43cb8c tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:43:17.561886 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-94fa6701-e5b7-49c9-9d05-59382f43cb8c tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: bced4f24-572a-4316-97e8-3ceedc61a621] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:43:17.568407 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-94fa6701-e5b7-49c9-9d05-59382f43cb8c tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:43:17.569167 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-94fa6701-e5b7-49c9-9d05-59382f43cb8c tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:43:17.570219 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-94fa6701-e5b7-49c9-9d05-59382f43cb8c tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:43:17.570652 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-94fa6701-e5b7-49c9-9d05-59382f43cb8c tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:43:17.747375 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-94fa6701-e5b7-49c9-9d05-59382f43cb8c tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96b599f8890b4281a7e311cf37a039e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d7fcab5d3f465793d650f16c6ea8de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:43:17.755723 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-94fa6701-e5b7-49c9-9d05-59382f43cb8c tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/bced4f24-572a-4316-97e8-3ceedc61a621" status: 200 len: 1321 microversion: 2.1 time: 0.198953 Oct 27 15:43:17.756534 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 47/122] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:43:17 2021] GET /compute/v2.1/servers/bced4f24-572a-4316-97e8-3ceedc61a621 => generated 1321 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 15:43:18.132644 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-48f4b2b1-85f5-46fc-a50e-631999cefbe4 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:43:18.133248 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-48f4b2b1-85f5-46fc-a50e-631999cefbe4 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] [instance: a4e225e4-7815-4f6a-b1e6-53edab3c1abd] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:43:18.139973 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-48f4b2b1-85f5-46fc-a50e-631999cefbe4 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:43:18.141303 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-48f4b2b1-85f5-46fc-a50e-631999cefbe4 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:43:18.142082 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-48f4b2b1-85f5-46fc-a50e-631999cefbe4 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:43:18.143108 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-48f4b2b1-85f5-46fc-a50e-631999cefbe4 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:43:18.286609 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-48f4b2b1-85f5-46fc-a50e-631999cefbe4 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0abe23cb5f314bc883ef7958b0ed9b5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fc48df471f247809d82ddf926bfdc6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:43:18.293886 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-48f4b2b1-85f5-46fc-a50e-631999cefbe4 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] 10.222.0.64 "GET /compute/v2.1/servers/a4e225e4-7815-4f6a-b1e6-53edab3c1abd" status: 200 len: 1506 microversion: 2.1 time: 0.164851 Oct 27 15:43:18.294501 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 76/123] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:43:18 2021] GET /compute/v2.1/servers/a4e225e4-7815-4f6a-b1e6-53edab3c1abd => generated 1506 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 15:43:18.359758 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-00d4011c-222d-4eed-bfe1-266a2804346a tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:43:18.361434 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-00d4011c-222d-4eed-bfe1-266a2804346a tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:43:18.374254 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-00d4011c-222d-4eed-bfe1-266a2804346a tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:43:18.376221 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-00d4011c-222d-4eed-bfe1-266a2804346a tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:43:18.379034 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-00d4011c-222d-4eed-bfe1-266a2804346a tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:43:18.380499 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-00d4011c-222d-4eed-bfe1-266a2804346a tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:43:18.757359 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-00d4011c-222d-4eed-bfe1-266a2804346a tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:43:18.771919 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-00d4011c-222d-4eed-bfe1-266a2804346a tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:43:18.774385 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-3673af9b-d016-46de-86d6-73da5bacd555 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:43:18.775028 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-00d4011c-222d-4eed-bfe1-266a2804346a tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:43:18.775157 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-3673af9b-d016-46de-86d6-73da5bacd555 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: bced4f24-572a-4316-97e8-3ceedc61a621] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:43:18.778543 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-00d4011c-222d-4eed-bfe1-266a2804346a tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672" status: 200 len: 1408 microversion: 2.20 time: 0.424360 Oct 27 15:43:18.779937 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 48/124] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Oct 27 15:43:18 2021] GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672 => generated 1408 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 15:43:18.791649 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-3673af9b-d016-46de-86d6-73da5bacd555 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:43:18.792519 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-3673af9b-d016-46de-86d6-73da5bacd555 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:43:18.793504 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-3673af9b-d016-46de-86d6-73da5bacd555 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:43:18.794087 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-3673af9b-d016-46de-86d6-73da5bacd555 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:43:19.061894 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-3673af9b-d016-46de-86d6-73da5bacd555 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96b599f8890b4281a7e311cf37a039e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d7fcab5d3f465793d650f16c6ea8de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:43:19.069956 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-3673af9b-d016-46de-86d6-73da5bacd555 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/bced4f24-572a-4316-97e8-3ceedc61a621" status: 200 len: 1321 microversion: 2.1 time: 0.300095 Oct 27 15:43:19.074533 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 77/125] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:43:18 2021] GET /compute/v2.1/servers/bced4f24-572a-4316-97e8-3ceedc61a621 => generated 1321 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 15:43:19.173786 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [req-c03ce8d4-abad-4966-9416-49438dec36ef req-a858b72d-50e3-4dd0-a9e3-8298a892d2bc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a115c672-012e-4e45-b5c9-4427e7b66672", "name": "network-vif-plugged", "status": "completed", "tag": "c9ac335c-5a25-416c-803f-ac2f3d462176"}]} {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 15:43:19.175407 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 27 15:43:19.175407 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: warnings.warn(msg) Oct 27 15:43:19.187173 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [req-c03ce8d4-abad-4966-9416-49438dec36ef req-a858b72d-50e3-4dd0-a9e3-8298a892d2bc service nova] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:43:19.187675 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [req-c03ce8d4-abad-4966-9416-49438dec36ef req-a858b72d-50e3-4dd0-a9e3-8298a892d2bc service nova] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:43:19.219730 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.compute.server_external_events [req-c03ce8d4-abad-4966-9416-49438dec36ef req-a858b72d-50e3-4dd0-a9e3-8298a892d2bc service nova] Creating event network-vif-plugged:c9ac335c-5a25-416c-803f-ac2f3d462176 for instance a115c672-012e-4e45-b5c9-4427e7b66672 on hv-cinder-80070 Oct 27 15:43:19.228905 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [req-c03ce8d4-abad-4966-9416-49438dec36ef req-a858b72d-50e3-4dd0-a9e3-8298a892d2bc service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059546 Oct 27 15:43:19.232853 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 49/126] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Oct 27 15:43:19 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 15:43:19.797860 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-8efc4739-b41a-418a-a5e0-94a184b3d7ce tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:43:19.798675 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-8efc4739-b41a-418a-a5e0-94a184b3d7ce tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:43:19.805636 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-8efc4739-b41a-418a-a5e0-94a184b3d7ce tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:43:19.806245 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-8efc4739-b41a-418a-a5e0-94a184b3d7ce tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:43:19.807254 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-8efc4739-b41a-418a-a5e0-94a184b3d7ce tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:43:19.808112 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-8efc4739-b41a-418a-a5e0-94a184b3d7ce tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:43:19.942563 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-8efc4739-b41a-418a-a5e0-94a184b3d7ce tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:43:19.950194 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-8efc4739-b41a-418a-a5e0-94a184b3d7ce tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:43:19.951691 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-8efc4739-b41a-418a-a5e0-94a184b3d7ce tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:43:19.952807 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-8efc4739-b41a-418a-a5e0-94a184b3d7ce tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672" status: 200 len: 1408 microversion: 2.20 time: 0.159555 Oct 27 15:43:19.953368 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 78/127] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Oct 27 15:43:19 2021] GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672 => generated 1408 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 15:43:20.092746 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-c45836f8-035b-42c2-9cc6-8d983d83c285 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:43:20.093578 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-c45836f8-035b-42c2-9cc6-8d983d83c285 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: bced4f24-572a-4316-97e8-3ceedc61a621] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:43:20.100645 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-c45836f8-035b-42c2-9cc6-8d983d83c285 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:43:20.101111 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-c45836f8-035b-42c2-9cc6-8d983d83c285 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:43:20.101882 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-c45836f8-035b-42c2-9cc6-8d983d83c285 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:43:20.102312 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-c45836f8-035b-42c2-9cc6-8d983d83c285 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:43:20.243920 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-c45836f8-035b-42c2-9cc6-8d983d83c285 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96b599f8890b4281a7e311cf37a039e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d7fcab5d3f465793d650f16c6ea8de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:43:20.251036 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-c45836f8-035b-42c2-9cc6-8d983d83c285 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/bced4f24-572a-4316-97e8-3ceedc61a621" status: 200 len: 1321 microversion: 2.1 time: 0.163376 Oct 27 15:43:20.252143 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 50/128] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:43:20 2021] GET /compute/v2.1/servers/bced4f24-572a-4316-97e8-3ceedc61a621 => generated 1321 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 15:43:20.970455 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-0d2fb452-9ef1-4495-aab4-ff6ec4231425 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:43:20.971126 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-0d2fb452-9ef1-4495-aab4-ff6ec4231425 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:43:20.977028 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-0d2fb452-9ef1-4495-aab4-ff6ec4231425 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:43:20.977467 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-0d2fb452-9ef1-4495-aab4-ff6ec4231425 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:43:20.978224 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-0d2fb452-9ef1-4495-aab4-ff6ec4231425 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:43:20.978650 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-0d2fb452-9ef1-4495-aab4-ff6ec4231425 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:43:21.105405 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-0d2fb452-9ef1-4495-aab4-ff6ec4231425 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:43:21.114566 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-0d2fb452-9ef1-4495-aab4-ff6ec4231425 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:43:21.116521 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-0d2fb452-9ef1-4495-aab4-ff6ec4231425 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:43:21.117909 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-0d2fb452-9ef1-4495-aab4-ff6ec4231425 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672" status: 200 len: 1408 microversion: 2.20 time: 0.151239 Oct 27 15:43:21.118844 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 79/129] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Oct 27 15:43:20 2021] GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672 => generated 1408 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 15:43:21.269638 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-608dc787-a354-44bf-b2bd-991cac03f90c tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:43:21.270260 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-608dc787-a354-44bf-b2bd-991cac03f90c tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: bced4f24-572a-4316-97e8-3ceedc61a621] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:43:21.277816 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [req-d3ddb993-b2d2-411d-80b6-d1c44bd9d678 req-5fc69297-c8a8-4143-a0f3-20106b1d918b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bced4f24-572a-4316-97e8-3ceedc61a621", "name": "network-vif-plugged", "status": "completed", "tag": "4638d661-d8d4-4d3b-ac20-f85ec470f7f4"}]} {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 15:43:21.278143 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-608dc787-a354-44bf-b2bd-991cac03f90c tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:43:21.278507 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-608dc787-a354-44bf-b2bd-991cac03f90c tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:43:21.279269 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-608dc787-a354-44bf-b2bd-991cac03f90c tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:43:21.279379 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 27 15:43:21.279379 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: warnings.warn(msg) Oct 27 15:43:21.279692 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-608dc787-a354-44bf-b2bd-991cac03f90c tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:43:21.287006 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [req-d3ddb993-b2d2-411d-80b6-d1c44bd9d678 req-5fc69297-c8a8-4143-a0f3-20106b1d918b service nova] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:43:21.287440 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [req-d3ddb993-b2d2-411d-80b6-d1c44bd9d678 req-5fc69297-c8a8-4143-a0f3-20106b1d918b service nova] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:43:21.298427 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.compute.server_external_events [req-d3ddb993-b2d2-411d-80b6-d1c44bd9d678 req-5fc69297-c8a8-4143-a0f3-20106b1d918b service nova] Creating event network-vif-plugged:4638d661-d8d4-4d3b-ac20-f85ec470f7f4 for instance bced4f24-572a-4316-97e8-3ceedc61a621 on hv-cinder-80070 Oct 27 15:43:21.303655 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [req-d3ddb993-b2d2-411d-80b6-d1c44bd9d678 req-5fc69297-c8a8-4143-a0f3-20106b1d918b service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029556 Oct 27 15:43:21.304329 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 80/130] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Oct 27 15:43:21 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 15:43:21.410948 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-608dc787-a354-44bf-b2bd-991cac03f90c tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96b599f8890b4281a7e311cf37a039e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d7fcab5d3f465793d650f16c6ea8de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:43:21.418254 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-608dc787-a354-44bf-b2bd-991cac03f90c tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/bced4f24-572a-4316-97e8-3ceedc61a621" status: 200 len: 1321 microversion: 2.1 time: 0.153418 Oct 27 15:43:21.418809 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 51/131] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:43:21 2021] GET /compute/v2.1/servers/bced4f24-572a-4316-97e8-3ceedc61a621 => generated 1321 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 15:43:21.832987 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-616b9ba6-1d2a-4018-8bd6-f84ac60421fb tempest-DeleteServersTestJSON-752571955 tempest-DeleteServersTestJSON-752571955-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7f1bc5e2-9909-484d-9e5a-79127913664f"}} {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 15:43:21.834462 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-616b9ba6-1d2a-4018-8bd6-f84ac60421fb tempest-DeleteServersTestJSON-752571955 tempest-DeleteServersTestJSON-752571955-project] [instance: 6cc17348-b41d-46ba-a1d6-9f80614b7596] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:43:21.841271 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-616b9ba6-1d2a-4018-8bd6-f84ac60421fb tempest-DeleteServersTestJSON-752571955 tempest-DeleteServersTestJSON-752571955-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:43:21.841766 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-616b9ba6-1d2a-4018-8bd6-f84ac60421fb tempest-DeleteServersTestJSON-752571955 tempest-DeleteServersTestJSON-752571955-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:43:21.842741 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-616b9ba6-1d2a-4018-8bd6-f84ac60421fb tempest-DeleteServersTestJSON-752571955 tempest-DeleteServersTestJSON-752571955-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:43:21.843244 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-616b9ba6-1d2a-4018-8bd6-f84ac60421fb tempest-DeleteServersTestJSON-752571955 tempest-DeleteServersTestJSON-752571955-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:43:21.907038 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-c31f5a9e-d24c-44dc-8773-a40393be3a72 tempest-VolumesActionsTest-1850781407 tempest-VolumesActionsTest-1850781407-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1350230328", "imageRef": "b585ffbc-6a36-48c9-81b3-e26f9bd0fcba", "flavorRef": "452", "networks": [{"uuid": "d9920b1a-dba1-47a3-9b0b-5332bfa99d8e"}]}} {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 15:43:21.977771 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.network.neutron [None req-c31f5a9e-d24c-44dc-8773-a40393be3a72 tempest-VolumesActionsTest-1850781407 tempest-VolumesActionsTest-1850781407-project] validate_networks() for [('d9920b1a-dba1-47a3-9b0b-5332bfa99d8e', None, None, None, None, None)] {{(pid=122225) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Oct 27 15:43:22.245527 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-616b9ba6-1d2a-4018-8bd6-f84ac60421fb tempest-DeleteServersTestJSON-752571955 tempest-DeleteServersTestJSON-752571955-project] 10.222.0.64 "POST /compute/v2.1/servers/6cc17348-b41d-46ba-a1d6-9f80614b7596/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.417114 Oct 27 15:43:22.246169 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 81/132] 10.222.0.64 () {60 vars in 1322 bytes} [Wed Oct 27 15:43:21 2021] POST /compute/v2.1/servers/6cc17348-b41d-46ba-a1d6-9f80614b7596/os-volume_attachments => generated 194 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 15:43:22.251918 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-3d197be9-4677-427e-b3fd-d7ade55f8e96 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ed3bd7e9-5fd7-4c9a-96cf-6a6b7cacfa91"}} {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 15:43:22.253377 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-3d197be9-4677-427e-b3fd-d7ade55f8e96 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] [instance: a4e225e4-7815-4f6a-b1e6-53edab3c1abd] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:43:22.263605 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-3d197be9-4677-427e-b3fd-d7ade55f8e96 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:43:22.264011 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-3d197be9-4677-427e-b3fd-d7ade55f8e96 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:43:22.265136 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-3d197be9-4677-427e-b3fd-d7ade55f8e96 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:43:22.266616 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-3d197be9-4677-427e-b3fd-d7ade55f8e96 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:43:22.583360 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.virt.hardware [None req-c31f5a9e-d24c-44dc-8773-a40393be3a72 tempest-VolumesActionsTest-1850781407 tempest-VolumesActionsTest-1850781407-project] Flavor limits 0:0:0 {{(pid=122225) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 15:43:22.583877 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.virt.hardware [None req-c31f5a9e-d24c-44dc-8773-a40393be3a72 tempest-VolumesActionsTest-1850781407 tempest-VolumesActionsTest-1850781407-project] Image limits 0:0:0 {{(pid=122225) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 15:43:22.584257 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.virt.hardware [None req-c31f5a9e-d24c-44dc-8773-a40393be3a72 tempest-VolumesActionsTest-1850781407 tempest-VolumesActionsTest-1850781407-project] Flavor pref 0:0:0 {{(pid=122225) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 15:43:22.584655 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.virt.hardware [None req-c31f5a9e-d24c-44dc-8773-a40393be3a72 tempest-VolumesActionsTest-1850781407 tempest-VolumesActionsTest-1850781407-project] Image pref 0:0:0 {{(pid=122225) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 15:43:22.585113 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.virt.hardware [None req-c31f5a9e-d24c-44dc-8773-a40393be3a72 tempest-VolumesActionsTest-1850781407 tempest-VolumesActionsTest-1850781407-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122225) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 15:43:22.595826 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-c31f5a9e-d24c-44dc-8773-a40393be3a72 tempest-VolumesActionsTest-1850781407 tempest-VolumesActionsTest-1850781407-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:43:22.596052 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-c31f5a9e-d24c-44dc-8773-a40393be3a72 tempest-VolumesActionsTest-1850781407 tempest-VolumesActionsTest-1850781407-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:43:22.596945 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-c31f5a9e-d24c-44dc-8773-a40393be3a72 tempest-VolumesActionsTest-1850781407 tempest-VolumesActionsTest-1850781407-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:43:22.597386 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-c31f5a9e-d24c-44dc-8773-a40393be3a72 tempest-VolumesActionsTest-1850781407 tempest-VolumesActionsTest-1850781407-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:43:22.615919 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.quota [None req-c31f5a9e-d24c-44dc-8773-a40393be3a72 tempest-VolumesActionsTest-1850781407 tempest-VolumesActionsTest-1850781407-project] Getting quotas for project eef06dd988f343e7ae8ccf2c93217e9f. Resources: {'ram', 'instances', 'cores'} {{(pid=122225) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 27 15:43:22.620368 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.quota [None req-c31f5a9e-d24c-44dc-8773-a40393be3a72 tempest-VolumesActionsTest-1850781407 tempest-VolumesActionsTest-1850781407-project] Getting quotas for user f44b5c1ad2204da1935d8cb7ea8bc67e and project eef06dd988f343e7ae8ccf2c93217e9f. Resources: {'ram', 'instances', 'cores'} {{(pid=122225) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 27 15:43:22.633979 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-c31f5a9e-d24c-44dc-8773-a40393be3a72 tempest-VolumesActionsTest-1850781407 tempest-VolumesActionsTest-1850781407-project] Going to run 1 instances... {{(pid=122225) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Oct 27 15:43:22.636592 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-c31f5a9e-d24c-44dc-8773-a40393be3a72 tempest-VolumesActionsTest-1850781407 tempest-VolumesActionsTest-1850781407-project] [instance: 48a2ef84-6477-44cd-a1f6-bac51ae67fa4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b585ffbc-6a36-48c9-81b3-e26f9bd0fcba',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122225) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Oct 27 15:43:22.683269 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-c31f5a9e-d24c-44dc-8773-a40393be3a72 tempest-VolumesActionsTest-1850781407 tempest-VolumesActionsTest-1850781407-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.782901 Oct 27 15:43:22.683948 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 52/133] 10.222.0.64 () {60 vars in 1146 bytes} [Wed Oct 27 15:43:21 2021] POST /compute/v2.1/servers => generated 380 bytes in 784 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 15:43:22.688438 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-d98527c2-3818-48ce-9d66-9edcc44c9f17 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:43:22.689920 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-d98527c2-3818-48ce-9d66-9edcc44c9f17 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:43:22.696484 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-d98527c2-3818-48ce-9d66-9edcc44c9f17 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:43:22.697093 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-d98527c2-3818-48ce-9d66-9edcc44c9f17 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:43:22.697924 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-d98527c2-3818-48ce-9d66-9edcc44c9f17 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:43:22.698450 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-d98527c2-3818-48ce-9d66-9edcc44c9f17 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:43:22.856739 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-3d197be9-4677-427e-b3fd-d7ade55f8e96 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] 10.222.0.64 "POST /compute/v2.1/servers/a4e225e4-7815-4f6a-b1e6-53edab3c1abd/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.609097 Oct 27 15:43:22.857600 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 82/134] 10.222.0.64 () {60 vars in 1322 bytes} [Wed Oct 27 15:43:22 2021] POST /compute/v2.1/servers/a4e225e4-7815-4f6a-b1e6-53edab3c1abd/os-volume_attachments => generated 194 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 15:43:22.860196 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-d98527c2-3818-48ce-9d66-9edcc44c9f17 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:43:22.864824 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-2b053fb2-446e-4a91-a33c-2acc15146ac8 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:43:22.865826 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-2b053fb2-446e-4a91-a33c-2acc15146ac8 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: bced4f24-572a-4316-97e8-3ceedc61a621] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:43:22.872097 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-d98527c2-3818-48ce-9d66-9edcc44c9f17 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:43:22.873760 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-d98527c2-3818-48ce-9d66-9edcc44c9f17 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:43:22.874942 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-d98527c2-3818-48ce-9d66-9edcc44c9f17 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672" status: 200 len: 1600 microversion: 2.20 time: 0.190023 Oct 27 15:43:22.875489 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 53/135] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Oct 27 15:43:22 2021] GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672 => generated 1600 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 15:43:22.877115 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-2b053fb2-446e-4a91-a33c-2acc15146ac8 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:43:22.877882 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-2b053fb2-446e-4a91-a33c-2acc15146ac8 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:43:22.878731 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-2b053fb2-446e-4a91-a33c-2acc15146ac8 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:43:22.879633 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-2b053fb2-446e-4a91-a33c-2acc15146ac8 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:43:22.895449 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-7eaf64df-a6b9-47c4-ba93-83553678639f tempest-VolumesActionsTest-1850781407 tempest-VolumesActionsTest-1850781407-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:43:22.896318 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-7eaf64df-a6b9-47c4-ba93-83553678639f tempest-VolumesActionsTest-1850781407 tempest-VolumesActionsTest-1850781407-project] [instance: 48a2ef84-6477-44cd-a1f6-bac51ae67fa4] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:43:22.964576 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-7eaf64df-a6b9-47c4-ba93-83553678639f tempest-VolumesActionsTest-1850781407 tempest-VolumesActionsTest-1850781407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f44b5c1ad2204da1935d8cb7ea8bc67e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eef06dd988f343e7ae8ccf2c93217e9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:43:22.973691 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-7eaf64df-a6b9-47c4-ba93-83553678639f tempest-VolumesActionsTest-1850781407 tempest-VolumesActionsTest-1850781407-project] 10.222.0.64 "GET /compute/v2.1/servers/48a2ef84-6477-44cd-a1f6-bac51ae67fa4" status: 200 len: 1214 microversion: 2.1 time: 0.084250 Oct 27 15:43:22.974838 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 54/136] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:43:22 2021] GET /compute/v2.1/servers/48a2ef84-6477-44cd-a1f6-bac51ae67fa4 => generated 1214 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 15:43:22.979946 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-1f892bd9-faa4-4aab-b4bd-b5f945d64d5a tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:43:22.980761 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-1f892bd9-faa4-4aab-b4bd-b5f945d64d5a tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:43:22.992159 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-1f892bd9-faa4-4aab-b4bd-b5f945d64d5a tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:43:22.992928 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-1f892bd9-faa4-4aab-b4bd-b5f945d64d5a tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:43:22.993795 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-1f892bd9-faa4-4aab-b4bd-b5f945d64d5a tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:43:22.994714 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-1f892bd9-faa4-4aab-b4bd-b5f945d64d5a tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:43:23.070750 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-2b053fb2-446e-4a91-a33c-2acc15146ac8 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96b599f8890b4281a7e311cf37a039e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d7fcab5d3f465793d650f16c6ea8de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:43:23.080383 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-2b053fb2-446e-4a91-a33c-2acc15146ac8 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/bced4f24-572a-4316-97e8-3ceedc61a621" status: 200 len: 1321 microversion: 2.1 time: 0.221225 Oct 27 15:43:23.089790 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 83/137] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:43:22 2021] GET /compute/v2.1/servers/bced4f24-572a-4316-97e8-3ceedc61a621 => generated 1321 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 15:43:23.156017 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-1f892bd9-faa4-4aab-b4bd-b5f945d64d5a tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.179496 Oct 27 15:43:23.156852 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 55/138] 10.222.0.64 () {60 vars in 1315 bytes} [Wed Oct 27 15:43:22 2021] GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672/os-interface => generated 284 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 15:43:23.994335 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-f0ea0185-e5e7-4545-aba7-9e0920408090 tempest-VolumesActionsTest-1850781407 tempest-VolumesActionsTest-1850781407-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:43:23.994950 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-f0ea0185-e5e7-4545-aba7-9e0920408090 tempest-VolumesActionsTest-1850781407 tempest-VolumesActionsTest-1850781407-project] [instance: 48a2ef84-6477-44cd-a1f6-bac51ae67fa4] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:43:24.001917 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-f0ea0185-e5e7-4545-aba7-9e0920408090 tempest-VolumesActionsTest-1850781407 tempest-VolumesActionsTest-1850781407-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:43:24.002364 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-f0ea0185-e5e7-4545-aba7-9e0920408090 tempest-VolumesActionsTest-1850781407 tempest-VolumesActionsTest-1850781407-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:43:24.004549 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-f0ea0185-e5e7-4545-aba7-9e0920408090 tempest-VolumesActionsTest-1850781407 tempest-VolumesActionsTest-1850781407-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:43:24.005212 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-f0ea0185-e5e7-4545-aba7-9e0920408090 tempest-VolumesActionsTest-1850781407 tempest-VolumesActionsTest-1850781407-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:43:24.099727 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-bd9b0972-af9f-4815-b2a9-7cfa3398c3ae tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:43:24.101011 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-bd9b0972-af9f-4815-b2a9-7cfa3398c3ae tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: bced4f24-572a-4316-97e8-3ceedc61a621] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:43:24.109913 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-bd9b0972-af9f-4815-b2a9-7cfa3398c3ae tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:43:24.110509 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-bd9b0972-af9f-4815-b2a9-7cfa3398c3ae tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:43:24.112453 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-bd9b0972-af9f-4815-b2a9-7cfa3398c3ae tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:43:24.113003 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-bd9b0972-af9f-4815-b2a9-7cfa3398c3ae tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:43:24.244674 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-bd9b0972-af9f-4815-b2a9-7cfa3398c3ae tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96b599f8890b4281a7e311cf37a039e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d7fcab5d3f465793d650f16c6ea8de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:43:24.252864 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-bd9b0972-af9f-4815-b2a9-7cfa3398c3ae tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/bced4f24-572a-4316-97e8-3ceedc61a621" status: 200 len: 1514 microversion: 2.1 time: 0.158594 Oct 27 15:43:24.256272 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 56/139] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:43:24 2021] GET /compute/v2.1/servers/bced4f24-572a-4316-97e8-3ceedc61a621 => generated 1514 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 15:43:24.273070 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-da682459-e3d8-45f5-8cd5-ae56f3d0097b tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 15:43:24.274048 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-da682459-e3d8-45f5-8cd5-ae56f3d0097b tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: bced4f24-572a-4316-97e8-3ceedc61a621] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:43:24.280215 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-da682459-e3d8-45f5-8cd5-ae56f3d0097b tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:43:24.280894 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-da682459-e3d8-45f5-8cd5-ae56f3d0097b tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:43:24.281842 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-da682459-e3d8-45f5-8cd5-ae56f3d0097b tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:43:24.282481 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-da682459-e3d8-45f5-8cd5-ae56f3d0097b tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:43:24.285654 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-f0ea0185-e5e7-4545-aba7-9e0920408090 tempest-VolumesActionsTest-1850781407 tempest-VolumesActionsTest-1850781407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f44b5c1ad2204da1935d8cb7ea8bc67e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eef06dd988f343e7ae8ccf2c93217e9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:43:24.307879 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-f0ea0185-e5e7-4545-aba7-9e0920408090 tempest-VolumesActionsTest-1850781407 tempest-VolumesActionsTest-1850781407-project] 10.222.0.64 "GET /compute/v2.1/servers/48a2ef84-6477-44cd-a1f6-bac51ae67fa4" status: 200 len: 1266 microversion: 2.1 time: 0.317168 Oct 27 15:43:24.309092 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 84/140] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:43:23 2021] GET /compute/v2.1/servers/48a2ef84-6477-44cd-a1f6-bac51ae67fa4 => generated 1266 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 15:43:24.327329 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.objects.instance [None req-da682459-e3d8-45f5-8cd5-ae56f3d0097b tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lazy-loading 'flavor' on Instance uuid bced4f24-572a-4316-97e8-3ceedc61a621 {{(pid=122225) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 27 15:43:24.477949 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-da682459-e3d8-45f5-8cd5-ae56f3d0097b tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "POST /compute/v2.1/servers/bced4f24-572a-4316-97e8-3ceedc61a621/action" status: 200 len: 32 microversion: 2.1 time: 0.209137 Oct 27 15:43:24.478573 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 57/141] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Oct 27 15:43:24 2021] POST /compute/v2.1/servers/bced4f24-572a-4316-97e8-3ceedc61a621/action => generated 32 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 27 15:43:24.488960 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-daad6fa4-e6ac-4cf9-aa5a-4adaa21cf01a tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:43:24.489604 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-daad6fa4-e6ac-4cf9-aa5a-4adaa21cf01a tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: bced4f24-572a-4316-97e8-3ceedc61a621] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:43:24.495821 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-daad6fa4-e6ac-4cf9-aa5a-4adaa21cf01a tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:43:24.496315 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-daad6fa4-e6ac-4cf9-aa5a-4adaa21cf01a tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:43:24.497393 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-daad6fa4-e6ac-4cf9-aa5a-4adaa21cf01a tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:43:24.497865 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-daad6fa4-e6ac-4cf9-aa5a-4adaa21cf01a tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:43:24.812267 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-daad6fa4-e6ac-4cf9-aa5a-4adaa21cf01a tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96b599f8890b4281a7e311cf37a039e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d7fcab5d3f465793d650f16c6ea8de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:43:24.819380 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-daad6fa4-e6ac-4cf9-aa5a-4adaa21cf01a tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/bced4f24-572a-4316-97e8-3ceedc61a621" status: 200 len: 1520 microversion: 2.1 time: 0.335594 Oct 27 15:43:24.819970 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 85/142] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:43:24 2021] GET /compute/v2.1/servers/bced4f24-572a-4316-97e8-3ceedc61a621 => generated 1520 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 15:43:24.995026 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-607133dd-c322-43fe-8789-cfac8b07aa8e tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 15:43:24.995830 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-607133dd-c322-43fe-8789-cfac8b07aa8e tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:43:25.020806 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [req-1e2563c5-7c62-4843-a848-cdb80d074ab9 req-d596ffc2-e235-4f9f-89e5-79f635d9a736 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a115c672-012e-4e45-b5c9-4427e7b66672", "tag": "c9ac335c-5a25-416c-803f-ac2f3d462176"}]} {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 15:43:25.023179 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 27 15:43:25.023179 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: warnings.warn(msg) Oct 27 15:43:25.035976 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-607133dd-c322-43fe-8789-cfac8b07aa8e tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:43:25.036514 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-607133dd-c322-43fe-8789-cfac8b07aa8e tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:43:25.037328 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-607133dd-c322-43fe-8789-cfac8b07aa8e tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:43:25.037762 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-607133dd-c322-43fe-8789-cfac8b07aa8e tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:43:25.043185 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [req-1e2563c5-7c62-4843-a848-cdb80d074ab9 req-d596ffc2-e235-4f9f-89e5-79f635d9a736 service nova] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:43:25.043631 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [req-1e2563c5-7c62-4843-a848-cdb80d074ab9 req-d596ffc2-e235-4f9f-89e5-79f635d9a736 service nova] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:43:25.079970 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.compute.server_external_events [req-1e2563c5-7c62-4843-a848-cdb80d074ab9 req-d596ffc2-e235-4f9f-89e5-79f635d9a736 service nova] Creating event network-changed:c9ac335c-5a25-416c-803f-ac2f3d462176 for instance a115c672-012e-4e45-b5c9-4427e7b66672 on hv-cinder-80070 Oct 27 15:43:25.092929 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [req-1e2563c5-7c62-4843-a848-cdb80d074ab9 req-d596ffc2-e235-4f9f-89e5-79f635d9a736 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077427 Oct 27 15:43:25.093589 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 86/143] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Oct 27 15:43:25 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 15:43:25.238912 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-607133dd-c322-43fe-8789-cfac8b07aa8e tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "POST /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672/action" status: 200 len: 14 microversion: 2.20 time: 0.250589 Oct 27 15:43:25.240364 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 58/144] 10.222.0.64 () {62 vars in 1318 bytes} [Wed Oct 27 15:43:24 2021] POST /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672/action => generated 14 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 15:43:25.326038 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-e0f2898b-ee97-4ac8-9b0e-aa5a9d73e4c1 tempest-VolumesActionsTest-1850781407 tempest-VolumesActionsTest-1850781407-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:43:25.327153 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-e0f2898b-ee97-4ac8-9b0e-aa5a9d73e4c1 tempest-VolumesActionsTest-1850781407 tempest-VolumesActionsTest-1850781407-project] [instance: 48a2ef84-6477-44cd-a1f6-bac51ae67fa4] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:43:25.337502 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-e0f2898b-ee97-4ac8-9b0e-aa5a9d73e4c1 tempest-VolumesActionsTest-1850781407 tempest-VolumesActionsTest-1850781407-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:43:25.337972 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-e0f2898b-ee97-4ac8-9b0e-aa5a9d73e4c1 tempest-VolumesActionsTest-1850781407 tempest-VolumesActionsTest-1850781407-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:43:25.341619 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-e0f2898b-ee97-4ac8-9b0e-aa5a9d73e4c1 tempest-VolumesActionsTest-1850781407 tempest-VolumesActionsTest-1850781407-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:43:25.342077 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-e0f2898b-ee97-4ac8-9b0e-aa5a9d73e4c1 tempest-VolumesActionsTest-1850781407 tempest-VolumesActionsTest-1850781407-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:43:25.506832 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-e0f2898b-ee97-4ac8-9b0e-aa5a9d73e4c1 tempest-VolumesActionsTest-1850781407 tempest-VolumesActionsTest-1850781407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f44b5c1ad2204da1935d8cb7ea8bc67e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eef06dd988f343e7ae8ccf2c93217e9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:43:25.527722 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-e0f2898b-ee97-4ac8-9b0e-aa5a9d73e4c1 tempest-VolumesActionsTest-1850781407 tempest-VolumesActionsTest-1850781407-project] 10.222.0.64 "GET /compute/v2.1/servers/48a2ef84-6477-44cd-a1f6-bac51ae67fa4" status: 200 len: 1272 microversion: 2.1 time: 0.205572 Oct 27 15:43:25.531166 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 87/145] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:43:25 2021] GET /compute/v2.1/servers/48a2ef84-6477-44cd-a1f6-bac51ae67fa4 => generated 1272 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 15:43:25.841714 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-c0824563-c63c-41ad-b10f-2ad947f0a88a tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:43:25.844306 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-c0824563-c63c-41ad-b10f-2ad947f0a88a tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: bced4f24-572a-4316-97e8-3ceedc61a621] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:43:25.864552 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-c0824563-c63c-41ad-b10f-2ad947f0a88a tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:43:25.865401 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-c0824563-c63c-41ad-b10f-2ad947f0a88a tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:43:25.866716 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-c0824563-c63c-41ad-b10f-2ad947f0a88a tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:43:25.867356 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-c0824563-c63c-41ad-b10f-2ad947f0a88a tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:43:26.251220 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-131c7f7d-9814-4eeb-b4f2-bc0d943ded17 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 15:43:26.252397 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-131c7f7d-9814-4eeb-b4f2-bc0d943ded17 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:43:26.272238 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-131c7f7d-9814-4eeb-b4f2-bc0d943ded17 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:43:26.279011 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-131c7f7d-9814-4eeb-b4f2-bc0d943ded17 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:43:26.280940 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-131c7f7d-9814-4eeb-b4f2-bc0d943ded17 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:43:26.281541 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-131c7f7d-9814-4eeb-b4f2-bc0d943ded17 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:43:26.322701 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-c0824563-c63c-41ad-b10f-2ad947f0a88a tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96b599f8890b4281a7e311cf37a039e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d7fcab5d3f465793d650f16c6ea8de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:43:26.330748 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-c0824563-c63c-41ad-b10f-2ad947f0a88a tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/bced4f24-572a-4316-97e8-3ceedc61a621" status: 200 len: 1520 microversion: 2.1 time: 0.495290 Oct 27 15:43:26.331329 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 59/146] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:43:25 2021] GET /compute/v2.1/servers/bced4f24-572a-4316-97e8-3ceedc61a621 => generated 1520 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 15:43:26.385902 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-131c7f7d-9814-4eeb-b4f2-bc0d943ded17 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "POST /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672/action" status: 200 len: 14 microversion: 2.20 time: 0.138902 Oct 27 15:43:26.387129 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 88/147] 10.222.0.64 () {62 vars in 1318 bytes} [Wed Oct 27 15:43:26 2021] POST /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672/action => generated 14 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 15:43:26.549228 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-80bd64f4-bf13-4c8d-b987-abecc2ca8bb8 tempest-VolumesActionsTest-1850781407 tempest-VolumesActionsTest-1850781407-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:43:26.550568 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-80bd64f4-bf13-4c8d-b987-abecc2ca8bb8 tempest-VolumesActionsTest-1850781407 tempest-VolumesActionsTest-1850781407-project] [instance: 48a2ef84-6477-44cd-a1f6-bac51ae67fa4] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:43:26.559118 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-80bd64f4-bf13-4c8d-b987-abecc2ca8bb8 tempest-VolumesActionsTest-1850781407 tempest-VolumesActionsTest-1850781407-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:43:26.559833 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-80bd64f4-bf13-4c8d-b987-abecc2ca8bb8 tempest-VolumesActionsTest-1850781407 tempest-VolumesActionsTest-1850781407-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:43:26.561167 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-80bd64f4-bf13-4c8d-b987-abecc2ca8bb8 tempest-VolumesActionsTest-1850781407 tempest-VolumesActionsTest-1850781407-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:43:26.561916 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-80bd64f4-bf13-4c8d-b987-abecc2ca8bb8 tempest-VolumesActionsTest-1850781407 tempest-VolumesActionsTest-1850781407-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:43:26.816079 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-80bd64f4-bf13-4c8d-b987-abecc2ca8bb8 tempest-VolumesActionsTest-1850781407 tempest-VolumesActionsTest-1850781407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f44b5c1ad2204da1935d8cb7ea8bc67e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eef06dd988f343e7ae8ccf2c93217e9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:43:26.825478 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-80bd64f4-bf13-4c8d-b987-abecc2ca8bb8 tempest-VolumesActionsTest-1850781407 tempest-VolumesActionsTest-1850781407-project] 10.222.0.64 "GET /compute/v2.1/servers/48a2ef84-6477-44cd-a1f6-bac51ae67fa4" status: 200 len: 1314 microversion: 2.1 time: 0.282066 Oct 27 15:43:26.839507 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 60/148] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:43:26 2021] GET /compute/v2.1/servers/48a2ef84-6477-44cd-a1f6-bac51ae67fa4 => generated 1314 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 15:43:27.202722 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [req-01cc871a-b5c2-40c0-8152-ae4ad08d7076 req-5b313e2e-4543-4dd9-a10a-90b0ae9bba7d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "48a2ef84-6477-44cd-a1f6-bac51ae67fa4", "tag": "6c93023e-5a56-4e67-89ee-7c18d38a071f"}]} {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 15:43:27.205620 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 27 15:43:27.205620 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: warnings.warn(msg) Oct 27 15:43:27.238113 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [req-01cc871a-b5c2-40c0-8152-ae4ad08d7076 req-5b313e2e-4543-4dd9-a10a-90b0ae9bba7d service nova] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:43:27.238559 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [req-01cc871a-b5c2-40c0-8152-ae4ad08d7076 req-5b313e2e-4543-4dd9-a10a-90b0ae9bba7d service nova] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:43:27.269359 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.compute.server_external_events [req-01cc871a-b5c2-40c0-8152-ae4ad08d7076 req-5b313e2e-4543-4dd9-a10a-90b0ae9bba7d service nova] Creating event network-changed:6c93023e-5a56-4e67-89ee-7c18d38a071f for instance 48a2ef84-6477-44cd-a1f6-bac51ae67fa4 on hv-cinder-80070 Oct 27 15:43:27.279398 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [req-01cc871a-b5c2-40c0-8152-ae4ad08d7076 req-5b313e2e-4543-4dd9-a10a-90b0ae9bba7d service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082691 Oct 27 15:43:27.284272 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 89/149] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Oct 27 15:43:27 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 15:43:27.348774 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-04eec981-5d9b-4486-95c1-d38c1eddebdb tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:43:27.349777 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-04eec981-5d9b-4486-95c1-d38c1eddebdb tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: bced4f24-572a-4316-97e8-3ceedc61a621] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:43:27.357244 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-04eec981-5d9b-4486-95c1-d38c1eddebdb tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:43:27.358584 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-04eec981-5d9b-4486-95c1-d38c1eddebdb tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:43:27.359725 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-04eec981-5d9b-4486-95c1-d38c1eddebdb tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:43:27.360484 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-04eec981-5d9b-4486-95c1-d38c1eddebdb tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:43:27.399748 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-9cc224da-99d8-4f5a-aec0-d9aaec22c680 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 15:43:27.402280 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-9cc224da-99d8-4f5a-aec0-d9aaec22c680 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:43:27.425753 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-9cc224da-99d8-4f5a-aec0-d9aaec22c680 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:43:27.428186 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-9cc224da-99d8-4f5a-aec0-d9aaec22c680 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:43:27.430220 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-9cc224da-99d8-4f5a-aec0-d9aaec22c680 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:43:27.430669 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-9cc224da-99d8-4f5a-aec0-d9aaec22c680 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:43:27.545069 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-9cc224da-99d8-4f5a-aec0-d9aaec22c680 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "POST /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672/action" status: 200 len: 14 microversion: 2.20 time: 0.151323 Oct 27 15:43:27.547879 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 90/150] 10.222.0.64 () {62 vars in 1318 bytes} [Wed Oct 27 15:43:27 2021] POST /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672/action => generated 14 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 15:43:27.843000 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-9b1d903c-9c36-4500-90b4-482108bc6913 tempest-VolumesActionsTest-1850781407 tempest-VolumesActionsTest-1850781407-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:43:27.843837 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-9b1d903c-9c36-4500-90b4-482108bc6913 tempest-VolumesActionsTest-1850781407 tempest-VolumesActionsTest-1850781407-project] [instance: 48a2ef84-6477-44cd-a1f6-bac51ae67fa4] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:43:27.851206 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-9b1d903c-9c36-4500-90b4-482108bc6913 tempest-VolumesActionsTest-1850781407 tempest-VolumesActionsTest-1850781407-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:43:27.851635 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-9b1d903c-9c36-4500-90b4-482108bc6913 tempest-VolumesActionsTest-1850781407 tempest-VolumesActionsTest-1850781407-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:43:27.852417 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-9b1d903c-9c36-4500-90b4-482108bc6913 tempest-VolumesActionsTest-1850781407 tempest-VolumesActionsTest-1850781407-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:43:27.852842 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-9b1d903c-9c36-4500-90b4-482108bc6913 tempest-VolumesActionsTest-1850781407 tempest-VolumesActionsTest-1850781407-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:43:27.907034 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-04eec981-5d9b-4486-95c1-d38c1eddebdb tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96b599f8890b4281a7e311cf37a039e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d7fcab5d3f465793d650f16c6ea8de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:43:27.921470 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-04eec981-5d9b-4486-95c1-d38c1eddebdb tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/bced4f24-572a-4316-97e8-3ceedc61a621" status: 200 len: 1520 microversion: 2.1 time: 0.574350 Oct 27 15:43:27.927001 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 61/151] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:43:27 2021] GET /compute/v2.1/servers/bced4f24-572a-4316-97e8-3ceedc61a621 => generated 1520 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 15:43:28.050309 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-9b1d903c-9c36-4500-90b4-482108bc6913 tempest-VolumesActionsTest-1850781407 tempest-VolumesActionsTest-1850781407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f44b5c1ad2204da1935d8cb7ea8bc67e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eef06dd988f343e7ae8ccf2c93217e9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:43:28.058365 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-9b1d903c-9c36-4500-90b4-482108bc6913 tempest-VolumesActionsTest-1850781407 tempest-VolumesActionsTest-1850781407-project] 10.222.0.64 "GET /compute/v2.1/servers/48a2ef84-6477-44cd-a1f6-bac51ae67fa4" status: 200 len: 1314 microversion: 2.1 time: 0.219516 Oct 27 15:43:28.059836 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 91/152] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:43:27 2021] GET /compute/v2.1/servers/48a2ef84-6477-44cd-a1f6-bac51ae67fa4 => generated 1314 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 15:43:28.556788 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-5b07607a-6a55-44de-8cfb-949a72dc84b0 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 15:43:28.557810 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-5b07607a-6a55-44de-8cfb-949a72dc84b0 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:43:28.565224 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-5b07607a-6a55-44de-8cfb-949a72dc84b0 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:43:28.565830 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-5b07607a-6a55-44de-8cfb-949a72dc84b0 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:43:28.566715 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-5b07607a-6a55-44de-8cfb-949a72dc84b0 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:43:28.567482 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-5b07607a-6a55-44de-8cfb-949a72dc84b0 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:43:28.662466 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-5b07607a-6a55-44de-8cfb-949a72dc84b0 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "POST /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672/action" status: 200 len: 14 microversion: 2.20 time: 0.109255 Oct 27 15:43:28.663882 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 62/153] 10.222.0.64 () {62 vars in 1318 bytes} [Wed Oct 27 15:43:28 2021] POST /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672/action => generated 14 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 15:43:28.942908 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-e830a037-eaff-4ef8-a584-14474dffa95a tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:43:28.943713 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-e830a037-eaff-4ef8-a584-14474dffa95a tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: bced4f24-572a-4316-97e8-3ceedc61a621] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:43:28.950092 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-e830a037-eaff-4ef8-a584-14474dffa95a tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:43:28.950693 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-e830a037-eaff-4ef8-a584-14474dffa95a tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:43:28.951628 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-e830a037-eaff-4ef8-a584-14474dffa95a tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:43:28.952093 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-e830a037-eaff-4ef8-a584-14474dffa95a tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:43:29.077072 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-c27fe2d1-b189-4565-a277-7fc451670084 tempest-VolumesActionsTest-1850781407 tempest-VolumesActionsTest-1850781407-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:43:29.077938 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-c27fe2d1-b189-4565-a277-7fc451670084 tempest-VolumesActionsTest-1850781407 tempest-VolumesActionsTest-1850781407-project] [instance: 48a2ef84-6477-44cd-a1f6-bac51ae67fa4] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:43:29.080982 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-e830a037-eaff-4ef8-a584-14474dffa95a tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96b599f8890b4281a7e311cf37a039e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d7fcab5d3f465793d650f16c6ea8de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:43:29.087583 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-c27fe2d1-b189-4565-a277-7fc451670084 tempest-VolumesActionsTest-1850781407 tempest-VolumesActionsTest-1850781407-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:43:29.088460 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-c27fe2d1-b189-4565-a277-7fc451670084 tempest-VolumesActionsTest-1850781407 tempest-VolumesActionsTest-1850781407-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:43:29.089235 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-e830a037-eaff-4ef8-a584-14474dffa95a tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/bced4f24-572a-4316-97e8-3ceedc61a621" status: 200 len: 1520 microversion: 2.1 time: 0.150465 Oct 27 15:43:29.089660 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-c27fe2d1-b189-4565-a277-7fc451670084 tempest-VolumesActionsTest-1850781407 tempest-VolumesActionsTest-1850781407-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:43:29.090128 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-c27fe2d1-b189-4565-a277-7fc451670084 tempest-VolumesActionsTest-1850781407 tempest-VolumesActionsTest-1850781407-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:43:29.100157 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 92/154] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:43:28 2021] GET /compute/v2.1/servers/bced4f24-572a-4316-97e8-3ceedc61a621 => generated 1520 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 15:43:29.227198 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-c27fe2d1-b189-4565-a277-7fc451670084 tempest-VolumesActionsTest-1850781407 tempest-VolumesActionsTest-1850781407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f44b5c1ad2204da1935d8cb7ea8bc67e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eef06dd988f343e7ae8ccf2c93217e9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:43:29.234649 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-c27fe2d1-b189-4565-a277-7fc451670084 tempest-VolumesActionsTest-1850781407 tempest-VolumesActionsTest-1850781407-project] 10.222.0.64 "GET /compute/v2.1/servers/48a2ef84-6477-44cd-a1f6-bac51ae67fa4" status: 200 len: 1314 microversion: 2.1 time: 0.161747 Oct 27 15:43:29.235314 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 63/155] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:43:29 2021] GET /compute/v2.1/servers/48a2ef84-6477-44cd-a1f6-bac51ae67fa4 => generated 1314 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 15:43:29.672778 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-34a02f04-3288-489a-8114-a7fe70b84ff1 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 15:43:29.673806 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-34a02f04-3288-489a-8114-a7fe70b84ff1 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:43:29.680228 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-34a02f04-3288-489a-8114-a7fe70b84ff1 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:43:29.680668 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-34a02f04-3288-489a-8114-a7fe70b84ff1 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:43:29.681432 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-34a02f04-3288-489a-8114-a7fe70b84ff1 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:43:29.681932 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-34a02f04-3288-489a-8114-a7fe70b84ff1 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:43:29.768408 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-34a02f04-3288-489a-8114-a7fe70b84ff1 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "POST /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672/action" status: 200 len: 14 microversion: 2.20 time: 0.099025 Oct 27 15:43:29.769317 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 93/156] 10.222.0.64 () {62 vars in 1318 bytes} [Wed Oct 27 15:43:29 2021] POST /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672/action => generated 14 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 15:43:30.106838 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-7565098c-db91-4c5c-9772-8b91d23cefa3 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:43:30.107569 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-7565098c-db91-4c5c-9772-8b91d23cefa3 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: bced4f24-572a-4316-97e8-3ceedc61a621] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:43:30.114344 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-7565098c-db91-4c5c-9772-8b91d23cefa3 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:43:30.114896 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-7565098c-db91-4c5c-9772-8b91d23cefa3 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:43:30.115739 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-7565098c-db91-4c5c-9772-8b91d23cefa3 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:43:30.116338 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-7565098c-db91-4c5c-9772-8b91d23cefa3 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:43:30.252316 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-4fd423ff-9c3c-4dfc-99bd-aa7ca0d91ff6 tempest-VolumesActionsTest-1850781407 tempest-VolumesActionsTest-1850781407-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:43:30.253008 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-4fd423ff-9c3c-4dfc-99bd-aa7ca0d91ff6 tempest-VolumesActionsTest-1850781407 tempest-VolumesActionsTest-1850781407-project] [instance: 48a2ef84-6477-44cd-a1f6-bac51ae67fa4] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:43:30.260322 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-4fd423ff-9c3c-4dfc-99bd-aa7ca0d91ff6 tempest-VolumesActionsTest-1850781407 tempest-VolumesActionsTest-1850781407-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:43:30.260765 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-4fd423ff-9c3c-4dfc-99bd-aa7ca0d91ff6 tempest-VolumesActionsTest-1850781407 tempest-VolumesActionsTest-1850781407-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:43:30.261529 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-4fd423ff-9c3c-4dfc-99bd-aa7ca0d91ff6 tempest-VolumesActionsTest-1850781407 tempest-VolumesActionsTest-1850781407-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:43:30.261956 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-4fd423ff-9c3c-4dfc-99bd-aa7ca0d91ff6 tempest-VolumesActionsTest-1850781407 tempest-VolumesActionsTest-1850781407-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:43:30.364346 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-7565098c-db91-4c5c-9772-8b91d23cefa3 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96b599f8890b4281a7e311cf37a039e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d7fcab5d3f465793d650f16c6ea8de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:43:30.372773 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-7565098c-db91-4c5c-9772-8b91d23cefa3 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/bced4f24-572a-4316-97e8-3ceedc61a621" status: 200 len: 1520 microversion: 2.1 time: 0.269788 Oct 27 15:43:30.373559 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 64/157] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:43:30 2021] GET /compute/v2.1/servers/bced4f24-572a-4316-97e8-3ceedc61a621 => generated 1520 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 15:43:30.394533 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-4fd423ff-9c3c-4dfc-99bd-aa7ca0d91ff6 tempest-VolumesActionsTest-1850781407 tempest-VolumesActionsTest-1850781407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f44b5c1ad2204da1935d8cb7ea8bc67e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eef06dd988f343e7ae8ccf2c93217e9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:43:30.401643 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-4fd423ff-9c3c-4dfc-99bd-aa7ca0d91ff6 tempest-VolumesActionsTest-1850781407 tempest-VolumesActionsTest-1850781407-project] 10.222.0.64 "GET /compute/v2.1/servers/48a2ef84-6477-44cd-a1f6-bac51ae67fa4" status: 200 len: 1314 microversion: 2.1 time: 0.154139 Oct 27 15:43:30.411834 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 94/158] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:43:30 2021] GET /compute/v2.1/servers/48a2ef84-6477-44cd-a1f6-bac51ae67fa4 => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 15:43:30.781016 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-fb50f8ba-4566-4f02-ac03-685c1dcc87e1 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 15:43:30.782953 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-fb50f8ba-4566-4f02-ac03-685c1dcc87e1 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:43:30.794455 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-fb50f8ba-4566-4f02-ac03-685c1dcc87e1 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:43:30.796340 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-fb50f8ba-4566-4f02-ac03-685c1dcc87e1 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:43:30.803073 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-fb50f8ba-4566-4f02-ac03-685c1dcc87e1 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:43:30.804441 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-fb50f8ba-4566-4f02-ac03-685c1dcc87e1 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:43:30.972348 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-fb50f8ba-4566-4f02-ac03-685c1dcc87e1 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "POST /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672/action" status: 200 len: 14 microversion: 2.20 time: 0.196210 Oct 27 15:43:30.973035 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 65/159] 10.222.0.64 () {62 vars in 1318 bytes} [Wed Oct 27 15:43:30 2021] POST /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672/action => generated 14 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 15:43:31.390132 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-c96265b2-a9bf-4093-8778-59d358360a5b tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:43:31.390836 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-c96265b2-a9bf-4093-8778-59d358360a5b tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: bced4f24-572a-4316-97e8-3ceedc61a621] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:43:31.398041 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-c96265b2-a9bf-4093-8778-59d358360a5b tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:43:31.398488 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-c96265b2-a9bf-4093-8778-59d358360a5b tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:43:31.399448 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-c96265b2-a9bf-4093-8778-59d358360a5b tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:43:31.400175 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-c96265b2-a9bf-4093-8778-59d358360a5b tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:43:31.418868 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-0ddaa998-6913-4a6b-a8cd-3daea0a09a5c tempest-VolumesActionsTest-1850781407 tempest-VolumesActionsTest-1850781407-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:43:31.419569 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-0ddaa998-6913-4a6b-a8cd-3daea0a09a5c tempest-VolumesActionsTest-1850781407 tempest-VolumesActionsTest-1850781407-project] [instance: 48a2ef84-6477-44cd-a1f6-bac51ae67fa4] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:43:31.426741 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-0ddaa998-6913-4a6b-a8cd-3daea0a09a5c tempest-VolumesActionsTest-1850781407 tempest-VolumesActionsTest-1850781407-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:43:31.427273 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-0ddaa998-6913-4a6b-a8cd-3daea0a09a5c tempest-VolumesActionsTest-1850781407 tempest-VolumesActionsTest-1850781407-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:43:31.428295 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-0ddaa998-6913-4a6b-a8cd-3daea0a09a5c tempest-VolumesActionsTest-1850781407 tempest-VolumesActionsTest-1850781407-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:43:31.428856 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-0ddaa998-6913-4a6b-a8cd-3daea0a09a5c tempest-VolumesActionsTest-1850781407 tempest-VolumesActionsTest-1850781407-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:43:31.553995 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-c96265b2-a9bf-4093-8778-59d358360a5b tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96b599f8890b4281a7e311cf37a039e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d7fcab5d3f465793d650f16c6ea8de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:43:31.565977 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-c96265b2-a9bf-4093-8778-59d358360a5b tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/bced4f24-572a-4316-97e8-3ceedc61a621" status: 200 len: 1520 microversion: 2.1 time: 0.178817 Oct 27 15:43:31.566901 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 95/160] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:43:31 2021] GET /compute/v2.1/servers/bced4f24-572a-4316-97e8-3ceedc61a621 => generated 1520 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 15:43:31.582927 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-0ddaa998-6913-4a6b-a8cd-3daea0a09a5c tempest-VolumesActionsTest-1850781407 tempest-VolumesActionsTest-1850781407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f44b5c1ad2204da1935d8cb7ea8bc67e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eef06dd988f343e7ae8ccf2c93217e9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:43:31.590439 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-0ddaa998-6913-4a6b-a8cd-3daea0a09a5c tempest-VolumesActionsTest-1850781407 tempest-VolumesActionsTest-1850781407-project] 10.222.0.64 "GET /compute/v2.1/servers/48a2ef84-6477-44cd-a1f6-bac51ae67fa4" status: 200 len: 1314 microversion: 2.1 time: 0.175625 Oct 27 15:43:31.592491 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 66/161] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:43:31 2021] GET /compute/v2.1/servers/48a2ef84-6477-44cd-a1f6-bac51ae67fa4 => generated 1314 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 15:43:31.983578 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-2c1a67e8-ee37-470f-9576-fce8b1bdb2fd tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 15:43:31.984517 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-2c1a67e8-ee37-470f-9576-fce8b1bdb2fd tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:43:31.990691 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-2c1a67e8-ee37-470f-9576-fce8b1bdb2fd tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:43:31.991118 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-2c1a67e8-ee37-470f-9576-fce8b1bdb2fd tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:43:31.991904 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-2c1a67e8-ee37-470f-9576-fce8b1bdb2fd tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:43:31.992521 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-2c1a67e8-ee37-470f-9576-fce8b1bdb2fd tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:43:32.103061 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-2c1a67e8-ee37-470f-9576-fce8b1bdb2fd tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "POST /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672/action" status: 200 len: 14 microversion: 2.20 time: 0.122983 Oct 27 15:43:32.103719 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 96/162] 10.222.0.64 () {62 vars in 1318 bytes} [Wed Oct 27 15:43:31 2021] POST /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672/action => generated 14 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 15:43:32.352800 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-87fa0d70-95e6-4ddb-8d54-479d57f0eb9e tempest-DeleteServersTestJSON-752571955 tempest-DeleteServersTestJSON-752571955-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:43:32.353310 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-87fa0d70-95e6-4ddb-8d54-479d57f0eb9e tempest-DeleteServersTestJSON-752571955 tempest-DeleteServersTestJSON-752571955-project] [instance: 6cc17348-b41d-46ba-a1d6-9f80614b7596] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:43:32.359494 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-87fa0d70-95e6-4ddb-8d54-479d57f0eb9e tempest-DeleteServersTestJSON-752571955 tempest-DeleteServersTestJSON-752571955-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:43:32.360060 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-87fa0d70-95e6-4ddb-8d54-479d57f0eb9e tempest-DeleteServersTestJSON-752571955 tempest-DeleteServersTestJSON-752571955-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:43:32.361306 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-87fa0d70-95e6-4ddb-8d54-479d57f0eb9e tempest-DeleteServersTestJSON-752571955 tempest-DeleteServersTestJSON-752571955-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:43:32.361931 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-87fa0d70-95e6-4ddb-8d54-479d57f0eb9e tempest-DeleteServersTestJSON-752571955 tempest-DeleteServersTestJSON-752571955-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:43:32.387240 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-87fa0d70-95e6-4ddb-8d54-479d57f0eb9e tempest-DeleteServersTestJSON-752571955 tempest-DeleteServersTestJSON-752571955-project] [instance: 6cc17348-b41d-46ba-a1d6-9f80614b7596] Going to try to terminate instance {{(pid=122225) delete /opt/stack/nova/nova/compute/api.py:2612}} Oct 27 15:43:32.479880 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-87fa0d70-95e6-4ddb-8d54-479d57f0eb9e tempest-DeleteServersTestJSON-752571955 tempest-DeleteServersTestJSON-752571955-project] 10.222.0.64 "DELETE /compute/v2.1/servers/6cc17348-b41d-46ba-a1d6-9f80614b7596" status: 204 len: 0 microversion: 2.1 time: 0.136892 Oct 27 15:43:32.480487 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 67/163] 10.222.0.64 () {58 vars in 1238 bytes} [Wed Oct 27 15:43:32 2021] DELETE /compute/v2.1/servers/6cc17348-b41d-46ba-a1d6-9f80614b7596 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 15:43:32.489810 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-3241395d-b664-4da2-ac60-e590026cac41 tempest-DeleteServersTestJSON-752571955 tempest-DeleteServersTestJSON-752571955-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:43:32.490499 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-3241395d-b664-4da2-ac60-e590026cac41 tempest-DeleteServersTestJSON-752571955 tempest-DeleteServersTestJSON-752571955-project] [instance: 6cc17348-b41d-46ba-a1d6-9f80614b7596] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:43:32.497764 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-3241395d-b664-4da2-ac60-e590026cac41 tempest-DeleteServersTestJSON-752571955 tempest-DeleteServersTestJSON-752571955-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:43:32.498206 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-3241395d-b664-4da2-ac60-e590026cac41 tempest-DeleteServersTestJSON-752571955 tempest-DeleteServersTestJSON-752571955-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:43:32.498969 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-3241395d-b664-4da2-ac60-e590026cac41 tempest-DeleteServersTestJSON-752571955 tempest-DeleteServersTestJSON-752571955-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:43:32.499404 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-3241395d-b664-4da2-ac60-e590026cac41 tempest-DeleteServersTestJSON-752571955 tempest-DeleteServersTestJSON-752571955-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:43:32.584139 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-d4f437d5-5498-4f86-85fe-cad1024c5ccb tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:43:32.584853 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-d4f437d5-5498-4f86-85fe-cad1024c5ccb tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: bced4f24-572a-4316-97e8-3ceedc61a621] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:43:32.591161 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-d4f437d5-5498-4f86-85fe-cad1024c5ccb tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:43:32.591603 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-d4f437d5-5498-4f86-85fe-cad1024c5ccb tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:43:32.592638 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-d4f437d5-5498-4f86-85fe-cad1024c5ccb tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:43:32.593070 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-d4f437d5-5498-4f86-85fe-cad1024c5ccb tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:43:32.634898 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-3241395d-b664-4da2-ac60-e590026cac41 tempest-DeleteServersTestJSON-752571955 tempest-DeleteServersTestJSON-752571955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf1a0e4ab3ab4008a25339e4eda7a48d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be9d7084d7ab4e408be53dd27f8748a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:43:32.644106 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-3241395d-b664-4da2-ac60-e590026cac41 tempest-DeleteServersTestJSON-752571955 tempest-DeleteServersTestJSON-752571955-project] 10.222.0.64 "GET /compute/v2.1/servers/6cc17348-b41d-46ba-a1d6-9f80614b7596" status: 200 len: 1554 microversion: 2.1 time: 0.159081 Oct 27 15:43:32.645287 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 97/164] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:43:32 2021] GET /compute/v2.1/servers/6cc17348-b41d-46ba-a1d6-9f80614b7596 => generated 1554 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 15:43:32.651340 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-6ab5a37b-4da9-4488-b66a-1ab5e79d9e90 tempest-VolumesActionsTest-1850781407 tempest-VolumesActionsTest-1850781407-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:43:32.652170 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-6ab5a37b-4da9-4488-b66a-1ab5e79d9e90 tempest-VolumesActionsTest-1850781407 tempest-VolumesActionsTest-1850781407-project] [instance: 48a2ef84-6477-44cd-a1f6-bac51ae67fa4] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:43:32.659530 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-6ab5a37b-4da9-4488-b66a-1ab5e79d9e90 tempest-VolumesActionsTest-1850781407 tempest-VolumesActionsTest-1850781407-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:43:32.660386 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-6ab5a37b-4da9-4488-b66a-1ab5e79d9e90 tempest-VolumesActionsTest-1850781407 tempest-VolumesActionsTest-1850781407-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:43:32.661170 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-6ab5a37b-4da9-4488-b66a-1ab5e79d9e90 tempest-VolumesActionsTest-1850781407 tempest-VolumesActionsTest-1850781407-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:43:32.661610 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-6ab5a37b-4da9-4488-b66a-1ab5e79d9e90 tempest-VolumesActionsTest-1850781407 tempest-VolumesActionsTest-1850781407-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:43:32.722943 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-d4f437d5-5498-4f86-85fe-cad1024c5ccb tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96b599f8890b4281a7e311cf37a039e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d7fcab5d3f465793d650f16c6ea8de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:43:32.732110 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-d4f437d5-5498-4f86-85fe-cad1024c5ccb tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/bced4f24-572a-4316-97e8-3ceedc61a621" status: 200 len: 1520 microversion: 2.1 time: 0.152960 Oct 27 15:43:32.732780 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 68/165] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:43:32 2021] GET /compute/v2.1/servers/bced4f24-572a-4316-97e8-3ceedc61a621 => generated 1520 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 15:43:32.811757 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-6ab5a37b-4da9-4488-b66a-1ab5e79d9e90 tempest-VolumesActionsTest-1850781407 tempest-VolumesActionsTest-1850781407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f44b5c1ad2204da1935d8cb7ea8bc67e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eef06dd988f343e7ae8ccf2c93217e9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:43:32.819868 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-6ab5a37b-4da9-4488-b66a-1ab5e79d9e90 tempest-VolumesActionsTest-1850781407 tempest-VolumesActionsTest-1850781407-project] 10.222.0.64 "GET /compute/v2.1/servers/48a2ef84-6477-44cd-a1f6-bac51ae67fa4" status: 200 len: 1314 microversion: 2.1 time: 0.172795 Oct 27 15:43:32.825916 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 98/166] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:43:32 2021] GET /compute/v2.1/servers/48a2ef84-6477-44cd-a1f6-bac51ae67fa4 => generated 1314 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 15:43:33.114301 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-cbce8a27-0e05-4a9b-bb5d-31ad01b9f4aa tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 15:43:33.115192 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-cbce8a27-0e05-4a9b-bb5d-31ad01b9f4aa tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:43:33.121381 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-cbce8a27-0e05-4a9b-bb5d-31ad01b9f4aa tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:43:33.121822 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-cbce8a27-0e05-4a9b-bb5d-31ad01b9f4aa tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:43:33.122578 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-cbce8a27-0e05-4a9b-bb5d-31ad01b9f4aa tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:43:33.123007 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-cbce8a27-0e05-4a9b-bb5d-31ad01b9f4aa tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:43:33.206129 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-cbce8a27-0e05-4a9b-bb5d-31ad01b9f4aa tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "POST /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672/action" status: 200 len: 14 microversion: 2.20 time: 0.096012 Oct 27 15:43:33.206761 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 69/167] 10.222.0.64 () {62 vars in 1318 bytes} [Wed Oct 27 15:43:33 2021] POST /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672/action => generated 14 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 15:43:33.662240 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-dbfcecad-7d48-467b-83f1-03b9fb7f1b9d tempest-DeleteServersTestJSON-752571955 tempest-DeleteServersTestJSON-752571955-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:43:33.662769 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-dbfcecad-7d48-467b-83f1-03b9fb7f1b9d tempest-DeleteServersTestJSON-752571955 tempest-DeleteServersTestJSON-752571955-project] [instance: 6cc17348-b41d-46ba-a1d6-9f80614b7596] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:43:33.668816 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-dbfcecad-7d48-467b-83f1-03b9fb7f1b9d tempest-DeleteServersTestJSON-752571955 tempest-DeleteServersTestJSON-752571955-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:43:33.669252 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-dbfcecad-7d48-467b-83f1-03b9fb7f1b9d tempest-DeleteServersTestJSON-752571955 tempest-DeleteServersTestJSON-752571955-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:43:33.670000 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-dbfcecad-7d48-467b-83f1-03b9fb7f1b9d tempest-DeleteServersTestJSON-752571955 tempest-DeleteServersTestJSON-752571955-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:43:33.670429 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-dbfcecad-7d48-467b-83f1-03b9fb7f1b9d tempest-DeleteServersTestJSON-752571955 tempest-DeleteServersTestJSON-752571955-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:43:33.751587 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-6c870094-9e70-4559-a81c-596b9e977e99 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:43:33.752557 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-6c870094-9e70-4559-a81c-596b9e977e99 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: bced4f24-572a-4316-97e8-3ceedc61a621] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:43:33.759429 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-6c870094-9e70-4559-a81c-596b9e977e99 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:43:33.759881 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-6c870094-9e70-4559-a81c-596b9e977e99 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:43:33.760697 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-6c870094-9e70-4559-a81c-596b9e977e99 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:43:33.761130 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-6c870094-9e70-4559-a81c-596b9e977e99 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:43:33.819560 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-dbfcecad-7d48-467b-83f1-03b9fb7f1b9d tempest-DeleteServersTestJSON-752571955 tempest-DeleteServersTestJSON-752571955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf1a0e4ab3ab4008a25339e4eda7a48d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be9d7084d7ab4e408be53dd27f8748a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:43:33.827912 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-dbfcecad-7d48-467b-83f1-03b9fb7f1b9d tempest-DeleteServersTestJSON-752571955 tempest-DeleteServersTestJSON-752571955-project] 10.222.0.64 "GET /compute/v2.1/servers/6cc17348-b41d-46ba-a1d6-9f80614b7596" status: 200 len: 1554 microversion: 2.1 time: 0.170481 Oct 27 15:43:33.828660 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 99/168] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:43:33 2021] GET /compute/v2.1/servers/6cc17348-b41d-46ba-a1d6-9f80614b7596 => generated 1554 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 15:43:33.836214 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-8f6bba06-1f5c-4676-9c9a-faf01a5e6151 tempest-VolumesActionsTest-1850781407 tempest-VolumesActionsTest-1850781407-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:43:33.837011 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-8f6bba06-1f5c-4676-9c9a-faf01a5e6151 tempest-VolumesActionsTest-1850781407 tempest-VolumesActionsTest-1850781407-project] [instance: 48a2ef84-6477-44cd-a1f6-bac51ae67fa4] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:43:33.843009 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-8f6bba06-1f5c-4676-9c9a-faf01a5e6151 tempest-VolumesActionsTest-1850781407 tempest-VolumesActionsTest-1850781407-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:43:33.843464 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-8f6bba06-1f5c-4676-9c9a-faf01a5e6151 tempest-VolumesActionsTest-1850781407 tempest-VolumesActionsTest-1850781407-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:43:33.844254 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-8f6bba06-1f5c-4676-9c9a-faf01a5e6151 tempest-VolumesActionsTest-1850781407 tempest-VolumesActionsTest-1850781407-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:43:33.844685 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-8f6bba06-1f5c-4676-9c9a-faf01a5e6151 tempest-VolumesActionsTest-1850781407 tempest-VolumesActionsTest-1850781407-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:43:33.894620 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-6c870094-9e70-4559-a81c-596b9e977e99 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96b599f8890b4281a7e311cf37a039e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d7fcab5d3f465793d650f16c6ea8de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:43:33.901770 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-6c870094-9e70-4559-a81c-596b9e977e99 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/bced4f24-572a-4316-97e8-3ceedc61a621" status: 200 len: 1520 microversion: 2.1 time: 0.155601 Oct 27 15:43:33.902334 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 70/169] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:43:33 2021] GET /compute/v2.1/servers/bced4f24-572a-4316-97e8-3ceedc61a621 => generated 1520 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 15:43:33.975658 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-8f6bba06-1f5c-4676-9c9a-faf01a5e6151 tempest-VolumesActionsTest-1850781407 tempest-VolumesActionsTest-1850781407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f44b5c1ad2204da1935d8cb7ea8bc67e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eef06dd988f343e7ae8ccf2c93217e9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:43:33.982792 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-8f6bba06-1f5c-4676-9c9a-faf01a5e6151 tempest-VolumesActionsTest-1850781407 tempest-VolumesActionsTest-1850781407-project] 10.222.0.64 "GET /compute/v2.1/servers/48a2ef84-6477-44cd-a1f6-bac51ae67fa4" status: 200 len: 1314 microversion: 2.1 time: 0.150037 Oct 27 15:43:33.983355 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 100/170] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:43:33 2021] GET /compute/v2.1/servers/48a2ef84-6477-44cd-a1f6-bac51ae67fa4 => generated 1314 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 15:43:34.220840 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-f305d5d5-c390-4226-9310-83f6c30e6970 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 15:43:34.221827 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-f305d5d5-c390-4226-9310-83f6c30e6970 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:43:34.229596 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-f305d5d5-c390-4226-9310-83f6c30e6970 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:43:34.230041 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-f305d5d5-c390-4226-9310-83f6c30e6970 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:43:34.230833 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-f305d5d5-c390-4226-9310-83f6c30e6970 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:43:34.231260 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-f305d5d5-c390-4226-9310-83f6c30e6970 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:43:34.320266 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-f305d5d5-c390-4226-9310-83f6c30e6970 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "POST /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672/action" status: 200 len: 14 microversion: 2.20 time: 0.106705 Oct 27 15:43:34.323422 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 71/171] 10.222.0.64 () {62 vars in 1318 bytes} [Wed Oct 27 15:43:34 2021] POST /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672/action => generated 14 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 15:43:34.759891 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [req-c5cce224-e721-4d88-9b89-facce696a222 req-eb06bd70-db5a-4c50-ab4c-6b82380958c5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "48a2ef84-6477-44cd-a1f6-bac51ae67fa4", "name": "network-vif-plugged", "status": "completed", "tag": "6c93023e-5a56-4e67-89ee-7c18d38a071f"}]} {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 15:43:34.762194 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 27 15:43:34.762194 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: warnings.warn(msg) Oct 27 15:43:34.770914 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [req-c5cce224-e721-4d88-9b89-facce696a222 req-eb06bd70-db5a-4c50-ab4c-6b82380958c5 service nova] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:43:34.771594 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [req-c5cce224-e721-4d88-9b89-facce696a222 req-eb06bd70-db5a-4c50-ab4c-6b82380958c5 service nova] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:43:34.784686 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.compute.server_external_events [req-c5cce224-e721-4d88-9b89-facce696a222 req-eb06bd70-db5a-4c50-ab4c-6b82380958c5 service nova] Creating event network-vif-plugged:6c93023e-5a56-4e67-89ee-7c18d38a071f for instance 48a2ef84-6477-44cd-a1f6-bac51ae67fa4 on hv-cinder-80070 Oct 27 15:43:34.789753 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [req-c5cce224-e721-4d88-9b89-facce696a222 req-eb06bd70-db5a-4c50-ab4c-6b82380958c5 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033626 Oct 27 15:43:34.791019 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 101/172] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Oct 27 15:43:34 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 15:43:34.846526 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-d2d3937a-0a9e-4036-8130-2c9390e01c54 tempest-DeleteServersTestJSON-752571955 tempest-DeleteServersTestJSON-752571955-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:43:34.847207 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-d2d3937a-0a9e-4036-8130-2c9390e01c54 tempest-DeleteServersTestJSON-752571955 tempest-DeleteServersTestJSON-752571955-project] [instance: 6cc17348-b41d-46ba-a1d6-9f80614b7596] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:43:34.854239 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-d2d3937a-0a9e-4036-8130-2c9390e01c54 tempest-DeleteServersTestJSON-752571955 tempest-DeleteServersTestJSON-752571955-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:43:34.854679 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-d2d3937a-0a9e-4036-8130-2c9390e01c54 tempest-DeleteServersTestJSON-752571955 tempest-DeleteServersTestJSON-752571955-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:43:34.855421 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-d2d3937a-0a9e-4036-8130-2c9390e01c54 tempest-DeleteServersTestJSON-752571955 tempest-DeleteServersTestJSON-752571955-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:43:34.855843 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-d2d3937a-0a9e-4036-8130-2c9390e01c54 tempest-DeleteServersTestJSON-752571955 tempest-DeleteServersTestJSON-752571955-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:43:34.921629 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-842c8e30-bff7-4271-ac6a-9eca59695ef7 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:43:34.923716 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-842c8e30-bff7-4271-ac6a-9eca59695ef7 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: bced4f24-572a-4316-97e8-3ceedc61a621] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:43:34.933027 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-842c8e30-bff7-4271-ac6a-9eca59695ef7 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:43:34.933481 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-842c8e30-bff7-4271-ac6a-9eca59695ef7 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:43:34.934272 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-842c8e30-bff7-4271-ac6a-9eca59695ef7 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:43:34.934708 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-842c8e30-bff7-4271-ac6a-9eca59695ef7 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:43:35.006573 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-d2d3937a-0a9e-4036-8130-2c9390e01c54 tempest-DeleteServersTestJSON-752571955 tempest-DeleteServersTestJSON-752571955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf1a0e4ab3ab4008a25339e4eda7a48d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be9d7084d7ab4e408be53dd27f8748a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:43:35.018375 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-d2d3937a-0a9e-4036-8130-2c9390e01c54 tempest-DeleteServersTestJSON-752571955 tempest-DeleteServersTestJSON-752571955-project] 10.222.0.64 "GET /compute/v2.1/servers/6cc17348-b41d-46ba-a1d6-9f80614b7596" status: 200 len: 1554 microversion: 2.1 time: 0.175524 Oct 27 15:43:35.019251 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 72/173] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:43:34 2021] GET /compute/v2.1/servers/6cc17348-b41d-46ba-a1d6-9f80614b7596 => generated 1554 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 15:43:35.029929 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-cdcf4bf6-b505-48a0-9a0f-a2ca14d7207c tempest-VolumesActionsTest-1850781407 tempest-VolumesActionsTest-1850781407-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:43:35.030679 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-cdcf4bf6-b505-48a0-9a0f-a2ca14d7207c tempest-VolumesActionsTest-1850781407 tempest-VolumesActionsTest-1850781407-project] [instance: 48a2ef84-6477-44cd-a1f6-bac51ae67fa4] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:43:35.041399 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-cdcf4bf6-b505-48a0-9a0f-a2ca14d7207c tempest-VolumesActionsTest-1850781407 tempest-VolumesActionsTest-1850781407-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:43:35.042459 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-cdcf4bf6-b505-48a0-9a0f-a2ca14d7207c tempest-VolumesActionsTest-1850781407 tempest-VolumesActionsTest-1850781407-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:43:35.043238 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-cdcf4bf6-b505-48a0-9a0f-a2ca14d7207c tempest-VolumesActionsTest-1850781407 tempest-VolumesActionsTest-1850781407-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:43:35.044242 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-cdcf4bf6-b505-48a0-9a0f-a2ca14d7207c tempest-VolumesActionsTest-1850781407 tempest-VolumesActionsTest-1850781407-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:43:35.149034 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-842c8e30-bff7-4271-ac6a-9eca59695ef7 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96b599f8890b4281a7e311cf37a039e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d7fcab5d3f465793d650f16c6ea8de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:43:35.156425 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-842c8e30-bff7-4271-ac6a-9eca59695ef7 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/bced4f24-572a-4316-97e8-3ceedc61a621" status: 200 len: 1520 microversion: 2.1 time: 0.240828 Oct 27 15:43:35.157002 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 102/174] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:43:34 2021] GET /compute/v2.1/servers/bced4f24-572a-4316-97e8-3ceedc61a621 => generated 1520 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 15:43:35.189711 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-cdcf4bf6-b505-48a0-9a0f-a2ca14d7207c tempest-VolumesActionsTest-1850781407 tempest-VolumesActionsTest-1850781407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f44b5c1ad2204da1935d8cb7ea8bc67e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eef06dd988f343e7ae8ccf2c93217e9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:43:35.197845 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-cdcf4bf6-b505-48a0-9a0f-a2ca14d7207c tempest-VolumesActionsTest-1850781407 tempest-VolumesActionsTest-1850781407-project] 10.222.0.64 "GET /compute/v2.1/servers/48a2ef84-6477-44cd-a1f6-bac51ae67fa4" status: 200 len: 1314 microversion: 2.1 time: 0.177169 Oct 27 15:43:35.198654 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 73/175] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:43:35 2021] GET /compute/v2.1/servers/48a2ef84-6477-44cd-a1f6-bac51ae67fa4 => generated 1314 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 15:43:35.330923 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-962af2c6-4518-409c-b14d-3d38ab4da55f tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 15:43:35.332011 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-962af2c6-4518-409c-b14d-3d38ab4da55f tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:43:35.337937 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-962af2c6-4518-409c-b14d-3d38ab4da55f tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:43:35.338463 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-962af2c6-4518-409c-b14d-3d38ab4da55f tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:43:35.339232 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-962af2c6-4518-409c-b14d-3d38ab4da55f tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:43:35.339664 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-962af2c6-4518-409c-b14d-3d38ab4da55f tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:43:35.496456 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-962af2c6-4518-409c-b14d-3d38ab4da55f tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "POST /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672/action" status: 200 len: 14 microversion: 2.20 time: 0.169267 Oct 27 15:43:35.497028 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 103/176] 10.222.0.64 () {62 vars in 1318 bytes} [Wed Oct 27 15:43:35 2021] POST /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672/action => generated 14 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 15:43:36.035960 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-3a126d7d-476a-4e79-8ce5-1c62c3d9c665 tempest-DeleteServersTestJSON-752571955 tempest-DeleteServersTestJSON-752571955-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:43:36.036406 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-3a126d7d-476a-4e79-8ce5-1c62c3d9c665 tempest-DeleteServersTestJSON-752571955 tempest-DeleteServersTestJSON-752571955-project] [instance: 6cc17348-b41d-46ba-a1d6-9f80614b7596] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:43:36.045701 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-3a126d7d-476a-4e79-8ce5-1c62c3d9c665 tempest-DeleteServersTestJSON-752571955 tempest-DeleteServersTestJSON-752571955-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:43:36.046150 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-3a126d7d-476a-4e79-8ce5-1c62c3d9c665 tempest-DeleteServersTestJSON-752571955 tempest-DeleteServersTestJSON-752571955-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:43:36.047390 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-3a126d7d-476a-4e79-8ce5-1c62c3d9c665 tempest-DeleteServersTestJSON-752571955 tempest-DeleteServersTestJSON-752571955-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:43:36.048418 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-3a126d7d-476a-4e79-8ce5-1c62c3d9c665 tempest-DeleteServersTestJSON-752571955 tempest-DeleteServersTestJSON-752571955-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:43:36.175785 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-66538f7b-873b-423d-975f-c1c32c697ceb tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:43:36.177430 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-66538f7b-873b-423d-975f-c1c32c697ceb tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: bced4f24-572a-4316-97e8-3ceedc61a621] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:43:36.185761 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-66538f7b-873b-423d-975f-c1c32c697ceb tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:43:36.186447 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-66538f7b-873b-423d-975f-c1c32c697ceb tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:43:36.187526 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-66538f7b-873b-423d-975f-c1c32c697ceb tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:43:36.188163 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-66538f7b-873b-423d-975f-c1c32c697ceb tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:43:36.304741 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-3a126d7d-476a-4e79-8ce5-1c62c3d9c665 tempest-DeleteServersTestJSON-752571955 tempest-DeleteServersTestJSON-752571955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf1a0e4ab3ab4008a25339e4eda7a48d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be9d7084d7ab4e408be53dd27f8748a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:43:36.314259 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-3a126d7d-476a-4e79-8ce5-1c62c3d9c665 tempest-DeleteServersTestJSON-752571955 tempest-DeleteServersTestJSON-752571955-project] 10.222.0.64 "GET /compute/v2.1/servers/6cc17348-b41d-46ba-a1d6-9f80614b7596" status: 200 len: 1554 microversion: 2.1 time: 0.281593 Oct 27 15:43:36.315104 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 74/177] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:43:36 2021] GET /compute/v2.1/servers/6cc17348-b41d-46ba-a1d6-9f80614b7596 => generated 1554 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 15:43:36.328001 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-44407867-c73f-4264-8c7c-974221f821e3 tempest-VolumesActionsTest-1850781407 tempest-VolumesActionsTest-1850781407-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:43:36.329013 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-44407867-c73f-4264-8c7c-974221f821e3 tempest-VolumesActionsTest-1850781407 tempest-VolumesActionsTest-1850781407-project] [instance: 48a2ef84-6477-44cd-a1f6-bac51ae67fa4] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:43:36.335439 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-44407867-c73f-4264-8c7c-974221f821e3 tempest-VolumesActionsTest-1850781407 tempest-VolumesActionsTest-1850781407-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:43:36.336149 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-44407867-c73f-4264-8c7c-974221f821e3 tempest-VolumesActionsTest-1850781407 tempest-VolumesActionsTest-1850781407-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:43:36.337086 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-44407867-c73f-4264-8c7c-974221f821e3 tempest-VolumesActionsTest-1850781407 tempest-VolumesActionsTest-1850781407-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:43:36.337674 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-44407867-c73f-4264-8c7c-974221f821e3 tempest-VolumesActionsTest-1850781407 tempest-VolumesActionsTest-1850781407-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:43:36.538917 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-44407867-c73f-4264-8c7c-974221f821e3 tempest-VolumesActionsTest-1850781407 tempest-VolumesActionsTest-1850781407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f44b5c1ad2204da1935d8cb7ea8bc67e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eef06dd988f343e7ae8ccf2c93217e9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:43:36.546046 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-44407867-c73f-4264-8c7c-974221f821e3 tempest-VolumesActionsTest-1850781407 tempest-VolumesActionsTest-1850781407-project] 10.222.0.64 "GET /compute/v2.1/servers/48a2ef84-6477-44cd-a1f6-bac51ae67fa4" status: 200 len: 1314 microversion: 2.1 time: 0.225887 Oct 27 15:43:36.546838 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 75/178] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:43:36 2021] GET /compute/v2.1/servers/48a2ef84-6477-44cd-a1f6-bac51ae67fa4 => generated 1314 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 15:43:36.553112 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-dd5fe1a3-e7b4-446d-88bc-8d7dca1644e3 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 15:43:36.554254 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-dd5fe1a3-e7b4-446d-88bc-8d7dca1644e3 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:43:36.564253 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-dd5fe1a3-e7b4-446d-88bc-8d7dca1644e3 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:43:36.564855 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-dd5fe1a3-e7b4-446d-88bc-8d7dca1644e3 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:43:36.565978 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-dd5fe1a3-e7b4-446d-88bc-8d7dca1644e3 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:43:36.566844 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-dd5fe1a3-e7b4-446d-88bc-8d7dca1644e3 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:43:36.646762 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-66538f7b-873b-423d-975f-c1c32c697ceb tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96b599f8890b4281a7e311cf37a039e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d7fcab5d3f465793d650f16c6ea8de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:43:36.654611 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-66538f7b-873b-423d-975f-c1c32c697ceb tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/bced4f24-572a-4316-97e8-3ceedc61a621" status: 200 len: 1520 microversion: 2.1 time: 0.483435 Oct 27 15:43:36.655511 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 104/179] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:43:36 2021] GET /compute/v2.1/servers/bced4f24-572a-4316-97e8-3ceedc61a621 => generated 1520 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 15:43:36.689784 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-dd5fe1a3-e7b4-446d-88bc-8d7dca1644e3 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "POST /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672/action" status: 200 len: 14 microversion: 2.20 time: 0.141562 Oct 27 15:43:36.690576 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 76/180] 10.222.0.64 () {62 vars in 1318 bytes} [Wed Oct 27 15:43:36 2021] POST /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672/action => generated 14 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 15:43:36.718681 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [req-089e6f0b-f0fa-4ed3-bcd2-1b8d90f8f4be req-12b8c0f7-fb2b-44db-bf1e-0b0f6c8d48e0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6cc17348-b41d-46ba-a1d6-9f80614b7596", "name": "network-vif-deleted", "tag": "e85edc27-86b1-4171-baec-a08e7231cb2d"}]} {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 15:43:36.721337 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 27 15:43:36.721337 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: warnings.warn(msg) Oct 27 15:43:36.732983 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [req-089e6f0b-f0fa-4ed3-bcd2-1b8d90f8f4be req-12b8c0f7-fb2b-44db-bf1e-0b0f6c8d48e0 service nova] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:43:36.734149 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [req-089e6f0b-f0fa-4ed3-bcd2-1b8d90f8f4be req-12b8c0f7-fb2b-44db-bf1e-0b0f6c8d48e0 service nova] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:43:36.764814 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.compute.server_external_events [req-089e6f0b-f0fa-4ed3-bcd2-1b8d90f8f4be req-12b8c0f7-fb2b-44db-bf1e-0b0f6c8d48e0 service nova] Creating event network-vif-deleted:e85edc27-86b1-4171-baec-a08e7231cb2d for instance 6cc17348-b41d-46ba-a1d6-9f80614b7596 on hv-cinder-80070 Oct 27 15:43:36.774078 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [req-089e6f0b-f0fa-4ed3-bcd2-1b8d90f8f4be req-12b8c0f7-fb2b-44db-bf1e-0b0f6c8d48e0 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061126 Oct 27 15:43:36.776354 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 105/181] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Oct 27 15:43:36 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 15:43:37.332649 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-b94d5ff4-2586-487a-9620-8f0e1b8fa760 tempest-DeleteServersTestJSON-752571955 tempest-DeleteServersTestJSON-752571955-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:43:37.334001 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-b94d5ff4-2586-487a-9620-8f0e1b8fa760 tempest-DeleteServersTestJSON-752571955 tempest-DeleteServersTestJSON-752571955-project] [instance: 6cc17348-b41d-46ba-a1d6-9f80614b7596] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:43:37.341265 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-b94d5ff4-2586-487a-9620-8f0e1b8fa760 tempest-DeleteServersTestJSON-752571955 tempest-DeleteServersTestJSON-752571955-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:43:37.341707 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-b94d5ff4-2586-487a-9620-8f0e1b8fa760 tempest-DeleteServersTestJSON-752571955 tempest-DeleteServersTestJSON-752571955-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:43:37.342484 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-b94d5ff4-2586-487a-9620-8f0e1b8fa760 tempest-DeleteServersTestJSON-752571955 tempest-DeleteServersTestJSON-752571955-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:43:37.343085 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-b94d5ff4-2586-487a-9620-8f0e1b8fa760 tempest-DeleteServersTestJSON-752571955 tempest-DeleteServersTestJSON-752571955-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:43:37.380187 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-b94d5ff4-2586-487a-9620-8f0e1b8fa760 tempest-DeleteServersTestJSON-752571955 tempest-DeleteServersTestJSON-752571955-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:43:37.380632 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-b94d5ff4-2586-487a-9620-8f0e1b8fa760 tempest-DeleteServersTestJSON-752571955 tempest-DeleteServersTestJSON-752571955-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:43:37.381079 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.objects.instance [None req-b94d5ff4-2586-487a-9620-8f0e1b8fa760 tempest-DeleteServersTestJSON-752571955 tempest-DeleteServersTestJSON-752571955-project] Lazy-loading 'fault' on Instance uuid 6cc17348-b41d-46ba-a1d6-9f80614b7596 {{(pid=122225) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 27 15:43:37.428154 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-b94d5ff4-2586-487a-9620-8f0e1b8fa760 tempest-DeleteServersTestJSON-752571955 tempest-DeleteServersTestJSON-752571955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf1a0e4ab3ab4008a25339e4eda7a48d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be9d7084d7ab4e408be53dd27f8748a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:43:37.436550 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-b94d5ff4-2586-487a-9620-8f0e1b8fa760 tempest-DeleteServersTestJSON-752571955 tempest-DeleteServersTestJSON-752571955-project] 10.222.0.64 "GET /compute/v2.1/servers/6cc17348-b41d-46ba-a1d6-9f80614b7596" status: 200 len: 1351 microversion: 2.1 time: 0.108810 Oct 27 15:43:37.446913 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 77/182] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:43:37 2021] GET /compute/v2.1/servers/6cc17348-b41d-46ba-a1d6-9f80614b7596 => generated 1351 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 15:43:37.563535 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-a9e6a25f-351a-47fd-b1b7-ba019b63e742 tempest-VolumesActionsTest-1850781407 tempest-VolumesActionsTest-1850781407-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:43:37.564306 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-a9e6a25f-351a-47fd-b1b7-ba019b63e742 tempest-VolumesActionsTest-1850781407 tempest-VolumesActionsTest-1850781407-project] [instance: 48a2ef84-6477-44cd-a1f6-bac51ae67fa4] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:43:37.570580 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-a9e6a25f-351a-47fd-b1b7-ba019b63e742 tempest-VolumesActionsTest-1850781407 tempest-VolumesActionsTest-1850781407-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:43:37.571026 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-a9e6a25f-351a-47fd-b1b7-ba019b63e742 tempest-VolumesActionsTest-1850781407 tempest-VolumesActionsTest-1850781407-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:43:37.571862 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-a9e6a25f-351a-47fd-b1b7-ba019b63e742 tempest-VolumesActionsTest-1850781407 tempest-VolumesActionsTest-1850781407-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:43:37.572310 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-a9e6a25f-351a-47fd-b1b7-ba019b63e742 tempest-VolumesActionsTest-1850781407 tempest-VolumesActionsTest-1850781407-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:43:37.675242 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-15e94c94-3a0c-4d81-9b51-600e5e3248dc tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:43:37.675872 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-15e94c94-3a0c-4d81-9b51-600e5e3248dc tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: bced4f24-572a-4316-97e8-3ceedc61a621] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:43:37.682786 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-15e94c94-3a0c-4d81-9b51-600e5e3248dc tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:43:37.683220 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-15e94c94-3a0c-4d81-9b51-600e5e3248dc tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:43:37.684177 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-15e94c94-3a0c-4d81-9b51-600e5e3248dc tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:43:37.684604 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-15e94c94-3a0c-4d81-9b51-600e5e3248dc tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:43:37.758858 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-a9e6a25f-351a-47fd-b1b7-ba019b63e742 tempest-VolumesActionsTest-1850781407 tempest-VolumesActionsTest-1850781407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f44b5c1ad2204da1935d8cb7ea8bc67e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eef06dd988f343e7ae8ccf2c93217e9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:43:37.768449 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-a9e6a25f-351a-47fd-b1b7-ba019b63e742 tempest-VolumesActionsTest-1850781407 tempest-VolumesActionsTest-1850781407-project] 10.222.0.64 "GET /compute/v2.1/servers/48a2ef84-6477-44cd-a1f6-bac51ae67fa4" status: 200 len: 1497 microversion: 2.1 time: 0.208089 Oct 27 15:43:37.769365 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 106/183] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:43:37 2021] GET /compute/v2.1/servers/48a2ef84-6477-44cd-a1f6-bac51ae67fa4 => generated 1497 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 15:43:37.775501 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-8bd2f9e2-a2f4-4d58-bfe4-0552d184fe0e tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 15:43:37.776532 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-8bd2f9e2-a2f4-4d58-bfe4-0552d184fe0e tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:43:37.783216 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-8bd2f9e2-a2f4-4d58-bfe4-0552d184fe0e tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:43:37.783977 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-8bd2f9e2-a2f4-4d58-bfe4-0552d184fe0e tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:43:37.785069 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-8bd2f9e2-a2f4-4d58-bfe4-0552d184fe0e tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:43:37.786016 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-8bd2f9e2-a2f4-4d58-bfe4-0552d184fe0e tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:43:37.874098 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-8bd2f9e2-a2f4-4d58-bfe4-0552d184fe0e tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "POST /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672/action" status: 200 len: 14 microversion: 2.20 time: 0.102987 Oct 27 15:43:37.874751 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 107/184] 10.222.0.64 () {62 vars in 1318 bytes} [Wed Oct 27 15:43:37 2021] POST /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672/action => generated 14 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 15:43:37.932221 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-15e94c94-3a0c-4d81-9b51-600e5e3248dc tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96b599f8890b4281a7e311cf37a039e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d7fcab5d3f465793d650f16c6ea8de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:43:37.941387 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-15e94c94-3a0c-4d81-9b51-600e5e3248dc tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/bced4f24-572a-4316-97e8-3ceedc61a621" status: 200 len: 1520 microversion: 2.1 time: 0.271492 Oct 27 15:43:37.942472 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 78/185] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:43:37 2021] GET /compute/v2.1/servers/bced4f24-572a-4316-97e8-3ceedc61a621 => generated 1520 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 15:43:38.411135 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-ca4c1b02-2fd8-41b5-89f0-c55d0b57a74d tempest-VolumesActionsTest-1850781407 tempest-VolumesActionsTest-1850781407-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:43:38.411712 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-ca4c1b02-2fd8-41b5-89f0-c55d0b57a74d tempest-VolumesActionsTest-1850781407 tempest-VolumesActionsTest-1850781407-project] [instance: 48a2ef84-6477-44cd-a1f6-bac51ae67fa4] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:43:38.418701 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-ca4c1b02-2fd8-41b5-89f0-c55d0b57a74d tempest-VolumesActionsTest-1850781407 tempest-VolumesActionsTest-1850781407-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:43:38.419165 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-ca4c1b02-2fd8-41b5-89f0-c55d0b57a74d tempest-VolumesActionsTest-1850781407 tempest-VolumesActionsTest-1850781407-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:43:38.419957 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-ca4c1b02-2fd8-41b5-89f0-c55d0b57a74d tempest-VolumesActionsTest-1850781407 tempest-VolumesActionsTest-1850781407-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:43:38.420552 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-ca4c1b02-2fd8-41b5-89f0-c55d0b57a74d tempest-VolumesActionsTest-1850781407 tempest-VolumesActionsTest-1850781407-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:43:38.449600 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-ca4c1b02-2fd8-41b5-89f0-c55d0b57a74d tempest-VolumesActionsTest-1850781407 tempest-VolumesActionsTest-1850781407-project] [instance: 48a2ef84-6477-44cd-a1f6-bac51ae67fa4] Going to try to terminate instance {{(pid=122224) delete /opt/stack/nova/nova/compute/api.py:2612}} Oct 27 15:43:38.455582 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-df7d50db-aa57-4b5f-8bc7-6e663fcda4d2 tempest-DeleteServersTestJSON-752571955 tempest-DeleteServersTestJSON-752571955-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:43:38.456323 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-df7d50db-aa57-4b5f-8bc7-6e663fcda4d2 tempest-DeleteServersTestJSON-752571955 tempest-DeleteServersTestJSON-752571955-project] [instance: 6cc17348-b41d-46ba-a1d6-9f80614b7596] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:43:38.465754 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-df7d50db-aa57-4b5f-8bc7-6e663fcda4d2 tempest-DeleteServersTestJSON-752571955 tempest-DeleteServersTestJSON-752571955-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:43:38.466501 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-df7d50db-aa57-4b5f-8bc7-6e663fcda4d2 tempest-DeleteServersTestJSON-752571955 tempest-DeleteServersTestJSON-752571955-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:43:38.467427 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-df7d50db-aa57-4b5f-8bc7-6e663fcda4d2 tempest-DeleteServersTestJSON-752571955 tempest-DeleteServersTestJSON-752571955-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:43:38.468030 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-df7d50db-aa57-4b5f-8bc7-6e663fcda4d2 tempest-DeleteServersTestJSON-752571955 tempest-DeleteServersTestJSON-752571955-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:43:38.484946 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.wsgi [None req-df7d50db-aa57-4b5f-8bc7-6e663fcda4d2 tempest-DeleteServersTestJSON-752571955 tempest-DeleteServersTestJSON-752571955-project] HTTP exception thrown: Instance 6cc17348-b41d-46ba-a1d6-9f80614b7596 could not be found. Oct 27 15:43:38.485931 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-df7d50db-aa57-4b5f-8bc7-6e663fcda4d2 tempest-DeleteServersTestJSON-752571955 tempest-DeleteServersTestJSON-752571955-project] Returning 404 to user: Instance 6cc17348-b41d-46ba-a1d6-9f80614b7596 could not be found. {{(pid=122225) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 27 15:43:38.486913 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-df7d50db-aa57-4b5f-8bc7-6e663fcda4d2 tempest-DeleteServersTestJSON-752571955 tempest-DeleteServersTestJSON-752571955-project] 10.222.0.64 "GET /compute/v2.1/servers/6cc17348-b41d-46ba-a1d6-9f80614b7596" status: 404 len: 111 microversion: 2.1 time: 0.036008 Oct 27 15:43:38.487610 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 79/186] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:43:38 2021] GET /compute/v2.1/servers/6cc17348-b41d-46ba-a1d6-9f80614b7596 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 15:43:38.556890 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-ca4c1b02-2fd8-41b5-89f0-c55d0b57a74d tempest-VolumesActionsTest-1850781407 tempest-VolumesActionsTest-1850781407-project] 10.222.0.64 "DELETE /compute/v2.1/servers/48a2ef84-6477-44cd-a1f6-bac51ae67fa4" status: 204 len: 0 microversion: 2.1 time: 0.149548 Oct 27 15:43:38.557614 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 108/187] 10.222.0.64 () {58 vars in 1238 bytes} [Wed Oct 27 15:43:38 2021] DELETE /compute/v2.1/servers/48a2ef84-6477-44cd-a1f6-bac51ae67fa4 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 15:43:38.566185 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-8bc14c23-f6f4-487d-86ac-7dd971a623f2 tempest-VolumesActionsTest-1850781407 tempest-VolumesActionsTest-1850781407-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:43:38.566884 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-8bc14c23-f6f4-487d-86ac-7dd971a623f2 tempest-VolumesActionsTest-1850781407 tempest-VolumesActionsTest-1850781407-project] [instance: 48a2ef84-6477-44cd-a1f6-bac51ae67fa4] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:43:38.580586 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-8bc14c23-f6f4-487d-86ac-7dd971a623f2 tempest-VolumesActionsTest-1850781407 tempest-VolumesActionsTest-1850781407-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:43:38.581151 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-8bc14c23-f6f4-487d-86ac-7dd971a623f2 tempest-VolumesActionsTest-1850781407 tempest-VolumesActionsTest-1850781407-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:43:38.581956 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-8bc14c23-f6f4-487d-86ac-7dd971a623f2 tempest-VolumesActionsTest-1850781407 tempest-VolumesActionsTest-1850781407-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:43:38.582419 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-8bc14c23-f6f4-487d-86ac-7dd971a623f2 tempest-VolumesActionsTest-1850781407 tempest-VolumesActionsTest-1850781407-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:43:38.622808 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-68d1ae18-bcae-489a-a1f9-89a2ffa07e7f tempest-DeleteServersTestJSON-752571955 tempest-DeleteServersTestJSON-752571955-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:43:38.624500 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-68d1ae18-bcae-489a-a1f9-89a2ffa07e7f tempest-DeleteServersTestJSON-752571955 tempest-DeleteServersTestJSON-752571955-project] [instance: 6cc17348-b41d-46ba-a1d6-9f80614b7596] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:43:38.634146 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-68d1ae18-bcae-489a-a1f9-89a2ffa07e7f tempest-DeleteServersTestJSON-752571955 tempest-DeleteServersTestJSON-752571955-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:43:38.634587 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-68d1ae18-bcae-489a-a1f9-89a2ffa07e7f tempest-DeleteServersTestJSON-752571955 tempest-DeleteServersTestJSON-752571955-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:43:38.635555 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-68d1ae18-bcae-489a-a1f9-89a2ffa07e7f tempest-DeleteServersTestJSON-752571955 tempest-DeleteServersTestJSON-752571955-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:43:38.636176 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-68d1ae18-bcae-489a-a1f9-89a2ffa07e7f tempest-DeleteServersTestJSON-752571955 tempest-DeleteServersTestJSON-752571955-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:43:38.652528 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.wsgi [None req-68d1ae18-bcae-489a-a1f9-89a2ffa07e7f tempest-DeleteServersTestJSON-752571955 tempest-DeleteServersTestJSON-752571955-project] HTTP exception thrown: Instance 6cc17348-b41d-46ba-a1d6-9f80614b7596 could not be found. Oct 27 15:43:38.653401 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-68d1ae18-bcae-489a-a1f9-89a2ffa07e7f tempest-DeleteServersTestJSON-752571955 tempest-DeleteServersTestJSON-752571955-project] Returning 404 to user: Instance 6cc17348-b41d-46ba-a1d6-9f80614b7596 could not be found. {{(pid=122224) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 27 15:43:38.654566 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-68d1ae18-bcae-489a-a1f9-89a2ffa07e7f tempest-DeleteServersTestJSON-752571955 tempest-DeleteServersTestJSON-752571955-project] 10.222.0.64 "GET /compute/v2.1/servers/6cc17348-b41d-46ba-a1d6-9f80614b7596/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.037909 Oct 27 15:43:38.655291 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 109/188] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Oct 27 15:43:38 2021] GET /compute/v2.1/servers/6cc17348-b41d-46ba-a1d6-9f80614b7596/os-volume_attachments => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 27 15:43:38.774792 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-8bc14c23-f6f4-487d-86ac-7dd971a623f2 tempest-VolumesActionsTest-1850781407 tempest-VolumesActionsTest-1850781407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f44b5c1ad2204da1935d8cb7ea8bc67e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eef06dd988f343e7ae8ccf2c93217e9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:43:38.783054 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-8bc14c23-f6f4-487d-86ac-7dd971a623f2 tempest-VolumesActionsTest-1850781407 tempest-VolumesActionsTest-1850781407-project] 10.222.0.64 "GET /compute/v2.1/servers/48a2ef84-6477-44cd-a1f6-bac51ae67fa4" status: 200 len: 1503 microversion: 2.1 time: 0.220283 Oct 27 15:43:38.783995 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 80/189] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:43:38 2021] GET /compute/v2.1/servers/48a2ef84-6477-44cd-a1f6-bac51ae67fa4 => generated 1503 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 15:43:38.885289 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-38f7f4ce-8375-4a73-a657-70f752b85e9f tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 15:43:38.886193 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-38f7f4ce-8375-4a73-a657-70f752b85e9f tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:43:38.892902 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-38f7f4ce-8375-4a73-a657-70f752b85e9f tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:43:38.893350 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-38f7f4ce-8375-4a73-a657-70f752b85e9f tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:43:38.894117 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-38f7f4ce-8375-4a73-a657-70f752b85e9f tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:43:38.894548 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-38f7f4ce-8375-4a73-a657-70f752b85e9f tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:43:38.961414 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-ad359823-1265-45f6-93de-969d8722c5eb tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:43:38.962028 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-ad359823-1265-45f6-93de-969d8722c5eb tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: bced4f24-572a-4316-97e8-3ceedc61a621] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:43:38.969306 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-ad359823-1265-45f6-93de-969d8722c5eb tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:43:38.969920 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-ad359823-1265-45f6-93de-969d8722c5eb tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:43:38.970739 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-ad359823-1265-45f6-93de-969d8722c5eb tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:43:38.971172 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-ad359823-1265-45f6-93de-969d8722c5eb tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:43:38.980125 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-38f7f4ce-8375-4a73-a657-70f752b85e9f tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "POST /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672/action" status: 200 len: 14 microversion: 2.20 time: 0.098104 Oct 27 15:43:38.981365 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 110/190] 10.222.0.64 () {62 vars in 1318 bytes} [Wed Oct 27 15:43:38 2021] POST /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672/action => generated 14 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 15:43:39.141095 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-ad359823-1265-45f6-93de-969d8722c5eb tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96b599f8890b4281a7e311cf37a039e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d7fcab5d3f465793d650f16c6ea8de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:43:39.149114 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-ad359823-1265-45f6-93de-969d8722c5eb tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/bced4f24-572a-4316-97e8-3ceedc61a621" status: 200 len: 1520 microversion: 2.1 time: 0.191362 Oct 27 15:43:39.150204 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 81/191] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:43:38 2021] GET /compute/v2.1/servers/bced4f24-572a-4316-97e8-3ceedc61a621 => generated 1520 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 15:43:39.241443 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-29e3d8f9-e1a8-42ed-83dd-25b105990870 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-391988917", "imageRef": "b585ffbc-6a36-48c9-81b3-e26f9bd0fcba", "flavorRef": "452", "networks": [{"uuid": "d9775d1d-2e09-490f-b5c0-23cc640635a9"}]}} {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 15:43:39.306417 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.network.neutron [None req-29e3d8f9-e1a8-42ed-83dd-25b105990870 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] validate_networks() for [('d9775d1d-2e09-490f-b5c0-23cc640635a9', None, None, None, None, None)] {{(pid=122224) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Oct 27 15:43:39.701900 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.virt.hardware [None req-29e3d8f9-e1a8-42ed-83dd-25b105990870 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Flavor limits 0:0:0 {{(pid=122224) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 15:43:39.703198 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.virt.hardware [None req-29e3d8f9-e1a8-42ed-83dd-25b105990870 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Image limits 0:0:0 {{(pid=122224) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 15:43:39.704051 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.virt.hardware [None req-29e3d8f9-e1a8-42ed-83dd-25b105990870 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Flavor pref 0:0:0 {{(pid=122224) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 15:43:39.704815 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.virt.hardware [None req-29e3d8f9-e1a8-42ed-83dd-25b105990870 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Image pref 0:0:0 {{(pid=122224) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 15:43:39.705326 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.virt.hardware [None req-29e3d8f9-e1a8-42ed-83dd-25b105990870 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122224) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 15:43:39.724881 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-29e3d8f9-e1a8-42ed-83dd-25b105990870 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:43:39.725788 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-29e3d8f9-e1a8-42ed-83dd-25b105990870 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:43:39.727258 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-29e3d8f9-e1a8-42ed-83dd-25b105990870 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:43:39.728929 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-29e3d8f9-e1a8-42ed-83dd-25b105990870 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:43:39.751659 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.quota [None req-29e3d8f9-e1a8-42ed-83dd-25b105990870 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Getting quotas for project 4fc48df471f247809d82ddf926bfdc6c. Resources: {'ram', 'instances', 'cores'} {{(pid=122224) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 27 15:43:39.756105 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.quota [None req-29e3d8f9-e1a8-42ed-83dd-25b105990870 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Getting quotas for user 0abe23cb5f314bc883ef7958b0ed9b5f and project 4fc48df471f247809d82ddf926bfdc6c. Resources: {'ram', 'instances', 'cores'} {{(pid=122224) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 27 15:43:39.769499 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-29e3d8f9-e1a8-42ed-83dd-25b105990870 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Going to run 1 instances... {{(pid=122224) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Oct 27 15:43:39.772810 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-29e3d8f9-e1a8-42ed-83dd-25b105990870 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] [instance: a2e6d3ca-9ddb-4f28-908a-24d8705fb320] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b585ffbc-6a36-48c9-81b3-e26f9bd0fcba',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122224) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Oct 27 15:43:39.801418 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-f4ee36f9-92f9-47f7-97c8-7ef28500cf76 tempest-VolumesActionsTest-1850781407 tempest-VolumesActionsTest-1850781407-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:43:39.802012 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-f4ee36f9-92f9-47f7-97c8-7ef28500cf76 tempest-VolumesActionsTest-1850781407 tempest-VolumesActionsTest-1850781407-project] [instance: 48a2ef84-6477-44cd-a1f6-bac51ae67fa4] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:43:39.808020 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-f4ee36f9-92f9-47f7-97c8-7ef28500cf76 tempest-VolumesActionsTest-1850781407 tempest-VolumesActionsTest-1850781407-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:43:39.808516 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-f4ee36f9-92f9-47f7-97c8-7ef28500cf76 tempest-VolumesActionsTest-1850781407 tempest-VolumesActionsTest-1850781407-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:43:39.809435 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-f4ee36f9-92f9-47f7-97c8-7ef28500cf76 tempest-VolumesActionsTest-1850781407 tempest-VolumesActionsTest-1850781407-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:43:39.809860 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-f4ee36f9-92f9-47f7-97c8-7ef28500cf76 tempest-VolumesActionsTest-1850781407 tempest-VolumesActionsTest-1850781407-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:43:39.827504 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-29e3d8f9-e1a8-42ed-83dd-25b105990870 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.590008 Oct 27 15:43:39.828604 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 111/192] 10.222.0.64 () {60 vars in 1146 bytes} [Wed Oct 27 15:43:39 2021] POST /compute/v2.1/servers => generated 380 bytes in 592 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 15:43:39.841433 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-69886094-eae8-4c40-8824-fe572281a3ba tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:43:39.842046 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-69886094-eae8-4c40-8824-fe572281a3ba tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] [instance: a2e6d3ca-9ddb-4f28-908a-24d8705fb320] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:43:39.915437 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-69886094-eae8-4c40-8824-fe572281a3ba tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0abe23cb5f314bc883ef7958b0ed9b5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fc48df471f247809d82ddf926bfdc6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:43:39.933267 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-69886094-eae8-4c40-8824-fe572281a3ba tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] 10.222.0.64 "GET /compute/v2.1/servers/a2e6d3ca-9ddb-4f28-908a-24d8705fb320" status: 200 len: 1217 microversion: 2.1 time: 0.095766 Oct 27 15:43:39.934047 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 112/193] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:43:39 2021] GET /compute/v2.1/servers/a2e6d3ca-9ddb-4f28-908a-24d8705fb320 => generated 1217 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 15:43:39.943489 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-0a6cdcae-b265-42ca-bc1f-6a3baceda987 tempest-DeleteServersTestJSON-752571955 tempest-DeleteServersTestJSON-752571955-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:43:39.946150 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-0a6cdcae-b265-42ca-bc1f-6a3baceda987 tempest-DeleteServersTestJSON-752571955 tempest-DeleteServersTestJSON-752571955-project] [instance: 6cc17348-b41d-46ba-a1d6-9f80614b7596] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:43:39.960041 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-0a6cdcae-b265-42ca-bc1f-6a3baceda987 tempest-DeleteServersTestJSON-752571955 tempest-DeleteServersTestJSON-752571955-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:43:39.960491 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-0a6cdcae-b265-42ca-bc1f-6a3baceda987 tempest-DeleteServersTestJSON-752571955 tempest-DeleteServersTestJSON-752571955-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:43:39.961276 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-0a6cdcae-b265-42ca-bc1f-6a3baceda987 tempest-DeleteServersTestJSON-752571955 tempest-DeleteServersTestJSON-752571955-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:43:39.961713 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-0a6cdcae-b265-42ca-bc1f-6a3baceda987 tempest-DeleteServersTestJSON-752571955 tempest-DeleteServersTestJSON-752571955-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:43:39.979689 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.wsgi [None req-0a6cdcae-b265-42ca-bc1f-6a3baceda987 tempest-DeleteServersTestJSON-752571955 tempest-DeleteServersTestJSON-752571955-project] HTTP exception thrown: Instance 6cc17348-b41d-46ba-a1d6-9f80614b7596 could not be found. Oct 27 15:43:39.980439 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-0a6cdcae-b265-42ca-bc1f-6a3baceda987 tempest-DeleteServersTestJSON-752571955 tempest-DeleteServersTestJSON-752571955-project] Returning 404 to user: Instance 6cc17348-b41d-46ba-a1d6-9f80614b7596 could not be found. {{(pid=122224) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 27 15:43:39.981504 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-0a6cdcae-b265-42ca-bc1f-6a3baceda987 tempest-DeleteServersTestJSON-752571955 tempest-DeleteServersTestJSON-752571955-project] 10.222.0.64 "DELETE /compute/v2.1/servers/6cc17348-b41d-46ba-a1d6-9f80614b7596" status: 404 len: 111 microversion: 2.1 time: 0.046364 Oct 27 15:43:39.982567 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 113/194] 10.222.0.64 () {58 vars in 1238 bytes} [Wed Oct 27 15:43:39 2021] DELETE /compute/v2.1/servers/6cc17348-b41d-46ba-a1d6-9f80614b7596 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 15:43:39.990560 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-00d71cc1-5ae5-4148-a9cb-3ac56b2cf523 tempest-DeleteServersTestJSON-752571955 tempest-DeleteServersTestJSON-752571955-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:43:39.991329 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-00d71cc1-5ae5-4148-a9cb-3ac56b2cf523 tempest-DeleteServersTestJSON-752571955 tempest-DeleteServersTestJSON-752571955-project] [instance: 6cc17348-b41d-46ba-a1d6-9f80614b7596] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:43:39.998022 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-00d71cc1-5ae5-4148-a9cb-3ac56b2cf523 tempest-DeleteServersTestJSON-752571955 tempest-DeleteServersTestJSON-752571955-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:43:39.998470 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-00d71cc1-5ae5-4148-a9cb-3ac56b2cf523 tempest-DeleteServersTestJSON-752571955 tempest-DeleteServersTestJSON-752571955-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:43:39.999339 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-00d71cc1-5ae5-4148-a9cb-3ac56b2cf523 tempest-DeleteServersTestJSON-752571955 tempest-DeleteServersTestJSON-752571955-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:43:39.999979 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-00d71cc1-5ae5-4148-a9cb-3ac56b2cf523 tempest-DeleteServersTestJSON-752571955 tempest-DeleteServersTestJSON-752571955-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:43:40.001892 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-f4ee36f9-92f9-47f7-97c8-7ef28500cf76 tempest-VolumesActionsTest-1850781407 tempest-VolumesActionsTest-1850781407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f44b5c1ad2204da1935d8cb7ea8bc67e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eef06dd988f343e7ae8ccf2c93217e9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:43:40.009729 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-f4ee36f9-92f9-47f7-97c8-7ef28500cf76 tempest-VolumesActionsTest-1850781407 tempest-VolumesActionsTest-1850781407-project] 10.222.0.64 "GET /compute/v2.1/servers/48a2ef84-6477-44cd-a1f6-bac51ae67fa4" status: 200 len: 1503 microversion: 2.1 time: 0.212796 Oct 27 15:43:40.010681 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 82/195] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:43:39 2021] GET /compute/v2.1/servers/48a2ef84-6477-44cd-a1f6-bac51ae67fa4 => generated 1503 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 15:43:40.016188 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-b5c96793-0b92-4aca-a68a-127a72c5e999 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 15:43:40.017547 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-b5c96793-0b92-4aca-a68a-127a72c5e999 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:43:40.024688 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-b5c96793-0b92-4aca-a68a-127a72c5e999 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:43:40.025526 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-b5c96793-0b92-4aca-a68a-127a72c5e999 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:43:40.025677 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.wsgi [None req-00d71cc1-5ae5-4148-a9cb-3ac56b2cf523 tempest-DeleteServersTestJSON-752571955 tempest-DeleteServersTestJSON-752571955-project] HTTP exception thrown: Instance 6cc17348-b41d-46ba-a1d6-9f80614b7596 could not be found. Oct 27 15:43:40.026169 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-00d71cc1-5ae5-4148-a9cb-3ac56b2cf523 tempest-DeleteServersTestJSON-752571955 tempest-DeleteServersTestJSON-752571955-project] Returning 404 to user: Instance 6cc17348-b41d-46ba-a1d6-9f80614b7596 could not be found. {{(pid=122224) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 27 15:43:40.026447 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-b5c96793-0b92-4aca-a68a-127a72c5e999 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:43:40.027012 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-00d71cc1-5ae5-4148-a9cb-3ac56b2cf523 tempest-DeleteServersTestJSON-752571955 tempest-DeleteServersTestJSON-752571955-project] 10.222.0.64 "GET /compute/v2.1/servers/6cc17348-b41d-46ba-a1d6-9f80614b7596" status: 404 len: 111 microversion: 2.1 time: 0.040155 Oct 27 15:43:40.027144 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-b5c96793-0b92-4aca-a68a-127a72c5e999 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:43:40.027580 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 114/196] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:43:39 2021] GET /compute/v2.1/servers/6cc17348-b41d-46ba-a1d6-9f80614b7596 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 15:43:40.140104 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-b5c96793-0b92-4aca-a68a-127a72c5e999 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "POST /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672/action" status: 200 len: 14 microversion: 2.20 time: 0.125825 Oct 27 15:43:40.141463 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 83/197] 10.222.0.64 () {62 vars in 1318 bytes} [Wed Oct 27 15:43:40 2021] POST /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672/action => generated 14 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 15:43:40.166563 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-23aacfcf-4f30-450d-a90a-9e892b2a7e56 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:43:40.167244 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-23aacfcf-4f30-450d-a90a-9e892b2a7e56 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: bced4f24-572a-4316-97e8-3ceedc61a621] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:43:40.174304 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-23aacfcf-4f30-450d-a90a-9e892b2a7e56 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:43:40.175096 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-23aacfcf-4f30-450d-a90a-9e892b2a7e56 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:43:40.176134 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-23aacfcf-4f30-450d-a90a-9e892b2a7e56 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:43:40.176727 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-23aacfcf-4f30-450d-a90a-9e892b2a7e56 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:43:40.364433 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-23aacfcf-4f30-450d-a90a-9e892b2a7e56 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96b599f8890b4281a7e311cf37a039e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d7fcab5d3f465793d650f16c6ea8de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:43:40.385071 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-23aacfcf-4f30-450d-a90a-9e892b2a7e56 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/bced4f24-572a-4316-97e8-3ceedc61a621" status: 200 len: 1520 microversion: 2.1 time: 0.222290 Oct 27 15:43:40.385854 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 115/198] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:43:40 2021] GET /compute/v2.1/servers/bced4f24-572a-4316-97e8-3ceedc61a621 => generated 1520 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 15:43:40.953791 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-c1300d57-9ba4-4a3b-a95c-f1af22e72bf6 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:43:40.954610 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-c1300d57-9ba4-4a3b-a95c-f1af22e72bf6 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] [instance: a2e6d3ca-9ddb-4f28-908a-24d8705fb320] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:43:40.961723 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-c1300d57-9ba4-4a3b-a95c-f1af22e72bf6 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:43:40.963161 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-c1300d57-9ba4-4a3b-a95c-f1af22e72bf6 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:43:40.964286 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-c1300d57-9ba4-4a3b-a95c-f1af22e72bf6 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:43:40.964866 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-c1300d57-9ba4-4a3b-a95c-f1af22e72bf6 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:43:41.031534 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-01670af0-0c6c-4436-a4e4-5f0deb5f0061 tempest-VolumesActionsTest-1850781407 tempest-VolumesActionsTest-1850781407-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:43:41.033137 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-01670af0-0c6c-4436-a4e4-5f0deb5f0061 tempest-VolumesActionsTest-1850781407 tempest-VolumesActionsTest-1850781407-project] [instance: 48a2ef84-6477-44cd-a1f6-bac51ae67fa4] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:43:41.040775 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-01670af0-0c6c-4436-a4e4-5f0deb5f0061 tempest-VolumesActionsTest-1850781407 tempest-VolumesActionsTest-1850781407-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:43:41.041444 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-01670af0-0c6c-4436-a4e4-5f0deb5f0061 tempest-VolumesActionsTest-1850781407 tempest-VolumesActionsTest-1850781407-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:43:41.042624 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-01670af0-0c6c-4436-a4e4-5f0deb5f0061 tempest-VolumesActionsTest-1850781407 tempest-VolumesActionsTest-1850781407-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:43:41.043484 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-c1300d57-9ba4-4a3b-a95c-f1af22e72bf6 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0abe23cb5f314bc883ef7958b0ed9b5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fc48df471f247809d82ddf926bfdc6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:43:41.048474 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-01670af0-0c6c-4436-a4e4-5f0deb5f0061 tempest-VolumesActionsTest-1850781407 tempest-VolumesActionsTest-1850781407-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:43:41.051312 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-c1300d57-9ba4-4a3b-a95c-f1af22e72bf6 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] 10.222.0.64 "GET /compute/v2.1/servers/a2e6d3ca-9ddb-4f28-908a-24d8705fb320" status: 200 len: 1269 microversion: 2.1 time: 0.104460 Oct 27 15:43:41.052110 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 84/199] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:43:40 2021] GET /compute/v2.1/servers/a2e6d3ca-9ddb-4f28-908a-24d8705fb320 => generated 1269 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 15:43:41.150996 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-00772151-0cb2-43ce-b8e1-80b76f2966f2 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 15:43:41.152357 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-00772151-0cb2-43ce-b8e1-80b76f2966f2 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:43:41.163148 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-00772151-0cb2-43ce-b8e1-80b76f2966f2 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:43:41.163541 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-00772151-0cb2-43ce-b8e1-80b76f2966f2 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:43:41.166553 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-00772151-0cb2-43ce-b8e1-80b76f2966f2 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:43:41.167291 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-00772151-0cb2-43ce-b8e1-80b76f2966f2 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:43:41.295310 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-00772151-0cb2-43ce-b8e1-80b76f2966f2 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "POST /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672/action" status: 200 len: 14 microversion: 2.20 time: 0.148170 Oct 27 15:43:41.296814 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 85/200] 10.222.0.64 () {62 vars in 1318 bytes} [Wed Oct 27 15:43:41 2021] POST /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672/action => generated 14 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 15:43:41.353446 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-01670af0-0c6c-4436-a4e4-5f0deb5f0061 tempest-VolumesActionsTest-1850781407 tempest-VolumesActionsTest-1850781407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f44b5c1ad2204da1935d8cb7ea8bc67e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eef06dd988f343e7ae8ccf2c93217e9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:43:41.362397 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-01670af0-0c6c-4436-a4e4-5f0deb5f0061 tempest-VolumesActionsTest-1850781407 tempest-VolumesActionsTest-1850781407-project] 10.222.0.64 "GET /compute/v2.1/servers/48a2ef84-6477-44cd-a1f6-bac51ae67fa4" status: 200 len: 1503 microversion: 2.1 time: 0.335656 Oct 27 15:43:41.372782 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 116/201] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:43:41 2021] GET /compute/v2.1/servers/48a2ef84-6477-44cd-a1f6-bac51ae67fa4 => generated 1503 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 15:43:41.403458 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-3d13df93-ac2b-4787-83f9-2dd0377200c4 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:43:41.404187 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-3d13df93-ac2b-4787-83f9-2dd0377200c4 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: bced4f24-572a-4316-97e8-3ceedc61a621] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:43:41.417041 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-3d13df93-ac2b-4787-83f9-2dd0377200c4 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:43:41.421002 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-3d13df93-ac2b-4787-83f9-2dd0377200c4 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:43:41.422158 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-3d13df93-ac2b-4787-83f9-2dd0377200c4 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:43:41.429954 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-3d13df93-ac2b-4787-83f9-2dd0377200c4 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:43:41.732251 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-3d13df93-ac2b-4787-83f9-2dd0377200c4 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96b599f8890b4281a7e311cf37a039e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d7fcab5d3f465793d650f16c6ea8de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:43:41.741217 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-3d13df93-ac2b-4787-83f9-2dd0377200c4 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/bced4f24-572a-4316-97e8-3ceedc61a621" status: 200 len: 1520 microversion: 2.1 time: 0.341516 Oct 27 15:43:41.742320 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 86/202] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:43:41 2021] GET /compute/v2.1/servers/bced4f24-572a-4316-97e8-3ceedc61a621 => generated 1520 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 15:43:42.068701 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-13c8e455-d632-4fec-b225-3b4d713a1427 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:43:42.069310 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-13c8e455-d632-4fec-b225-3b4d713a1427 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] [instance: a2e6d3ca-9ddb-4f28-908a-24d8705fb320] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:43:42.079621 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-13c8e455-d632-4fec-b225-3b4d713a1427 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:43:42.080275 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-13c8e455-d632-4fec-b225-3b4d713a1427 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:43:42.081082 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-13c8e455-d632-4fec-b225-3b4d713a1427 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:43:42.081514 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-13c8e455-d632-4fec-b225-3b4d713a1427 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:43:42.308273 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-cf880e27-5409-48a7-a429-84bddaa571e6 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 15:43:42.309371 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-cf880e27-5409-48a7-a429-84bddaa571e6 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:43:42.320161 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-cf880e27-5409-48a7-a429-84bddaa571e6 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:43:42.322051 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-cf880e27-5409-48a7-a429-84bddaa571e6 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:43:42.322940 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-cf880e27-5409-48a7-a429-84bddaa571e6 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:43:42.324987 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-cf880e27-5409-48a7-a429-84bddaa571e6 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:43:42.378057 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-13c8e455-d632-4fec-b225-3b4d713a1427 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0abe23cb5f314bc883ef7958b0ed9b5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fc48df471f247809d82ddf926bfdc6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:43:42.386147 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-13c8e455-d632-4fec-b225-3b4d713a1427 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] 10.222.0.64 "GET /compute/v2.1/servers/a2e6d3ca-9ddb-4f28-908a-24d8705fb320" status: 200 len: 1317 microversion: 2.1 time: 0.321411 Oct 27 15:43:42.386886 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 117/203] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:43:42 2021] GET /compute/v2.1/servers/a2e6d3ca-9ddb-4f28-908a-24d8705fb320 => generated 1317 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 15:43:42.392222 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-ca78acea-b3fb-443e-b8a2-c8a401e561fe tempest-VolumesActionsTest-1850781407 tempest-VolumesActionsTest-1850781407-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:43:42.393307 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-ca78acea-b3fb-443e-b8a2-c8a401e561fe tempest-VolumesActionsTest-1850781407 tempest-VolumesActionsTest-1850781407-project] [instance: 48a2ef84-6477-44cd-a1f6-bac51ae67fa4] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:43:42.403525 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-ca78acea-b3fb-443e-b8a2-c8a401e561fe tempest-VolumesActionsTest-1850781407 tempest-VolumesActionsTest-1850781407-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:43:42.404793 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-ca78acea-b3fb-443e-b8a2-c8a401e561fe tempest-VolumesActionsTest-1850781407 tempest-VolumesActionsTest-1850781407-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:43:42.405782 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-ca78acea-b3fb-443e-b8a2-c8a401e561fe tempest-VolumesActionsTest-1850781407 tempest-VolumesActionsTest-1850781407-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:43:42.406417 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-ca78acea-b3fb-443e-b8a2-c8a401e561fe tempest-VolumesActionsTest-1850781407 tempest-VolumesActionsTest-1850781407-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:43:42.474495 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-cf880e27-5409-48a7-a429-84bddaa571e6 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "POST /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672/action" status: 200 len: 14 microversion: 2.20 time: 0.170208 Oct 27 15:43:42.478034 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 87/204] 10.222.0.64 () {62 vars in 1318 bytes} [Wed Oct 27 15:43:42 2021] POST /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672/action => generated 14 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 15:43:42.541960 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [req-be92a7a5-4d71-4efc-8807-24fb9061fccc req-b720ecf3-9af1-4158-8f1b-57260ee5f8d7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "48a2ef84-6477-44cd-a1f6-bac51ae67fa4", "name": "network-vif-deleted", "tag": "6c93023e-5a56-4e67-89ee-7c18d38a071f"}]} {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 15:43:42.543786 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 27 15:43:42.543786 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: warnings.warn(msg) Oct 27 15:43:42.560806 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-ca78acea-b3fb-443e-b8a2-c8a401e561fe tempest-VolumesActionsTest-1850781407 tempest-VolumesActionsTest-1850781407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f44b5c1ad2204da1935d8cb7ea8bc67e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eef06dd988f343e7ae8ccf2c93217e9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:43:42.566137 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [req-be92a7a5-4d71-4efc-8807-24fb9061fccc req-b720ecf3-9af1-4158-8f1b-57260ee5f8d7 service nova] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:43:42.568865 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-ca78acea-b3fb-443e-b8a2-c8a401e561fe tempest-VolumesActionsTest-1850781407 tempest-VolumesActionsTest-1850781407-project] 10.222.0.64 "GET /compute/v2.1/servers/48a2ef84-6477-44cd-a1f6-bac51ae67fa4" status: 200 len: 1461 microversion: 2.1 time: 0.180779 Oct 27 15:43:42.569186 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [req-be92a7a5-4d71-4efc-8807-24fb9061fccc req-b720ecf3-9af1-4158-8f1b-57260ee5f8d7 service nova] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:43:42.570693 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 118/205] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:43:42 2021] GET /compute/v2.1/servers/48a2ef84-6477-44cd-a1f6-bac51ae67fa4 => generated 1461 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 15:43:42.601218 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.compute.server_external_events [req-be92a7a5-4d71-4efc-8807-24fb9061fccc req-b720ecf3-9af1-4158-8f1b-57260ee5f8d7 service nova] Creating event network-vif-deleted:6c93023e-5a56-4e67-89ee-7c18d38a071f for instance 48a2ef84-6477-44cd-a1f6-bac51ae67fa4 on hv-cinder-80070 Oct 27 15:43:42.607760 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [req-be92a7a5-4d71-4efc-8807-24fb9061fccc req-b720ecf3-9af1-4158-8f1b-57260ee5f8d7 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069788 Oct 27 15:43:42.609193 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 88/206] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Oct 27 15:43:42 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 15:43:42.770968 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-a8c14655-718c-4c34-b445-30f52fbaf1c3 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:43:42.772054 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-a8c14655-718c-4c34-b445-30f52fbaf1c3 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: bced4f24-572a-4316-97e8-3ceedc61a621] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:43:42.789203 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-a8c14655-718c-4c34-b445-30f52fbaf1c3 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:43:42.790004 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-a8c14655-718c-4c34-b445-30f52fbaf1c3 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:43:42.790935 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-a8c14655-718c-4c34-b445-30f52fbaf1c3 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:43:42.791746 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-a8c14655-718c-4c34-b445-30f52fbaf1c3 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:43:42.902184 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-60f8de65-3c41-4b2c-96cb-623e618c8d23 tempest-VolumesGetTestJSON-1146167361 tempest-VolumesGetTestJSON-1146167361-project] Action: 'create', calling method: .version_select at 0x7fbc069285e0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-100838781", "metadata": {"Type": "work"}}} {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 15:43:43.122631 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-a8c14655-718c-4c34-b445-30f52fbaf1c3 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96b599f8890b4281a7e311cf37a039e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d7fcab5d3f465793d650f16c6ea8de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:43:43.136218 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-a8c14655-718c-4c34-b445-30f52fbaf1c3 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/bced4f24-572a-4316-97e8-3ceedc61a621" status: 200 len: 1520 microversion: 2.1 time: 0.370269 Oct 27 15:43:43.138012 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 89/207] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:43:42 2021] GET /compute/v2.1/servers/bced4f24-572a-4316-97e8-3ceedc61a621 => generated 1520 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 15:43:43.275762 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-60f8de65-3c41-4b2c-96cb-623e618c8d23 tempest-VolumesGetTestJSON-1146167361 tempest-VolumesGetTestJSON-1146167361-project] 10.222.0.64 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 0.580520 Oct 27 15:43:43.276433 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 119/208] 10.222.0.64 () {60 vars in 1155 bytes} [Wed Oct 27 15:43:42 2021] POST /compute/v2.1/os-volumes => generated 352 bytes in 582 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Oct 27 15:43:43.290719 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [req-5e9ef356-72ec-42ff-9437-fdd09429eef4 req-d5b7c61c-d5aa-4f57-9ad9-c783a6b6d2cf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a2e6d3ca-9ddb-4f28-908a-24d8705fb320", "tag": "63ec4f11-578e-4a46-9aa2-ef65a12a2552"}]} {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 15:43:43.292510 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 27 15:43:43.292510 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: warnings.warn(msg) Oct 27 15:43:43.300898 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-a3976c6d-9c88-46f0-b2df-0d870fa389d3 tempest-VolumesGetTestJSON-1146167361 tempest-VolumesGetTestJSON-1146167361-project] Calling method '.version_select at 0x7fbc067a49d0>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:43:43.302535 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [req-5e9ef356-72ec-42ff-9437-fdd09429eef4 req-d5b7c61c-d5aa-4f57-9ad9-c783a6b6d2cf service nova] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:43:43.307294 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [req-5e9ef356-72ec-42ff-9437-fdd09429eef4 req-d5b7c61c-d5aa-4f57-9ad9-c783a6b6d2cf service nova] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:43:43.343449 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.compute.server_external_events [req-5e9ef356-72ec-42ff-9437-fdd09429eef4 req-d5b7c61c-d5aa-4f57-9ad9-c783a6b6d2cf service nova] Creating event network-changed:63ec4f11-578e-4a46-9aa2-ef65a12a2552 for instance a2e6d3ca-9ddb-4f28-908a-24d8705fb320 on hv-cinder-80070 Oct 27 15:43:43.350570 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [req-5e9ef356-72ec-42ff-9437-fdd09429eef4 req-d5b7c61c-d5aa-4f57-9ad9-c783a6b6d2cf service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064173 Oct 27 15:43:43.351190 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 120/209] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Oct 27 15:43:43 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 15:43:43.367807 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-a3976c6d-9c88-46f0-b2df-0d870fa389d3 tempest-VolumesGetTestJSON-1146167361 tempest-VolumesGetTestJSON-1146167361-project] 10.222.0.64 "GET /compute/v2.1/os-volumes/3ea2545b-6ba1-43bb-b1d4-65d81675391f" status: 200 len: 352 microversion: 2.1 time: 0.082349 Oct 27 15:43:43.368554 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 90/210] 10.222.0.64 () {58 vars in 1244 bytes} [Wed Oct 27 15:43:43 2021] GET /compute/v2.1/os-volumes/3ea2545b-6ba1-43bb-b1d4-65d81675391f => generated 352 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 15:43:43.407761 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-5444a6b1-d240-4cc6-a628-07e1d633d812 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:43:43.408827 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-5444a6b1-d240-4cc6-a628-07e1d633d812 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] [instance: a2e6d3ca-9ddb-4f28-908a-24d8705fb320] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:43:43.416915 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-5444a6b1-d240-4cc6-a628-07e1d633d812 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:43:43.418280 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-5444a6b1-d240-4cc6-a628-07e1d633d812 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:43:43.419714 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-5444a6b1-d240-4cc6-a628-07e1d633d812 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:43:43.420193 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-5444a6b1-d240-4cc6-a628-07e1d633d812 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:43:43.485066 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-fd47ac04-ac32-40a8-8515-0a0e8069559d tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 15:43:43.486579 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-fd47ac04-ac32-40a8-8515-0a0e8069559d tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:43:43.494826 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-fd47ac04-ac32-40a8-8515-0a0e8069559d tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:43:43.495279 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-fd47ac04-ac32-40a8-8515-0a0e8069559d tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:43:43.496216 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-fd47ac04-ac32-40a8-8515-0a0e8069559d tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:43:43.496787 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-fd47ac04-ac32-40a8-8515-0a0e8069559d tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:43:43.599060 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-fd47ac04-ac32-40a8-8515-0a0e8069559d tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "POST /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672/action" status: 200 len: 14 microversion: 2.20 time: 0.117524 Oct 27 15:43:43.603012 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 91/211] 10.222.0.64 () {62 vars in 1318 bytes} [Wed Oct 27 15:43:43 2021] POST /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672/action => generated 14 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 15:43:43.608421 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-6c491ca5-91da-49ec-b39d-3ae39977030b tempest-VolumesActionsTest-1850781407 tempest-VolumesActionsTest-1850781407-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:43:43.611908 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-6c491ca5-91da-49ec-b39d-3ae39977030b tempest-VolumesActionsTest-1850781407 tempest-VolumesActionsTest-1850781407-project] [instance: 48a2ef84-6477-44cd-a1f6-bac51ae67fa4] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:43:43.618947 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-6c491ca5-91da-49ec-b39d-3ae39977030b tempest-VolumesActionsTest-1850781407 tempest-VolumesActionsTest-1850781407-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:43:43.619623 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-6c491ca5-91da-49ec-b39d-3ae39977030b tempest-VolumesActionsTest-1850781407 tempest-VolumesActionsTest-1850781407-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:43:43.620583 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-6c491ca5-91da-49ec-b39d-3ae39977030b tempest-VolumesActionsTest-1850781407 tempest-VolumesActionsTest-1850781407-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:43:43.621078 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-6c491ca5-91da-49ec-b39d-3ae39977030b tempest-VolumesActionsTest-1850781407 tempest-VolumesActionsTest-1850781407-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:43:43.636840 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.wsgi [None req-6c491ca5-91da-49ec-b39d-3ae39977030b tempest-VolumesActionsTest-1850781407 tempest-VolumesActionsTest-1850781407-project] HTTP exception thrown: Instance 48a2ef84-6477-44cd-a1f6-bac51ae67fa4 could not be found. Oct 27 15:43:43.637413 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-6c491ca5-91da-49ec-b39d-3ae39977030b tempest-VolumesActionsTest-1850781407 tempest-VolumesActionsTest-1850781407-project] Returning 404 to user: Instance 48a2ef84-6477-44cd-a1f6-bac51ae67fa4 could not be found. {{(pid=122225) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 27 15:43:43.638229 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-6c491ca5-91da-49ec-b39d-3ae39977030b tempest-VolumesActionsTest-1850781407 tempest-VolumesActionsTest-1850781407-project] 10.222.0.64 "GET /compute/v2.1/servers/48a2ef84-6477-44cd-a1f6-bac51ae67fa4" status: 404 len: 111 microversion: 2.1 time: 0.034014 Oct 27 15:43:43.638774 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 92/212] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:43:43 2021] GET /compute/v2.1/servers/48a2ef84-6477-44cd-a1f6-bac51ae67fa4 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 15:43:43.691515 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-5444a6b1-d240-4cc6-a628-07e1d633d812 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0abe23cb5f314bc883ef7958b0ed9b5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fc48df471f247809d82ddf926bfdc6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:43:43.699266 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-5444a6b1-d240-4cc6-a628-07e1d633d812 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] 10.222.0.64 "GET /compute/v2.1/servers/a2e6d3ca-9ddb-4f28-908a-24d8705fb320" status: 200 len: 1317 microversion: 2.1 time: 0.297295 Oct 27 15:43:43.699837 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 121/213] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:43:43 2021] GET /compute/v2.1/servers/a2e6d3ca-9ddb-4f28-908a-24d8705fb320 => generated 1317 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 15:43:43.748691 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-96659275-9c95-4091-a965-ce593e589d76 tempest-VolumesActionsTest-1850781407 tempest-VolumesActionsTest-1850781407-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1915545579", "imageRef": "b585ffbc-6a36-48c9-81b3-e26f9bd0fcba", "flavorRef": "452", "networks": [{"uuid": "d9920b1a-dba1-47a3-9b0b-5332bfa99d8e"}]}} {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 15:43:43.805505 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.network.neutron [None req-96659275-9c95-4091-a965-ce593e589d76 tempest-VolumesActionsTest-1850781407 tempest-VolumesActionsTest-1850781407-project] validate_networks() for [('d9920b1a-dba1-47a3-9b0b-5332bfa99d8e', None, None, None, None, None)] {{(pid=122225) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Oct 27 15:43:44.154615 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-e3d56a72-65f6-4930-8799-b74516834c3d tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:43:44.155479 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-e3d56a72-65f6-4930-8799-b74516834c3d tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: bced4f24-572a-4316-97e8-3ceedc61a621] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:43:44.163753 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-e3d56a72-65f6-4930-8799-b74516834c3d tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:43:44.164451 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-e3d56a72-65f6-4930-8799-b74516834c3d tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:43:44.165408 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-e3d56a72-65f6-4930-8799-b74516834c3d tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:43:44.166024 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-e3d56a72-65f6-4930-8799-b74516834c3d tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:43:44.255678 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.virt.hardware [None req-96659275-9c95-4091-a965-ce593e589d76 tempest-VolumesActionsTest-1850781407 tempest-VolumesActionsTest-1850781407-project] Flavor limits 0:0:0 {{(pid=122225) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 15:43:44.256336 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.virt.hardware [None req-96659275-9c95-4091-a965-ce593e589d76 tempest-VolumesActionsTest-1850781407 tempest-VolumesActionsTest-1850781407-project] Image limits 0:0:0 {{(pid=122225) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 15:43:44.256972 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.virt.hardware [None req-96659275-9c95-4091-a965-ce593e589d76 tempest-VolumesActionsTest-1850781407 tempest-VolumesActionsTest-1850781407-project] Flavor pref 0:0:0 {{(pid=122225) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 15:43:44.257375 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.virt.hardware [None req-96659275-9c95-4091-a965-ce593e589d76 tempest-VolumesActionsTest-1850781407 tempest-VolumesActionsTest-1850781407-project] Image pref 0:0:0 {{(pid=122225) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 15:43:44.257950 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.virt.hardware [None req-96659275-9c95-4091-a965-ce593e589d76 tempest-VolumesActionsTest-1850781407 tempest-VolumesActionsTest-1850781407-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122225) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 15:43:44.268511 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-96659275-9c95-4091-a965-ce593e589d76 tempest-VolumesActionsTest-1850781407 tempest-VolumesActionsTest-1850781407-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:43:44.269356 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-96659275-9c95-4091-a965-ce593e589d76 tempest-VolumesActionsTest-1850781407 tempest-VolumesActionsTest-1850781407-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:43:44.270338 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-96659275-9c95-4091-a965-ce593e589d76 tempest-VolumesActionsTest-1850781407 tempest-VolumesActionsTest-1850781407-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:43:44.270980 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-96659275-9c95-4091-a965-ce593e589d76 tempest-VolumesActionsTest-1850781407 tempest-VolumesActionsTest-1850781407-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:43:44.292109 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.quota [None req-96659275-9c95-4091-a965-ce593e589d76 tempest-VolumesActionsTest-1850781407 tempest-VolumesActionsTest-1850781407-project] Getting quotas for project eef06dd988f343e7ae8ccf2c93217e9f. Resources: {'ram', 'instances', 'cores'} {{(pid=122225) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 27 15:43:44.296967 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.quota [None req-96659275-9c95-4091-a965-ce593e589d76 tempest-VolumesActionsTest-1850781407 tempest-VolumesActionsTest-1850781407-project] Getting quotas for user f44b5c1ad2204da1935d8cb7ea8bc67e and project eef06dd988f343e7ae8ccf2c93217e9f. Resources: {'ram', 'instances', 'cores'} {{(pid=122225) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 27 15:43:44.309895 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-96659275-9c95-4091-a965-ce593e589d76 tempest-VolumesActionsTest-1850781407 tempest-VolumesActionsTest-1850781407-project] Going to run 1 instances... {{(pid=122225) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Oct 27 15:43:44.312615 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-96659275-9c95-4091-a965-ce593e589d76 tempest-VolumesActionsTest-1850781407 tempest-VolumesActionsTest-1850781407-project] [instance: b355f088-15f6-4993-bf18-d99417b40f98] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b585ffbc-6a36-48c9-81b3-e26f9bd0fcba',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122225) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Oct 27 15:43:44.370203 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-96659275-9c95-4091-a965-ce593e589d76 tempest-VolumesActionsTest-1850781407 tempest-VolumesActionsTest-1850781407-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.625092 Oct 27 15:43:44.371959 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 93/214] 10.222.0.64 () {60 vars in 1146 bytes} [Wed Oct 27 15:43:43 2021] POST /compute/v2.1/servers => generated 380 bytes in 627 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 15:43:44.387267 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-47e53969-01ec-4abc-87f6-b79a3134f912 tempest-VolumesGetTestJSON-1146167361 tempest-VolumesGetTestJSON-1146167361-project] Calling method '.version_select at 0x7fbc067a0a60>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:43:44.403364 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-e3d56a72-65f6-4930-8799-b74516834c3d tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96b599f8890b4281a7e311cf37a039e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d7fcab5d3f465793d650f16c6ea8de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:43:44.418992 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-e3d56a72-65f6-4930-8799-b74516834c3d tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/bced4f24-572a-4316-97e8-3ceedc61a621" status: 200 len: 1520 microversion: 2.1 time: 0.267570 Oct 27 15:43:44.419862 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 122/215] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:43:44 2021] GET /compute/v2.1/servers/bced4f24-572a-4316-97e8-3ceedc61a621 => generated 1520 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 15:43:44.435402 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-ac131eb5-e758-46d6-8c1d-e098a40b453a tempest-VolumesActionsTest-1850781407 tempest-VolumesActionsTest-1850781407-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:43:44.436043 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-ac131eb5-e758-46d6-8c1d-e098a40b453a tempest-VolumesActionsTest-1850781407 tempest-VolumesActionsTest-1850781407-project] [instance: b355f088-15f6-4993-bf18-d99417b40f98] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:43:44.454522 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-47e53969-01ec-4abc-87f6-b79a3134f912 tempest-VolumesGetTestJSON-1146167361 tempest-VolumesGetTestJSON-1146167361-project] 10.222.0.64 "GET /compute/v2.1/os-volumes/3ea2545b-6ba1-43bb-b1d4-65d81675391f" status: 200 len: 353 microversion: 2.1 time: 0.074132 Oct 27 15:43:44.455102 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 94/216] 10.222.0.64 () {58 vars in 1244 bytes} [Wed Oct 27 15:43:44 2021] GET /compute/v2.1/os-volumes/3ea2545b-6ba1-43bb-b1d4-65d81675391f => generated 353 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 15:43:44.465977 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-a8cd06dc-d080-4e4d-a890-30b2a41d301d tempest-VolumesGetTestJSON-1146167361 tempest-VolumesGetTestJSON-1146167361-project] Calling method '.version_select at 0x7fbc067a08b0>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:43:44.530490 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-a8cd06dc-d080-4e4d-a890-30b2a41d301d tempest-VolumesGetTestJSON-1146167361 tempest-VolumesGetTestJSON-1146167361-project] 10.222.0.64 "GET /compute/v2.1/os-volumes/3ea2545b-6ba1-43bb-b1d4-65d81675391f" status: 200 len: 353 microversion: 2.1 time: 0.067905 Oct 27 15:43:44.531059 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 95/217] 10.222.0.64 () {58 vars in 1244 bytes} [Wed Oct 27 15:43:44 2021] GET /compute/v2.1/os-volumes/3ea2545b-6ba1-43bb-b1d4-65d81675391f => generated 353 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 15:43:44.553307 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-57e98a3c-1cea-4ad8-b883-33262656f6a1 tempest-VolumesGetTestJSON-1146167361 tempest-VolumesGetTestJSON-1146167361-project] Calling method '.version_select at 0x7fbc069305e0>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:43:44.563929 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-ac131eb5-e758-46d6-8c1d-e098a40b453a tempest-VolumesActionsTest-1850781407 tempest-VolumesActionsTest-1850781407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f44b5c1ad2204da1935d8cb7ea8bc67e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eef06dd988f343e7ae8ccf2c93217e9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:43:44.581030 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-ac131eb5-e758-46d6-8c1d-e098a40b453a tempest-VolumesActionsTest-1850781407 tempest-VolumesActionsTest-1850781407-project] 10.222.0.64 "GET /compute/v2.1/servers/b355f088-15f6-4993-bf18-d99417b40f98" status: 200 len: 1214 microversion: 2.1 time: 0.155856 Oct 27 15:43:44.591648 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 123/218] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:43:44 2021] GET /compute/v2.1/servers/b355f088-15f6-4993-bf18-d99417b40f98 => generated 1214 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 15:43:44.612021 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-0cf09363-0597-4744-b749-d04957e6daa0 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 15:43:44.613503 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-0cf09363-0597-4744-b749-d04957e6daa0 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:43:44.620673 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-0cf09363-0597-4744-b749-d04957e6daa0 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:43:44.621586 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-0cf09363-0597-4744-b749-d04957e6daa0 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:43:44.622691 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-0cf09363-0597-4744-b749-d04957e6daa0 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:43:44.623669 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-0cf09363-0597-4744-b749-d04957e6daa0 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:43:44.631430 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-57e98a3c-1cea-4ad8-b883-33262656f6a1 tempest-VolumesGetTestJSON-1146167361 tempest-VolumesGetTestJSON-1146167361-project] 10.222.0.64 "DELETE /compute/v2.1/os-volumes/3ea2545b-6ba1-43bb-b1d4-65d81675391f" status: 202 len: 0 microversion: 2.1 time: 0.086164 Oct 27 15:43:44.632360 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 96/219] 10.222.0.64 () {58 vars in 1247 bytes} [Wed Oct 27 15:43:44 2021] DELETE /compute/v2.1/os-volumes/3ea2545b-6ba1-43bb-b1d4-65d81675391f => generated 0 bytes in 88 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 15:43:44.650435 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-bcd7fbe1-c84c-4e8f-9d86-96ce1cadc099 tempest-VolumesGetTestJSON-1146167361 tempest-VolumesGetTestJSON-1146167361-project] Calling method '.version_select at 0x7fbc0676e790>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:43:44.752673 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-0cf09363-0597-4744-b749-d04957e6daa0 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "POST /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672/action" status: 200 len: 14 microversion: 2.20 time: 0.145133 Oct 27 15:43:44.753824 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 124/220] 10.222.0.64 () {62 vars in 1318 bytes} [Wed Oct 27 15:43:44 2021] POST /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672/action => generated 14 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 15:43:44.759634 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-1bbbcdf4-e293-41ca-8c6c-c76ff8583118 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:43:44.761039 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-1bbbcdf4-e293-41ca-8c6c-c76ff8583118 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] [instance: a2e6d3ca-9ddb-4f28-908a-24d8705fb320] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:43:44.772829 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-1bbbcdf4-e293-41ca-8c6c-c76ff8583118 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:43:44.774263 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-1bbbcdf4-e293-41ca-8c6c-c76ff8583118 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:43:44.775217 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-1bbbcdf4-e293-41ca-8c6c-c76ff8583118 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:43:44.775756 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-1bbbcdf4-e293-41ca-8c6c-c76ff8583118 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:43:44.783805 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-bcd7fbe1-c84c-4e8f-9d86-96ce1cadc099 tempest-VolumesGetTestJSON-1146167361 tempest-VolumesGetTestJSON-1146167361-project] 10.222.0.64 "GET /compute/v2.1/os-volumes/3ea2545b-6ba1-43bb-b1d4-65d81675391f" status: 200 len: 352 microversion: 2.1 time: 0.146552 Oct 27 15:43:44.795202 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 97/221] 10.222.0.64 () {58 vars in 1244 bytes} [Wed Oct 27 15:43:44 2021] GET /compute/v2.1/os-volumes/3ea2545b-6ba1-43bb-b1d4-65d81675391f => generated 352 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 15:43:44.941659 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-1bbbcdf4-e293-41ca-8c6c-c76ff8583118 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0abe23cb5f314bc883ef7958b0ed9b5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fc48df471f247809d82ddf926bfdc6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:43:44.949955 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-1bbbcdf4-e293-41ca-8c6c-c76ff8583118 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] 10.222.0.64 "GET /compute/v2.1/servers/a2e6d3ca-9ddb-4f28-908a-24d8705fb320" status: 200 len: 1317 microversion: 2.1 time: 0.194756 Oct 27 15:43:44.950610 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 125/222] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:43:44 2021] GET /compute/v2.1/servers/a2e6d3ca-9ddb-4f28-908a-24d8705fb320 => generated 1317 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 15:43:45.437238 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-48b2dce9-b3a5-414f-84e7-e9a5647497d4 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:43:45.437924 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-48b2dce9-b3a5-414f-84e7-e9a5647497d4 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: bced4f24-572a-4316-97e8-3ceedc61a621] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:43:45.445109 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-48b2dce9-b3a5-414f-84e7-e9a5647497d4 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:43:45.445551 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-48b2dce9-b3a5-414f-84e7-e9a5647497d4 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:43:45.446291 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-48b2dce9-b3a5-414f-84e7-e9a5647497d4 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:43:45.446712 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-48b2dce9-b3a5-414f-84e7-e9a5647497d4 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:43:45.566290 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-48b2dce9-b3a5-414f-84e7-e9a5647497d4 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96b599f8890b4281a7e311cf37a039e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d7fcab5d3f465793d650f16c6ea8de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:43:45.573429 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-48b2dce9-b3a5-414f-84e7-e9a5647497d4 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/bced4f24-572a-4316-97e8-3ceedc61a621" status: 200 len: 1520 microversion: 2.1 time: 0.140274 Oct 27 15:43:45.573991 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 98/223] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:43:45 2021] GET /compute/v2.1/servers/bced4f24-572a-4316-97e8-3ceedc61a621 => generated 1520 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 15:43:45.597846 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-5931a2f6-ff9f-494c-9037-f775e19e4bfb tempest-VolumesActionsTest-1850781407 tempest-VolumesActionsTest-1850781407-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:43:45.598631 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-5931a2f6-ff9f-494c-9037-f775e19e4bfb tempest-VolumesActionsTest-1850781407 tempest-VolumesActionsTest-1850781407-project] [instance: b355f088-15f6-4993-bf18-d99417b40f98] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:43:45.605424 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-5931a2f6-ff9f-494c-9037-f775e19e4bfb tempest-VolumesActionsTest-1850781407 tempest-VolumesActionsTest-1850781407-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:43:45.605883 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-5931a2f6-ff9f-494c-9037-f775e19e4bfb tempest-VolumesActionsTest-1850781407 tempest-VolumesActionsTest-1850781407-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:43:45.606672 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-5931a2f6-ff9f-494c-9037-f775e19e4bfb tempest-VolumesActionsTest-1850781407 tempest-VolumesActionsTest-1850781407-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:43:45.607108 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-5931a2f6-ff9f-494c-9037-f775e19e4bfb tempest-VolumesActionsTest-1850781407 tempest-VolumesActionsTest-1850781407-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:43:45.665379 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-5931a2f6-ff9f-494c-9037-f775e19e4bfb tempest-VolumesActionsTest-1850781407 tempest-VolumesActionsTest-1850781407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f44b5c1ad2204da1935d8cb7ea8bc67e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eef06dd988f343e7ae8ccf2c93217e9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:43:45.672456 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-5931a2f6-ff9f-494c-9037-f775e19e4bfb tempest-VolumesActionsTest-1850781407 tempest-VolumesActionsTest-1850781407-project] 10.222.0.64 "GET /compute/v2.1/servers/b355f088-15f6-4993-bf18-d99417b40f98" status: 200 len: 1266 microversion: 2.1 time: 0.078535 Oct 27 15:43:45.673193 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 126/224] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:43:45 2021] GET /compute/v2.1/servers/b355f088-15f6-4993-bf18-d99417b40f98 => generated 1266 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 15:43:45.764188 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-c336c0f7-407a-42d2-aec3-cf7c29869bd7 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 15:43:45.765019 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-c336c0f7-407a-42d2-aec3-cf7c29869bd7 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:43:45.772481 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-c336c0f7-407a-42d2-aec3-cf7c29869bd7 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:43:45.773361 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-c336c0f7-407a-42d2-aec3-cf7c29869bd7 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:43:45.774398 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-c336c0f7-407a-42d2-aec3-cf7c29869bd7 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:43:45.774947 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-c336c0f7-407a-42d2-aec3-cf7c29869bd7 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:43:45.796612 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-c2e57cf0-9520-4020-8faa-98d85de8a05e tempest-VolumesGetTestJSON-1146167361 tempest-VolumesGetTestJSON-1146167361-project] Calling method '.version_select at 0x7fbc060f8b80>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:43:45.826177 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.wsgi [None req-c2e57cf0-9520-4020-8faa-98d85de8a05e tempest-VolumesGetTestJSON-1146167361 tempest-VolumesGetTestJSON-1146167361-project] HTTP exception thrown: Volume 3ea2545b-6ba1-43bb-b1d4-65d81675391f could not be found. Oct 27 15:43:45.826783 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-c2e57cf0-9520-4020-8faa-98d85de8a05e tempest-VolumesGetTestJSON-1146167361 tempest-VolumesGetTestJSON-1146167361-project] Returning 404 to user: Volume 3ea2545b-6ba1-43bb-b1d4-65d81675391f could not be found. {{(pid=122224) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 27 15:43:45.827606 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-c2e57cf0-9520-4020-8faa-98d85de8a05e tempest-VolumesGetTestJSON-1146167361 tempest-VolumesGetTestJSON-1146167361-project] 10.222.0.64 "GET /compute/v2.1/os-volumes/3ea2545b-6ba1-43bb-b1d4-65d81675391f" status: 404 len: 109 microversion: 2.1 time: 0.034784 Oct 27 15:43:45.832013 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 127/225] 10.222.0.64 () {58 vars in 1244 bytes} [Wed Oct 27 15:43:45 2021] GET /compute/v2.1/os-volumes/3ea2545b-6ba1-43bb-b1d4-65d81675391f => generated 109 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 27 15:43:45.860336 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-c336c0f7-407a-42d2-aec3-cf7c29869bd7 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "POST /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672/action" status: 200 len: 6451 microversion: 2.20 time: 0.099869 Oct 27 15:43:45.867008 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 99/226] 10.222.0.64 () {62 vars in 1318 bytes} [Wed Oct 27 15:43:45 2021] POST /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672/action => generated 6451 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 15:43:45.968450 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-84134f2b-ad1b-4b30-b9b5-9bb8d6da1f6f tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:43:45.969352 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-84134f2b-ad1b-4b30-b9b5-9bb8d6da1f6f tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] [instance: a2e6d3ca-9ddb-4f28-908a-24d8705fb320] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:43:45.977343 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-84134f2b-ad1b-4b30-b9b5-9bb8d6da1f6f tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:43:45.977796 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-84134f2b-ad1b-4b30-b9b5-9bb8d6da1f6f tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:43:45.978813 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-84134f2b-ad1b-4b30-b9b5-9bb8d6da1f6f tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:43:45.979225 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-84134f2b-ad1b-4b30-b9b5-9bb8d6da1f6f tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:43:46.183802 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-84134f2b-ad1b-4b30-b9b5-9bb8d6da1f6f tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0abe23cb5f314bc883ef7958b0ed9b5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fc48df471f247809d82ddf926bfdc6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:43:46.192197 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-84134f2b-ad1b-4b30-b9b5-9bb8d6da1f6f tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] 10.222.0.64 "GET /compute/v2.1/servers/a2e6d3ca-9ddb-4f28-908a-24d8705fb320" status: 200 len: 1317 microversion: 2.1 time: 0.228288 Oct 27 15:43:46.201959 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 128/227] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:43:45 2021] GET /compute/v2.1/servers/a2e6d3ca-9ddb-4f28-908a-24d8705fb320 => generated 1317 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 15:43:46.592673 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-8161231e-446c-4139-823f-ca9ea752185c tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:43:46.594234 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-8161231e-446c-4139-823f-ca9ea752185c tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: bced4f24-572a-4316-97e8-3ceedc61a621] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:43:46.603953 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-8161231e-446c-4139-823f-ca9ea752185c tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:43:46.604643 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-8161231e-446c-4139-823f-ca9ea752185c tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:43:46.607325 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-8161231e-446c-4139-823f-ca9ea752185c tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:43:46.608225 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-8161231e-446c-4139-823f-ca9ea752185c tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:43:46.689583 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-fd763d67-78d6-476c-942f-cc49d6a8e919 tempest-VolumesActionsTest-1850781407 tempest-VolumesActionsTest-1850781407-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:43:46.691737 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-fd763d67-78d6-476c-942f-cc49d6a8e919 tempest-VolumesActionsTest-1850781407 tempest-VolumesActionsTest-1850781407-project] [instance: b355f088-15f6-4993-bf18-d99417b40f98] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:43:46.706446 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-fd763d67-78d6-476c-942f-cc49d6a8e919 tempest-VolumesActionsTest-1850781407 tempest-VolumesActionsTest-1850781407-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:43:46.706907 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-fd763d67-78d6-476c-942f-cc49d6a8e919 tempest-VolumesActionsTest-1850781407 tempest-VolumesActionsTest-1850781407-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:43:46.709225 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-fd763d67-78d6-476c-942f-cc49d6a8e919 tempest-VolumesActionsTest-1850781407 tempest-VolumesActionsTest-1850781407-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:43:46.709825 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-fd763d67-78d6-476c-942f-cc49d6a8e919 tempest-VolumesActionsTest-1850781407 tempest-VolumesActionsTest-1850781407-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:43:46.778435 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-8161231e-446c-4139-823f-ca9ea752185c tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96b599f8890b4281a7e311cf37a039e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d7fcab5d3f465793d650f16c6ea8de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:43:46.791701 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-8161231e-446c-4139-823f-ca9ea752185c tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/bced4f24-572a-4316-97e8-3ceedc61a621" status: 200 len: 1520 microversion: 2.1 time: 0.203829 Oct 27 15:43:46.793030 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 100/228] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:43:46 2021] GET /compute/v2.1/servers/bced4f24-572a-4316-97e8-3ceedc61a621 => generated 1520 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 15:43:46.877057 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-c30de0cc-b0f7-492a-9868-a4a8a43fb5a7 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 15:43:46.879118 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-c30de0cc-b0f7-492a-9868-a4a8a43fb5a7 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:43:46.887076 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-c30de0cc-b0f7-492a-9868-a4a8a43fb5a7 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:43:46.887505 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-c30de0cc-b0f7-492a-9868-a4a8a43fb5a7 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:43:46.888655 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-c30de0cc-b0f7-492a-9868-a4a8a43fb5a7 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:43:46.889228 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-c30de0cc-b0f7-492a-9868-a4a8a43fb5a7 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:43:46.990828 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-fd763d67-78d6-476c-942f-cc49d6a8e919 tempest-VolumesActionsTest-1850781407 tempest-VolumesActionsTest-1850781407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f44b5c1ad2204da1935d8cb7ea8bc67e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eef06dd988f343e7ae8ccf2c93217e9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:43:47.000205 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-fd763d67-78d6-476c-942f-cc49d6a8e919 tempest-VolumesActionsTest-1850781407 tempest-VolumesActionsTest-1850781407-project] 10.222.0.64 "GET /compute/v2.1/servers/b355f088-15f6-4993-bf18-d99417b40f98" status: 200 len: 1314 microversion: 2.1 time: 0.314554 Oct 27 15:43:47.000864 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 129/229] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:43:46 2021] GET /compute/v2.1/servers/b355f088-15f6-4993-bf18-d99417b40f98 => generated 1314 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 15:43:47.001235 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-c30de0cc-b0f7-492a-9868-a4a8a43fb5a7 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "POST /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672/action" status: 200 len: 10701 microversion: 2.20 time: 0.127864 Oct 27 15:43:47.001971 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 101/230] 10.222.0.64 () {62 vars in 1318 bytes} [Wed Oct 27 15:43:46 2021] POST /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672/action => generated 10701 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 27 15:43:47.210272 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-a0b4d576-4547-4860-9257-430d875aad9c tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:43:47.210884 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-a0b4d576-4547-4860-9257-430d875aad9c tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] [instance: a2e6d3ca-9ddb-4f28-908a-24d8705fb320] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:43:47.218346 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-a0b4d576-4547-4860-9257-430d875aad9c tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:43:47.219237 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-a0b4d576-4547-4860-9257-430d875aad9c tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:43:47.220397 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-a0b4d576-4547-4860-9257-430d875aad9c tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:43:47.221060 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-a0b4d576-4547-4860-9257-430d875aad9c tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:43:47.429371 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-a0b4d576-4547-4860-9257-430d875aad9c tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0abe23cb5f314bc883ef7958b0ed9b5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fc48df471f247809d82ddf926bfdc6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:43:47.436616 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-a0b4d576-4547-4860-9257-430d875aad9c tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] 10.222.0.64 "GET /compute/v2.1/servers/a2e6d3ca-9ddb-4f28-908a-24d8705fb320" status: 200 len: 1317 microversion: 2.1 time: 0.230781 Oct 27 15:43:47.437190 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 130/231] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:43:47 2021] GET /compute/v2.1/servers/a2e6d3ca-9ddb-4f28-908a-24d8705fb320 => generated 1317 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 15:43:47.525202 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [req-463aaf9c-6592-44ac-b3fe-68b9701f66c8 req-de8c6bd6-a084-4c81-a6e2-8686873b657a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b355f088-15f6-4993-bf18-d99417b40f98", "tag": "74629cf8-105c-46a7-9f14-6b76b6add445"}]} {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 15:43:47.526836 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 27 15:43:47.526836 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: warnings.warn(msg) Oct 27 15:43:47.548558 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [req-463aaf9c-6592-44ac-b3fe-68b9701f66c8 req-de8c6bd6-a084-4c81-a6e2-8686873b657a service nova] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:43:47.550010 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [req-463aaf9c-6592-44ac-b3fe-68b9701f66c8 req-de8c6bd6-a084-4c81-a6e2-8686873b657a service nova] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:43:47.562810 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.compute.server_external_events [req-463aaf9c-6592-44ac-b3fe-68b9701f66c8 req-de8c6bd6-a084-4c81-a6e2-8686873b657a service nova] Creating event network-changed:74629cf8-105c-46a7-9f14-6b76b6add445 for instance b355f088-15f6-4993-bf18-d99417b40f98 on hv-cinder-80070 Oct 27 15:43:47.568456 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [req-463aaf9c-6592-44ac-b3fe-68b9701f66c8 req-de8c6bd6-a084-4c81-a6e2-8686873b657a service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047750 Oct 27 15:43:47.569732 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 102/232] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Oct 27 15:43:47 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 15:43:47.809465 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-56efd6c2-cd97-4824-a5c2-f1a938a36afb tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:43:47.810632 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-56efd6c2-cd97-4824-a5c2-f1a938a36afb tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: bced4f24-572a-4316-97e8-3ceedc61a621] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:43:47.818952 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-56efd6c2-cd97-4824-a5c2-f1a938a36afb tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:43:47.819533 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-56efd6c2-cd97-4824-a5c2-f1a938a36afb tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:43:47.820503 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-56efd6c2-cd97-4824-a5c2-f1a938a36afb tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:43:47.820932 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-56efd6c2-cd97-4824-a5c2-f1a938a36afb tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:43:48.018114 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-02afdb6b-70b4-422a-aba2-1743beaa77ed tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 15:43:48.019108 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-02afdb6b-70b4-422a-aba2-1743beaa77ed tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:43:48.026618 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-02afdb6b-70b4-422a-aba2-1743beaa77ed tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:43:48.027332 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-02afdb6b-70b4-422a-aba2-1743beaa77ed tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:43:48.028220 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-02afdb6b-70b4-422a-aba2-1743beaa77ed tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:43:48.028748 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-02afdb6b-70b4-422a-aba2-1743beaa77ed tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:43:48.130421 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-02afdb6b-70b4-422a-aba2-1743beaa77ed tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "POST /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672/action" status: 200 len: 15025 microversion: 2.20 time: 0.119188 Oct 27 15:43:48.131831 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 103/233] 10.222.0.64 () {62 vars in 1318 bytes} [Wed Oct 27 15:43:48 2021] POST /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672/action => generated 15025 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 27 15:43:48.138392 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-fa230d3d-0303-407d-9b29-ce6ef8a1c04b tempest-VolumesActionsTest-1850781407 tempest-VolumesActionsTest-1850781407-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:43:48.139125 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-fa230d3d-0303-407d-9b29-ce6ef8a1c04b tempest-VolumesActionsTest-1850781407 tempest-VolumesActionsTest-1850781407-project] [instance: b355f088-15f6-4993-bf18-d99417b40f98] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:43:48.152876 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-fa230d3d-0303-407d-9b29-ce6ef8a1c04b tempest-VolumesActionsTest-1850781407 tempest-VolumesActionsTest-1850781407-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:43:48.154075 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-fa230d3d-0303-407d-9b29-ce6ef8a1c04b tempest-VolumesActionsTest-1850781407 tempest-VolumesActionsTest-1850781407-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:43:48.154858 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-fa230d3d-0303-407d-9b29-ce6ef8a1c04b tempest-VolumesActionsTest-1850781407 tempest-VolumesActionsTest-1850781407-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:43:48.155458 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-fa230d3d-0303-407d-9b29-ce6ef8a1c04b tempest-VolumesActionsTest-1850781407 tempest-VolumesActionsTest-1850781407-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:43:48.238042 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-56efd6c2-cd97-4824-a5c2-f1a938a36afb tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96b599f8890b4281a7e311cf37a039e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d7fcab5d3f465793d650f16c6ea8de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:43:48.246469 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-56efd6c2-cd97-4824-a5c2-f1a938a36afb tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/bced4f24-572a-4316-97e8-3ceedc61a621" status: 200 len: 1520 microversion: 2.1 time: 0.440531 Oct 27 15:43:48.247392 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 131/234] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:43:47 2021] GET /compute/v2.1/servers/bced4f24-572a-4316-97e8-3ceedc61a621 => generated 1520 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 15:43:48.319726 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-fa230d3d-0303-407d-9b29-ce6ef8a1c04b tempest-VolumesActionsTest-1850781407 tempest-VolumesActionsTest-1850781407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f44b5c1ad2204da1935d8cb7ea8bc67e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eef06dd988f343e7ae8ccf2c93217e9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:43:48.327305 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-fa230d3d-0303-407d-9b29-ce6ef8a1c04b tempest-VolumesActionsTest-1850781407 tempest-VolumesActionsTest-1850781407-project] 10.222.0.64 "GET /compute/v2.1/servers/b355f088-15f6-4993-bf18-d99417b40f98" status: 200 len: 1314 microversion: 2.1 time: 0.193874 Oct 27 15:43:48.327878 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 104/235] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:43:48 2021] GET /compute/v2.1/servers/b355f088-15f6-4993-bf18-d99417b40f98 => generated 1314 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 15:43:48.453877 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-56958a05-7104-4412-9e46-9947a4956ca3 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:43:48.454482 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-56958a05-7104-4412-9e46-9947a4956ca3 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] [instance: a2e6d3ca-9ddb-4f28-908a-24d8705fb320] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:43:48.460844 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-56958a05-7104-4412-9e46-9947a4956ca3 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:43:48.461294 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-56958a05-7104-4412-9e46-9947a4956ca3 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:43:48.462063 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-56958a05-7104-4412-9e46-9947a4956ca3 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:43:48.462495 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-56958a05-7104-4412-9e46-9947a4956ca3 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:43:48.708442 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-56958a05-7104-4412-9e46-9947a4956ca3 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0abe23cb5f314bc883ef7958b0ed9b5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fc48df471f247809d82ddf926bfdc6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:43:48.720251 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-56958a05-7104-4412-9e46-9947a4956ca3 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] 10.222.0.64 "GET /compute/v2.1/servers/a2e6d3ca-9ddb-4f28-908a-24d8705fb320" status: 200 len: 1317 microversion: 2.1 time: 0.270694 Oct 27 15:43:48.721921 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 132/236] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:43:48 2021] GET /compute/v2.1/servers/a2e6d3ca-9ddb-4f28-908a-24d8705fb320 => generated 1317 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 15:43:49.144116 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-c0e04b59-34f7-45aa-85a7-c324622a0e8b tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 15:43:49.144994 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-c0e04b59-34f7-45aa-85a7-c324622a0e8b tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:43:49.151422 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-c0e04b59-34f7-45aa-85a7-c324622a0e8b tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:43:49.152103 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-c0e04b59-34f7-45aa-85a7-c324622a0e8b tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:43:49.152873 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-c0e04b59-34f7-45aa-85a7-c324622a0e8b tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:43:49.153387 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-c0e04b59-34f7-45aa-85a7-c324622a0e8b tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:43:49.265441 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-78c3e1c0-e365-42d7-ad92-ca2a6f8ed0cf tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:43:49.266401 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-78c3e1c0-e365-42d7-ad92-ca2a6f8ed0cf tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: bced4f24-572a-4316-97e8-3ceedc61a621] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:43:49.269251 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-c0e04b59-34f7-45aa-85a7-c324622a0e8b tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "POST /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672/action" status: 200 len: 17602 microversion: 2.20 time: 0.129084 Oct 27 15:43:49.273383 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 105/237] 10.222.0.64 () {62 vars in 1318 bytes} [Wed Oct 27 15:43:49 2021] POST /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672/action => generated 17602 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 27 15:43:49.273538 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-78c3e1c0-e365-42d7-ad92-ca2a6f8ed0cf tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:43:49.273766 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-78c3e1c0-e365-42d7-ad92-ca2a6f8ed0cf tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:43:49.274538 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-78c3e1c0-e365-42d7-ad92-ca2a6f8ed0cf tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:43:49.274966 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-78c3e1c0-e365-42d7-ad92-ca2a6f8ed0cf tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:43:49.346901 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-c42e4490-377a-4697-9d29-3b8173761153 tempest-VolumesActionsTest-1850781407 tempest-VolumesActionsTest-1850781407-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:43:49.347642 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-c42e4490-377a-4697-9d29-3b8173761153 tempest-VolumesActionsTest-1850781407 tempest-VolumesActionsTest-1850781407-project] [instance: b355f088-15f6-4993-bf18-d99417b40f98] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:43:49.357122 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-c42e4490-377a-4697-9d29-3b8173761153 tempest-VolumesActionsTest-1850781407 tempest-VolumesActionsTest-1850781407-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:43:49.357866 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-c42e4490-377a-4697-9d29-3b8173761153 tempest-VolumesActionsTest-1850781407 tempest-VolumesActionsTest-1850781407-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:43:49.358837 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-c42e4490-377a-4697-9d29-3b8173761153 tempest-VolumesActionsTest-1850781407 tempest-VolumesActionsTest-1850781407-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:43:49.359430 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-c42e4490-377a-4697-9d29-3b8173761153 tempest-VolumesActionsTest-1850781407 tempest-VolumesActionsTest-1850781407-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:43:49.425664 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-78c3e1c0-e365-42d7-ad92-ca2a6f8ed0cf tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96b599f8890b4281a7e311cf37a039e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d7fcab5d3f465793d650f16c6ea8de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:43:49.433453 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-78c3e1c0-e365-42d7-ad92-ca2a6f8ed0cf tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/bced4f24-572a-4316-97e8-3ceedc61a621" status: 200 len: 1520 microversion: 2.1 time: 0.172435 Oct 27 15:43:49.444004 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 133/238] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:43:49 2021] GET /compute/v2.1/servers/bced4f24-572a-4316-97e8-3ceedc61a621 => generated 1520 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 15:43:49.516362 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-c42e4490-377a-4697-9d29-3b8173761153 tempest-VolumesActionsTest-1850781407 tempest-VolumesActionsTest-1850781407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f44b5c1ad2204da1935d8cb7ea8bc67e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eef06dd988f343e7ae8ccf2c93217e9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:43:49.524546 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-c42e4490-377a-4697-9d29-3b8173761153 tempest-VolumesActionsTest-1850781407 tempest-VolumesActionsTest-1850781407-project] 10.222.0.64 "GET /compute/v2.1/servers/b355f088-15f6-4993-bf18-d99417b40f98" status: 200 len: 1314 microversion: 2.1 time: 0.182624 Oct 27 15:43:49.525543 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 106/239] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:43:49 2021] GET /compute/v2.1/servers/b355f088-15f6-4993-bf18-d99417b40f98 => generated 1314 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 15:43:49.738036 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-91474ccf-33a9-45a6-8997-2db8db4ff085 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:43:49.738644 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-91474ccf-33a9-45a6-8997-2db8db4ff085 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] [instance: a2e6d3ca-9ddb-4f28-908a-24d8705fb320] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:43:49.744594 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-91474ccf-33a9-45a6-8997-2db8db4ff085 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:43:49.745045 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-91474ccf-33a9-45a6-8997-2db8db4ff085 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:43:49.745809 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-91474ccf-33a9-45a6-8997-2db8db4ff085 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:43:49.746250 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-91474ccf-33a9-45a6-8997-2db8db4ff085 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:43:49.874945 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-91474ccf-33a9-45a6-8997-2db8db4ff085 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0abe23cb5f314bc883ef7958b0ed9b5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fc48df471f247809d82ddf926bfdc6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:43:49.889018 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-91474ccf-33a9-45a6-8997-2db8db4ff085 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] 10.222.0.64 "GET /compute/v2.1/servers/a2e6d3ca-9ddb-4f28-908a-24d8705fb320" status: 200 len: 1317 microversion: 2.1 time: 0.154615 Oct 27 15:43:49.889835 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 134/240] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:43:49 2021] GET /compute/v2.1/servers/a2e6d3ca-9ddb-4f28-908a-24d8705fb320 => generated 1317 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 15:43:50.280150 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-ef3b9d2e-f295-458c-91fc-ad29bcb2e868 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 15:43:50.281102 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-ef3b9d2e-f295-458c-91fc-ad29bcb2e868 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:43:50.288447 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-ef3b9d2e-f295-458c-91fc-ad29bcb2e868 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:43:50.288888 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-ef3b9d2e-f295-458c-91fc-ad29bcb2e868 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:43:50.289656 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-ef3b9d2e-f295-458c-91fc-ad29bcb2e868 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:43:50.290079 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-ef3b9d2e-f295-458c-91fc-ad29bcb2e868 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:43:50.366281 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-ef3b9d2e-f295-458c-91fc-ad29bcb2e868 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "POST /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672/action" status: 200 len: 17602 microversion: 2.20 time: 0.089741 Oct 27 15:43:50.367775 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 107/241] 10.222.0.64 () {62 vars in 1318 bytes} [Wed Oct 27 15:43:50 2021] POST /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672/action => generated 17602 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 27 15:43:50.450353 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-2a3215a6-9cbf-4d7c-af0c-e5bf5127626e tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:43:50.451611 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-2a3215a6-9cbf-4d7c-af0c-e5bf5127626e tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: bced4f24-572a-4316-97e8-3ceedc61a621] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:43:50.458373 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-2a3215a6-9cbf-4d7c-af0c-e5bf5127626e tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:43:50.458816 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-2a3215a6-9cbf-4d7c-af0c-e5bf5127626e tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:43:50.459576 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-2a3215a6-9cbf-4d7c-af0c-e5bf5127626e tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:43:50.460063 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-2a3215a6-9cbf-4d7c-af0c-e5bf5127626e tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:43:50.547927 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-43094b9b-38c3-4922-ad32-f01d1caa9756 tempest-VolumesActionsTest-1850781407 tempest-VolumesActionsTest-1850781407-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:43:50.549714 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-43094b9b-38c3-4922-ad32-f01d1caa9756 tempest-VolumesActionsTest-1850781407 tempest-VolumesActionsTest-1850781407-project] [instance: b355f088-15f6-4993-bf18-d99417b40f98] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:43:50.561387 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-43094b9b-38c3-4922-ad32-f01d1caa9756 tempest-VolumesActionsTest-1850781407 tempest-VolumesActionsTest-1850781407-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:43:50.562208 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-43094b9b-38c3-4922-ad32-f01d1caa9756 tempest-VolumesActionsTest-1850781407 tempest-VolumesActionsTest-1850781407-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:43:50.563556 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-43094b9b-38c3-4922-ad32-f01d1caa9756 tempest-VolumesActionsTest-1850781407 tempest-VolumesActionsTest-1850781407-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:43:50.564458 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-43094b9b-38c3-4922-ad32-f01d1caa9756 tempest-VolumesActionsTest-1850781407 tempest-VolumesActionsTest-1850781407-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:43:50.607448 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-2a3215a6-9cbf-4d7c-af0c-e5bf5127626e tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96b599f8890b4281a7e311cf37a039e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d7fcab5d3f465793d650f16c6ea8de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:43:50.618837 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-2a3215a6-9cbf-4d7c-af0c-e5bf5127626e tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/bced4f24-572a-4316-97e8-3ceedc61a621" status: 200 len: 1520 microversion: 2.1 time: 0.172034 Oct 27 15:43:50.620158 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 135/242] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:43:50 2021] GET /compute/v2.1/servers/bced4f24-572a-4316-97e8-3ceedc61a621 => generated 1520 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 15:43:50.731185 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-43094b9b-38c3-4922-ad32-f01d1caa9756 tempest-VolumesActionsTest-1850781407 tempest-VolumesActionsTest-1850781407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f44b5c1ad2204da1935d8cb7ea8bc67e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eef06dd988f343e7ae8ccf2c93217e9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:43:50.739499 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-43094b9b-38c3-4922-ad32-f01d1caa9756 tempest-VolumesActionsTest-1850781407 tempest-VolumesActionsTest-1850781407-project] 10.222.0.64 "GET /compute/v2.1/servers/b355f088-15f6-4993-bf18-d99417b40f98" status: 200 len: 1314 microversion: 2.1 time: 0.200126 Oct 27 15:43:50.740511 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 108/243] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:43:50 2021] GET /compute/v2.1/servers/b355f088-15f6-4993-bf18-d99417b40f98 => generated 1314 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 15:43:50.846588 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [req-c2898c81-337e-46a5-b5bf-9b6a6b04baee req-63b7d393-2741-4715-b639-efcbc786f32a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a2e6d3ca-9ddb-4f28-908a-24d8705fb320", "name": "network-vif-plugged", "status": "completed", "tag": "63ec4f11-578e-4a46-9aa2-ef65a12a2552"}]} {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 15:43:50.848640 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 27 15:43:50.848640 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: warnings.warn(msg) Oct 27 15:43:50.856647 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [req-c2898c81-337e-46a5-b5bf-9b6a6b04baee req-63b7d393-2741-4715-b639-efcbc786f32a service nova] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:43:50.857153 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [req-c2898c81-337e-46a5-b5bf-9b6a6b04baee req-63b7d393-2741-4715-b639-efcbc786f32a service nova] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:43:50.869022 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.compute.server_external_events [req-c2898c81-337e-46a5-b5bf-9b6a6b04baee req-63b7d393-2741-4715-b639-efcbc786f32a service nova] Creating event network-vif-plugged:63ec4f11-578e-4a46-9aa2-ef65a12a2552 for instance a2e6d3ca-9ddb-4f28-908a-24d8705fb320 on hv-cinder-80070 Oct 27 15:43:50.874190 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [req-c2898c81-337e-46a5-b5bf-9b6a6b04baee req-63b7d393-2741-4715-b639-efcbc786f32a service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031981 Oct 27 15:43:50.875323 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 136/244] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Oct 27 15:43:50 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 15:43:50.906637 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-a261669a-eca4-4a26-8286-e0725ab23b8d tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:43:50.907435 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-a261669a-eca4-4a26-8286-e0725ab23b8d tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] [instance: a2e6d3ca-9ddb-4f28-908a-24d8705fb320] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:43:50.931154 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-a261669a-eca4-4a26-8286-e0725ab23b8d tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:43:50.931602 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-a261669a-eca4-4a26-8286-e0725ab23b8d tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:43:50.933489 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-a261669a-eca4-4a26-8286-e0725ab23b8d tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:43:50.933931 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-a261669a-eca4-4a26-8286-e0725ab23b8d tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:43:51.097953 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-a261669a-eca4-4a26-8286-e0725ab23b8d tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0abe23cb5f314bc883ef7958b0ed9b5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fc48df471f247809d82ddf926bfdc6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:43:51.107622 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-a261669a-eca4-4a26-8286-e0725ab23b8d tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] 10.222.0.64 "GET /compute/v2.1/servers/a2e6d3ca-9ddb-4f28-908a-24d8705fb320" status: 200 len: 1317 microversion: 2.1 time: 0.204950 Oct 27 15:43:51.112447 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 109/245] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:43:50 2021] GET /compute/v2.1/servers/a2e6d3ca-9ddb-4f28-908a-24d8705fb320 => generated 1317 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 15:43:51.379545 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-dca9788d-ef22-4c63-9f8e-c2d3bde59cda tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 15:43:51.380879 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-dca9788d-ef22-4c63-9f8e-c2d3bde59cda tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:43:51.388028 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-dca9788d-ef22-4c63-9f8e-c2d3bde59cda tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:43:51.388819 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-dca9788d-ef22-4c63-9f8e-c2d3bde59cda tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:43:51.390084 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-dca9788d-ef22-4c63-9f8e-c2d3bde59cda tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:43:51.390645 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-dca9788d-ef22-4c63-9f8e-c2d3bde59cda tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:43:51.540034 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-dca9788d-ef22-4c63-9f8e-c2d3bde59cda tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "POST /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672/action" status: 200 len: 19342 microversion: 2.20 time: 0.165596 Oct 27 15:43:51.542174 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 137/246] 10.222.0.64 () {62 vars in 1318 bytes} [Wed Oct 27 15:43:51 2021] POST /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672/action => generated 19342 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 27 15:43:51.636572 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-35af48b8-b1f7-4702-833b-625c4cbeef9c tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:43:51.637173 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-35af48b8-b1f7-4702-833b-625c4cbeef9c tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: bced4f24-572a-4316-97e8-3ceedc61a621] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:43:51.645101 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-35af48b8-b1f7-4702-833b-625c4cbeef9c tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:43:51.645624 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-35af48b8-b1f7-4702-833b-625c4cbeef9c tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:43:51.646285 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-35af48b8-b1f7-4702-833b-625c4cbeef9c tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:43:51.646705 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-35af48b8-b1f7-4702-833b-625c4cbeef9c tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:43:51.762229 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-8eba92e8-ddb0-4c25-bbae-039222824afc tempest-VolumesActionsTest-1850781407 tempest-VolumesActionsTest-1850781407-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:43:51.762950 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-8eba92e8-ddb0-4c25-bbae-039222824afc tempest-VolumesActionsTest-1850781407 tempest-VolumesActionsTest-1850781407-project] [instance: b355f088-15f6-4993-bf18-d99417b40f98] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:43:51.774420 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-35af48b8-b1f7-4702-833b-625c4cbeef9c tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96b599f8890b4281a7e311cf37a039e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d7fcab5d3f465793d650f16c6ea8de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:43:51.775178 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-8eba92e8-ddb0-4c25-bbae-039222824afc tempest-VolumesActionsTest-1850781407 tempest-VolumesActionsTest-1850781407-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:43:51.775636 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-8eba92e8-ddb0-4c25-bbae-039222824afc tempest-VolumesActionsTest-1850781407 tempest-VolumesActionsTest-1850781407-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:43:51.776455 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-8eba92e8-ddb0-4c25-bbae-039222824afc tempest-VolumesActionsTest-1850781407 tempest-VolumesActionsTest-1850781407-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:43:51.776893 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-8eba92e8-ddb0-4c25-bbae-039222824afc tempest-VolumesActionsTest-1850781407 tempest-VolumesActionsTest-1850781407-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:43:51.781816 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-35af48b8-b1f7-4702-833b-625c4cbeef9c tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/bced4f24-572a-4316-97e8-3ceedc61a621" status: 200 len: 1520 microversion: 2.1 time: 0.149179 Oct 27 15:43:51.782381 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 110/247] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:43:51 2021] GET /compute/v2.1/servers/bced4f24-572a-4316-97e8-3ceedc61a621 => generated 1520 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 15:43:51.906686 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-8eba92e8-ddb0-4c25-bbae-039222824afc tempest-VolumesActionsTest-1850781407 tempest-VolumesActionsTest-1850781407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f44b5c1ad2204da1935d8cb7ea8bc67e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eef06dd988f343e7ae8ccf2c93217e9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:43:51.915532 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-8eba92e8-ddb0-4c25-bbae-039222824afc tempest-VolumesActionsTest-1850781407 tempest-VolumesActionsTest-1850781407-project] 10.222.0.64 "GET /compute/v2.1/servers/b355f088-15f6-4993-bf18-d99417b40f98" status: 200 len: 1314 microversion: 2.1 time: 0.158887 Oct 27 15:43:51.916137 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 138/248] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:43:51 2021] GET /compute/v2.1/servers/b355f088-15f6-4993-bf18-d99417b40f98 => generated 1314 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 15:43:52.125081 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-37b4e756-7da2-4451-9037-0d1164a7830d tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:43:52.125677 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-37b4e756-7da2-4451-9037-0d1164a7830d tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] [instance: a2e6d3ca-9ddb-4f28-908a-24d8705fb320] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:43:52.131919 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-37b4e756-7da2-4451-9037-0d1164a7830d tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:43:52.132508 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-37b4e756-7da2-4451-9037-0d1164a7830d tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:43:52.133473 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-37b4e756-7da2-4451-9037-0d1164a7830d tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:43:52.133906 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-37b4e756-7da2-4451-9037-0d1164a7830d tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:43:52.257265 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-37b4e756-7da2-4451-9037-0d1164a7830d tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0abe23cb5f314bc883ef7958b0ed9b5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fc48df471f247809d82ddf926bfdc6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:43:52.264462 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-37b4e756-7da2-4451-9037-0d1164a7830d tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] 10.222.0.64 "GET /compute/v2.1/servers/a2e6d3ca-9ddb-4f28-908a-24d8705fb320" status: 200 len: 1317 microversion: 2.1 time: 0.143111 Oct 27 15:43:52.265023 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 111/249] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:43:52 2021] GET /compute/v2.1/servers/a2e6d3ca-9ddb-4f28-908a-24d8705fb320 => generated 1317 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 15:43:52.552131 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-5e2d45a1-1bb7-49b1-b318-7d6313ba5d8e tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 15:43:52.553035 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-5e2d45a1-1bb7-49b1-b318-7d6313ba5d8e tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:43:52.559364 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-5e2d45a1-1bb7-49b1-b318-7d6313ba5d8e tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:43:52.559945 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-5e2d45a1-1bb7-49b1-b318-7d6313ba5d8e tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:43:52.560696 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-5e2d45a1-1bb7-49b1-b318-7d6313ba5d8e tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:43:52.561196 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-5e2d45a1-1bb7-49b1-b318-7d6313ba5d8e tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:43:52.798401 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-601f2797-e26a-4bd8-8f10-f3710d2e7973 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:43:52.799955 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-601f2797-e26a-4bd8-8f10-f3710d2e7973 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: bced4f24-572a-4316-97e8-3ceedc61a621] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:43:52.805662 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-601f2797-e26a-4bd8-8f10-f3710d2e7973 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:43:52.806108 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-601f2797-e26a-4bd8-8f10-f3710d2e7973 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:43:52.806865 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-601f2797-e26a-4bd8-8f10-f3710d2e7973 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:43:52.807358 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-601f2797-e26a-4bd8-8f10-f3710d2e7973 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:43:52.934623 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-601f2797-e26a-4bd8-8f10-f3710d2e7973 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96b599f8890b4281a7e311cf37a039e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d7fcab5d3f465793d650f16c6ea8de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:43:52.942396 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-601f2797-e26a-4bd8-8f10-f3710d2e7973 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/bced4f24-572a-4316-97e8-3ceedc61a621" status: 200 len: 1520 microversion: 2.1 time: 0.147621 Oct 27 15:43:52.943046 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 112/250] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:43:52 2021] GET /compute/v2.1/servers/bced4f24-572a-4316-97e8-3ceedc61a621 => generated 1520 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 15:43:52.947589 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-86f512a4-b812-47ac-acdd-4dce70003912 tempest-VolumesActionsTest-1850781407 tempest-VolumesActionsTest-1850781407-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:43:52.948308 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-86f512a4-b812-47ac-acdd-4dce70003912 tempest-VolumesActionsTest-1850781407 tempest-VolumesActionsTest-1850781407-project] [instance: b355f088-15f6-4993-bf18-d99417b40f98] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:43:52.954061 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-86f512a4-b812-47ac-acdd-4dce70003912 tempest-VolumesActionsTest-1850781407 tempest-VolumesActionsTest-1850781407-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:43:52.954504 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-86f512a4-b812-47ac-acdd-4dce70003912 tempest-VolumesActionsTest-1850781407 tempest-VolumesActionsTest-1850781407-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:43:52.955835 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-86f512a4-b812-47ac-acdd-4dce70003912 tempest-VolumesActionsTest-1850781407 tempest-VolumesActionsTest-1850781407-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:43:52.956303 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-86f512a4-b812-47ac-acdd-4dce70003912 tempest-VolumesActionsTest-1850781407 tempest-VolumesActionsTest-1850781407-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:43:53.081446 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-86f512a4-b812-47ac-acdd-4dce70003912 tempest-VolumesActionsTest-1850781407 tempest-VolumesActionsTest-1850781407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f44b5c1ad2204da1935d8cb7ea8bc67e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eef06dd988f343e7ae8ccf2c93217e9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:43:53.089432 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-86f512a4-b812-47ac-acdd-4dce70003912 tempest-VolumesActionsTest-1850781407 tempest-VolumesActionsTest-1850781407-project] 10.222.0.64 "GET /compute/v2.1/servers/b355f088-15f6-4993-bf18-d99417b40f98" status: 200 len: 1314 microversion: 2.1 time: 0.145292 Oct 27 15:43:53.090012 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 113/251] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:43:52 2021] GET /compute/v2.1/servers/b355f088-15f6-4993-bf18-d99417b40f98 => generated 1314 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 15:43:53.280314 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-31a2d9e4-23a3-4393-99ad-af700ca32c79 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:43:53.281046 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-31a2d9e4-23a3-4393-99ad-af700ca32c79 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] [instance: a2e6d3ca-9ddb-4f28-908a-24d8705fb320] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:43:53.287041 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-31a2d9e4-23a3-4393-99ad-af700ca32c79 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:43:53.287585 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-31a2d9e4-23a3-4393-99ad-af700ca32c79 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:43:53.288459 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-31a2d9e4-23a3-4393-99ad-af700ca32c79 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:43:53.288823 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-31a2d9e4-23a3-4393-99ad-af700ca32c79 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:43:53.420650 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-31a2d9e4-23a3-4393-99ad-af700ca32c79 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0abe23cb5f314bc883ef7958b0ed9b5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fc48df471f247809d82ddf926bfdc6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:43:53.428701 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-31a2d9e4-23a3-4393-99ad-af700ca32c79 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] 10.222.0.64 "GET /compute/v2.1/servers/a2e6d3ca-9ddb-4f28-908a-24d8705fb320" status: 200 len: 1317 microversion: 2.1 time: 0.151969 Oct 27 15:43:53.433626 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 114/252] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:43:53 2021] GET /compute/v2.1/servers/a2e6d3ca-9ddb-4f28-908a-24d8705fb320 => generated 1317 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 15:43:53.960684 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-f518b3a6-9fcc-4bbd-a448-db9863dea5fc tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:43:53.961344 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-f518b3a6-9fcc-4bbd-a448-db9863dea5fc tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: bced4f24-572a-4316-97e8-3ceedc61a621] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:43:53.968451 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-f518b3a6-9fcc-4bbd-a448-db9863dea5fc tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:43:53.968895 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-f518b3a6-9fcc-4bbd-a448-db9863dea5fc tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:43:53.969692 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-f518b3a6-9fcc-4bbd-a448-db9863dea5fc tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:43:53.970124 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-f518b3a6-9fcc-4bbd-a448-db9863dea5fc tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:43:54.139191 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-f518b3a6-9fcc-4bbd-a448-db9863dea5fc tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96b599f8890b4281a7e311cf37a039e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d7fcab5d3f465793d650f16c6ea8de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:43:54.146932 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-f518b3a6-9fcc-4bbd-a448-db9863dea5fc tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/bced4f24-572a-4316-97e8-3ceedc61a621" status: 200 len: 1520 microversion: 2.1 time: 0.190017 Oct 27 15:43:54.147498 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 115/253] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:43:53 2021] GET /compute/v2.1/servers/bced4f24-572a-4316-97e8-3ceedc61a621 => generated 1520 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 15:43:54.156615 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-6eaf8525-afb7-4c66-a55a-750fe92fecaa tempest-VolumesActionsTest-1850781407 tempest-VolumesActionsTest-1850781407-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:43:54.156615 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-6eaf8525-afb7-4c66-a55a-750fe92fecaa tempest-VolumesActionsTest-1850781407 tempest-VolumesActionsTest-1850781407-project] [instance: b355f088-15f6-4993-bf18-d99417b40f98] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:43:54.158199 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-6eaf8525-afb7-4c66-a55a-750fe92fecaa tempest-VolumesActionsTest-1850781407 tempest-VolumesActionsTest-1850781407-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:43:54.159550 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-6eaf8525-afb7-4c66-a55a-750fe92fecaa tempest-VolumesActionsTest-1850781407 tempest-VolumesActionsTest-1850781407-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:43:54.160424 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-6eaf8525-afb7-4c66-a55a-750fe92fecaa tempest-VolumesActionsTest-1850781407 tempest-VolumesActionsTest-1850781407-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:43:54.161031 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-6eaf8525-afb7-4c66-a55a-750fe92fecaa tempest-VolumesActionsTest-1850781407 tempest-VolumesActionsTest-1850781407-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:43:54.442069 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-6eaf8525-afb7-4c66-a55a-750fe92fecaa tempest-VolumesActionsTest-1850781407 tempest-VolumesActionsTest-1850781407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f44b5c1ad2204da1935d8cb7ea8bc67e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eef06dd988f343e7ae8ccf2c93217e9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:43:54.449380 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-6eaf8525-afb7-4c66-a55a-750fe92fecaa tempest-VolumesActionsTest-1850781407 tempest-VolumesActionsTest-1850781407-project] 10.222.0.64 "GET /compute/v2.1/servers/b355f088-15f6-4993-bf18-d99417b40f98" status: 200 len: 1314 microversion: 2.1 time: 0.300852 Oct 27 15:43:54.450087 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 116/254] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:43:54 2021] GET /compute/v2.1/servers/b355f088-15f6-4993-bf18-d99417b40f98 => generated 1314 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 15:43:54.454426 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-c3b1af29-4a14-4093-9889-f9bec933d2f3 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:43:54.455106 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-c3b1af29-4a14-4093-9889-f9bec933d2f3 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] [instance: a2e6d3ca-9ddb-4f28-908a-24d8705fb320] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:43:54.461846 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-c3b1af29-4a14-4093-9889-f9bec933d2f3 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:43:54.462291 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-c3b1af29-4a14-4093-9889-f9bec933d2f3 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:43:54.463094 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-c3b1af29-4a14-4093-9889-f9bec933d2f3 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:43:54.463529 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-c3b1af29-4a14-4093-9889-f9bec933d2f3 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:43:54.614438 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-c3b1af29-4a14-4093-9889-f9bec933d2f3 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0abe23cb5f314bc883ef7958b0ed9b5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fc48df471f247809d82ddf926bfdc6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:43:54.621937 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-c3b1af29-4a14-4093-9889-f9bec933d2f3 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] 10.222.0.64 "GET /compute/v2.1/servers/a2e6d3ca-9ddb-4f28-908a-24d8705fb320" status: 200 len: 1317 microversion: 2.1 time: 0.170792 Oct 27 15:43:54.622501 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 117/255] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:43:54 2021] GET /compute/v2.1/servers/a2e6d3ca-9ddb-4f28-908a-24d8705fb320 => generated 1317 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 15:43:55.164499 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-28a9e550-da72-4ffa-9542-96e07fd4f508 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:43:55.165182 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-28a9e550-da72-4ffa-9542-96e07fd4f508 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: bced4f24-572a-4316-97e8-3ceedc61a621] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:43:55.171085 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-28a9e550-da72-4ffa-9542-96e07fd4f508 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:43:55.172021 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-28a9e550-da72-4ffa-9542-96e07fd4f508 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:43:55.172599 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-28a9e550-da72-4ffa-9542-96e07fd4f508 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:43:55.173033 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-28a9e550-da72-4ffa-9542-96e07fd4f508 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:43:55.307354 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-28a9e550-da72-4ffa-9542-96e07fd4f508 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96b599f8890b4281a7e311cf37a039e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d7fcab5d3f465793d650f16c6ea8de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:43:55.315002 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-28a9e550-da72-4ffa-9542-96e07fd4f508 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/bced4f24-572a-4316-97e8-3ceedc61a621" status: 200 len: 1520 microversion: 2.1 time: 0.153596 Oct 27 15:43:55.315558 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 118/256] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:43:55 2021] GET /compute/v2.1/servers/bced4f24-572a-4316-97e8-3ceedc61a621 => generated 1520 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 15:43:55.466214 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-88005dd2-ad5f-43dd-8662-3a9771e9fc01 tempest-VolumesActionsTest-1850781407 tempest-VolumesActionsTest-1850781407-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:43:55.466815 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-88005dd2-ad5f-43dd-8662-3a9771e9fc01 tempest-VolumesActionsTest-1850781407 tempest-VolumesActionsTest-1850781407-project] [instance: b355f088-15f6-4993-bf18-d99417b40f98] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:43:55.472730 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-88005dd2-ad5f-43dd-8662-3a9771e9fc01 tempest-VolumesActionsTest-1850781407 tempest-VolumesActionsTest-1850781407-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:43:55.473167 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-88005dd2-ad5f-43dd-8662-3a9771e9fc01 tempest-VolumesActionsTest-1850781407 tempest-VolumesActionsTest-1850781407-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:43:55.474155 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-88005dd2-ad5f-43dd-8662-3a9771e9fc01 tempest-VolumesActionsTest-1850781407 tempest-VolumesActionsTest-1850781407-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:43:55.474639 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-88005dd2-ad5f-43dd-8662-3a9771e9fc01 tempest-VolumesActionsTest-1850781407 tempest-VolumesActionsTest-1850781407-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:43:55.597689 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-88005dd2-ad5f-43dd-8662-3a9771e9fc01 tempest-VolumesActionsTest-1850781407 tempest-VolumesActionsTest-1850781407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f44b5c1ad2204da1935d8cb7ea8bc67e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eef06dd988f343e7ae8ccf2c93217e9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:43:55.605195 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-88005dd2-ad5f-43dd-8662-3a9771e9fc01 tempest-VolumesActionsTest-1850781407 tempest-VolumesActionsTest-1850781407-project] 10.222.0.64 "GET /compute/v2.1/servers/b355f088-15f6-4993-bf18-d99417b40f98" status: 200 len: 1314 microversion: 2.1 time: 0.142627 Oct 27 15:43:55.605752 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 119/257] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:43:55 2021] GET /compute/v2.1/servers/b355f088-15f6-4993-bf18-d99417b40f98 => generated 1314 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 15:43:55.638305 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-9c4d3bde-9901-4f16-baa7-20d1f918d1e5 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:43:55.638907 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-9c4d3bde-9901-4f16-baa7-20d1f918d1e5 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] [instance: a2e6d3ca-9ddb-4f28-908a-24d8705fb320] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:43:55.645112 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-9c4d3bde-9901-4f16-baa7-20d1f918d1e5 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:43:55.645556 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-9c4d3bde-9901-4f16-baa7-20d1f918d1e5 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:43:55.646316 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-9c4d3bde-9901-4f16-baa7-20d1f918d1e5 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:43:55.646739 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-9c4d3bde-9901-4f16-baa7-20d1f918d1e5 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:43:55.735049 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-5e2d45a1-1bb7-49b1-b318-7d6313ba5d8e tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "POST /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672/action" status: 200 len: 23591 microversion: 2.20 time: 3.186695 Oct 27 15:43:55.739777 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 139/258] 10.222.0.64 () {62 vars in 1318 bytes} [Wed Oct 27 15:43:52 2021] POST /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672/action => generated 23591 bytes in 3188 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 27 15:43:55.793648 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-9c4d3bde-9901-4f16-baa7-20d1f918d1e5 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0abe23cb5f314bc883ef7958b0ed9b5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fc48df471f247809d82ddf926bfdc6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:43:55.802175 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-9c4d3bde-9901-4f16-baa7-20d1f918d1e5 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] 10.222.0.64 "GET /compute/v2.1/servers/a2e6d3ca-9ddb-4f28-908a-24d8705fb320" status: 200 len: 1317 microversion: 2.1 time: 0.167373 Oct 27 15:43:55.802739 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 120/259] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:43:55 2021] GET /compute/v2.1/servers/a2e6d3ca-9ddb-4f28-908a-24d8705fb320 => generated 1317 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 15:43:56.333232 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-b1400418-4e61-4e01-923b-666196adf1bf tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:43:56.334009 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-b1400418-4e61-4e01-923b-666196adf1bf tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: bced4f24-572a-4316-97e8-3ceedc61a621] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:43:56.341859 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-b1400418-4e61-4e01-923b-666196adf1bf tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:43:56.342344 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-b1400418-4e61-4e01-923b-666196adf1bf tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:43:56.343136 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-b1400418-4e61-4e01-923b-666196adf1bf tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:43:56.343572 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-b1400418-4e61-4e01-923b-666196adf1bf tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:43:56.478500 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-b1400418-4e61-4e01-923b-666196adf1bf tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96b599f8890b4281a7e311cf37a039e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d7fcab5d3f465793d650f16c6ea8de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:43:56.486360 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-b1400418-4e61-4e01-923b-666196adf1bf tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/bced4f24-572a-4316-97e8-3ceedc61a621" status: 200 len: 1520 microversion: 2.1 time: 0.157737 Oct 27 15:43:56.486928 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 140/260] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:43:56 2021] GET /compute/v2.1/servers/bced4f24-572a-4316-97e8-3ceedc61a621 => generated 1520 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 15:43:56.622220 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-c994ae5c-7536-4ed5-afea-e9c386bd44e2 tempest-VolumesActionsTest-1850781407 tempest-VolumesActionsTest-1850781407-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:43:56.622819 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-c994ae5c-7536-4ed5-afea-e9c386bd44e2 tempest-VolumesActionsTest-1850781407 tempest-VolumesActionsTest-1850781407-project] [instance: b355f088-15f6-4993-bf18-d99417b40f98] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:43:56.630078 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-c994ae5c-7536-4ed5-afea-e9c386bd44e2 tempest-VolumesActionsTest-1850781407 tempest-VolumesActionsTest-1850781407-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:43:56.630917 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-c994ae5c-7536-4ed5-afea-e9c386bd44e2 tempest-VolumesActionsTest-1850781407 tempest-VolumesActionsTest-1850781407-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:43:56.631712 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-c994ae5c-7536-4ed5-afea-e9c386bd44e2 tempest-VolumesActionsTest-1850781407 tempest-VolumesActionsTest-1850781407-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:43:56.632272 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-c994ae5c-7536-4ed5-afea-e9c386bd44e2 tempest-VolumesActionsTest-1850781407 tempest-VolumesActionsTest-1850781407-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:43:56.749515 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-13bda14f-bdcc-4bc3-9e0c-e38a2492c5c0 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 15:43:56.751099 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-13bda14f-bdcc-4bc3-9e0c-e38a2492c5c0 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:43:56.765884 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-13bda14f-bdcc-4bc3-9e0c-e38a2492c5c0 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:43:56.767387 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-13bda14f-bdcc-4bc3-9e0c-e38a2492c5c0 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:43:56.768979 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-13bda14f-bdcc-4bc3-9e0c-e38a2492c5c0 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:43:56.769462 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-13bda14f-bdcc-4bc3-9e0c-e38a2492c5c0 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:43:56.785503 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-c994ae5c-7536-4ed5-afea-e9c386bd44e2 tempest-VolumesActionsTest-1850781407 tempest-VolumesActionsTest-1850781407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f44b5c1ad2204da1935d8cb7ea8bc67e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eef06dd988f343e7ae8ccf2c93217e9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:43:56.797518 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-c994ae5c-7536-4ed5-afea-e9c386bd44e2 tempest-VolumesActionsTest-1850781407 tempest-VolumesActionsTest-1850781407-project] 10.222.0.64 "GET /compute/v2.1/servers/b355f088-15f6-4993-bf18-d99417b40f98" status: 200 len: 1314 microversion: 2.1 time: 0.178839 Oct 27 15:43:56.798329 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 121/261] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:43:56 2021] GET /compute/v2.1/servers/b355f088-15f6-4993-bf18-d99417b40f98 => generated 1314 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 15:43:56.820486 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-4823189a-1fd5-4f4b-8294-2666e0c71563 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:43:56.821172 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-4823189a-1fd5-4f4b-8294-2666e0c71563 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] [instance: a2e6d3ca-9ddb-4f28-908a-24d8705fb320] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:43:56.827291 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-4823189a-1fd5-4f4b-8294-2666e0c71563 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:43:56.827804 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-4823189a-1fd5-4f4b-8294-2666e0c71563 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:43:56.829526 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-4823189a-1fd5-4f4b-8294-2666e0c71563 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:43:56.829526 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-4823189a-1fd5-4f4b-8294-2666e0c71563 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:43:56.929586 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-13bda14f-bdcc-4bc3-9e0c-e38a2492c5c0 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "POST /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672/action" status: 200 len: 23890 microversion: 2.20 time: 0.185899 Oct 27 15:43:56.930424 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 141/262] 10.222.0.64 () {62 vars in 1318 bytes} [Wed Oct 27 15:43:56 2021] POST /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672/action => generated 23890 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 27 15:43:56.959615 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-4823189a-1fd5-4f4b-8294-2666e0c71563 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0abe23cb5f314bc883ef7958b0ed9b5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fc48df471f247809d82ddf926bfdc6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:43:56.966852 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-4823189a-1fd5-4f4b-8294-2666e0c71563 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] 10.222.0.64 "GET /compute/v2.1/servers/a2e6d3ca-9ddb-4f28-908a-24d8705fb320" status: 200 len: 1506 microversion: 2.1 time: 0.150140 Oct 27 15:43:56.971996 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 122/263] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:43:56 2021] GET /compute/v2.1/servers/a2e6d3ca-9ddb-4f28-908a-24d8705fb320 => generated 1506 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 15:43:56.984611 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-6efc4942-4ce1-4505-a6c3-c2babaeff287 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ed3bd7e9-5fd7-4c9a-96cf-6a6b7cacfa91"}} {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 15:43:56.985826 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-6efc4942-4ce1-4505-a6c3-c2babaeff287 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] [instance: a2e6d3ca-9ddb-4f28-908a-24d8705fb320] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:43:56.993014 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-6efc4942-4ce1-4505-a6c3-c2babaeff287 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:43:56.993454 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-6efc4942-4ce1-4505-a6c3-c2babaeff287 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:43:56.994214 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-6efc4942-4ce1-4505-a6c3-c2babaeff287 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:43:56.994645 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-6efc4942-4ce1-4505-a6c3-c2babaeff287 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:43:57.071294 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.wsgi [None req-6efc4942-4ce1-4505-a6c3-c2babaeff287 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] HTTP exception thrown: Invalid volume: volume ed3bd7e9-5fd7-4c9a-96cf-6a6b7cacfa91 is already attached to instances: a4e225e4-7815-4f6a-b1e6-53edab3c1abd Oct 27 15:43:57.071926 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-6efc4942-4ce1-4505-a6c3-c2babaeff287 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Returning 400 to user: Invalid volume: volume ed3bd7e9-5fd7-4c9a-96cf-6a6b7cacfa91 is already attached to instances: a4e225e4-7815-4f6a-b1e6-53edab3c1abd {{(pid=122224) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 27 15:43:57.072755 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-6efc4942-4ce1-4505-a6c3-c2babaeff287 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] 10.222.0.64 "POST /compute/v2.1/servers/a2e6d3ca-9ddb-4f28-908a-24d8705fb320/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.092352 Oct 27 15:43:57.073297 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 142/264] 10.222.0.64 () {60 vars in 1322 bytes} [Wed Oct 27 15:43:56 2021] POST /compute/v2.1/servers/a2e6d3ca-9ddb-4f28-908a-24d8705fb320/os-volume_attachments => generated 174 bytes in 94 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 27 15:43:57.132514 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-d1d5def2-fa44-4816-9288-e264d6b6e365 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:43:57.133023 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-d1d5def2-fa44-4816-9288-e264d6b6e365 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] [instance: a4e225e4-7815-4f6a-b1e6-53edab3c1abd] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:43:57.138800 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-d1d5def2-fa44-4816-9288-e264d6b6e365 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:43:57.139256 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-d1d5def2-fa44-4816-9288-e264d6b6e365 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:43:57.140110 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-d1d5def2-fa44-4816-9288-e264d6b6e365 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:43:57.140544 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-d1d5def2-fa44-4816-9288-e264d6b6e365 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:43:57.268186 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.objects.instance [None req-d1d5def2-fa44-4816-9288-e264d6b6e365 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lazy-loading 'services' on Instance uuid a4e225e4-7815-4f6a-b1e6-53edab3c1abd {{(pid=122225) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 27 15:43:57.385169 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-d1d5def2-fa44-4816-9288-e264d6b6e365 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] 10.222.0.64 "DELETE /compute/v2.1/servers/a4e225e4-7815-4f6a-b1e6-53edab3c1abd/os-volume_attachments/ed3bd7e9-5fd7-4c9a-96cf-6a6b7cacfa91" status: 202 len: 0 microversion: 2.1 time: 0.256499 Oct 27 15:43:57.385743 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 123/265] 10.222.0.64 () {58 vars in 1415 bytes} [Wed Oct 27 15:43:57 2021] DELETE /compute/v2.1/servers/a4e225e4-7815-4f6a-b1e6-53edab3c1abd/os-volume_attachments/ed3bd7e9-5fd7-4c9a-96cf-6a6b7cacfa91 => generated 0 bytes in 258 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 15:43:57.394467 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-29344f17-6954-454c-b90b-2c48cc9bdb35 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:43:57.395494 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-29344f17-6954-454c-b90b-2c48cc9bdb35 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] [instance: a4e225e4-7815-4f6a-b1e6-53edab3c1abd] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:43:57.402824 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-29344f17-6954-454c-b90b-2c48cc9bdb35 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:43:57.403268 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-29344f17-6954-454c-b90b-2c48cc9bdb35 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:43:57.404128 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-29344f17-6954-454c-b90b-2c48cc9bdb35 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:43:57.404562 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-29344f17-6954-454c-b90b-2c48cc9bdb35 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:43:57.434412 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-29344f17-6954-454c-b90b-2c48cc9bdb35 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] 10.222.0.64 "GET /compute/v2.1/servers/a4e225e4-7815-4f6a-b1e6-53edab3c1abd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044277 Oct 27 15:43:57.434969 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 143/266] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Oct 27 15:43:57 2021] GET /compute/v2.1/servers/a4e225e4-7815-4f6a-b1e6-53edab3c1abd/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 15:43:57.503586 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-b752f989-83f0-4749-a3a7-721746c913a1 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:43:57.504308 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-b752f989-83f0-4749-a3a7-721746c913a1 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: bced4f24-572a-4316-97e8-3ceedc61a621] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:43:57.510402 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-b752f989-83f0-4749-a3a7-721746c913a1 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:43:57.510834 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-b752f989-83f0-4749-a3a7-721746c913a1 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:43:57.511588 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-b752f989-83f0-4749-a3a7-721746c913a1 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:43:57.512039 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-b752f989-83f0-4749-a3a7-721746c913a1 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:43:57.633378 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-b752f989-83f0-4749-a3a7-721746c913a1 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96b599f8890b4281a7e311cf37a039e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d7fcab5d3f465793d650f16c6ea8de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:43:57.640623 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-b752f989-83f0-4749-a3a7-721746c913a1 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/bced4f24-572a-4316-97e8-3ceedc61a621" status: 200 len: 1520 microversion: 2.1 time: 0.141861 Oct 27 15:43:57.641192 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 124/267] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:43:57 2021] GET /compute/v2.1/servers/bced4f24-572a-4316-97e8-3ceedc61a621 => generated 1520 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 15:43:57.815129 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-467a5103-f8b4-4654-92c7-576042f564a7 tempest-VolumesActionsTest-1850781407 tempest-VolumesActionsTest-1850781407-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:43:57.815961 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-467a5103-f8b4-4654-92c7-576042f564a7 tempest-VolumesActionsTest-1850781407 tempest-VolumesActionsTest-1850781407-project] [instance: b355f088-15f6-4993-bf18-d99417b40f98] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:43:57.822363 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-467a5103-f8b4-4654-92c7-576042f564a7 tempest-VolumesActionsTest-1850781407 tempest-VolumesActionsTest-1850781407-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:43:57.822809 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-467a5103-f8b4-4654-92c7-576042f564a7 tempest-VolumesActionsTest-1850781407 tempest-VolumesActionsTest-1850781407-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:43:57.823572 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-467a5103-f8b4-4654-92c7-576042f564a7 tempest-VolumesActionsTest-1850781407 tempest-VolumesActionsTest-1850781407-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:43:57.824215 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-467a5103-f8b4-4654-92c7-576042f564a7 tempest-VolumesActionsTest-1850781407 tempest-VolumesActionsTest-1850781407-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:43:57.862819 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [req-36d2bba3-16d4-4149-be67-ec9d834cd6cb req-85c8bc50-c7cc-42f5-a81b-18414229968a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b355f088-15f6-4993-bf18-d99417b40f98", "name": "network-vif-plugged", "status": "completed", "tag": "74629cf8-105c-46a7-9f14-6b76b6add445"}]} {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 15:43:57.865725 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 27 15:43:57.865725 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: warnings.warn(msg) Oct 27 15:43:57.875339 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [req-36d2bba3-16d4-4149-be67-ec9d834cd6cb req-85c8bc50-c7cc-42f5-a81b-18414229968a service nova] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:43:57.876120 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [req-36d2bba3-16d4-4149-be67-ec9d834cd6cb req-85c8bc50-c7cc-42f5-a81b-18414229968a service nova] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:43:57.893296 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.compute.server_external_events [req-36d2bba3-16d4-4149-be67-ec9d834cd6cb req-85c8bc50-c7cc-42f5-a81b-18414229968a service nova] Creating event network-vif-plugged:74629cf8-105c-46a7-9f14-6b76b6add445 for instance b355f088-15f6-4993-bf18-d99417b40f98 on hv-cinder-80070 Oct 27 15:43:57.899469 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [req-36d2bba3-16d4-4149-be67-ec9d834cd6cb req-85c8bc50-c7cc-42f5-a81b-18414229968a service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042207 Oct 27 15:43:57.900490 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 125/268] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Oct 27 15:43:57 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 15:43:57.943012 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-68f020dc-95dd-4521-9a27-8f11a32b53ea tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 15:43:57.944142 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-68f020dc-95dd-4521-9a27-8f11a32b53ea tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:43:57.950605 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-68f020dc-95dd-4521-9a27-8f11a32b53ea tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:43:57.951060 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-68f020dc-95dd-4521-9a27-8f11a32b53ea tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:43:57.951991 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-68f020dc-95dd-4521-9a27-8f11a32b53ea tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:43:57.952440 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-68f020dc-95dd-4521-9a27-8f11a32b53ea tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:43:58.005769 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-467a5103-f8b4-4654-92c7-576042f564a7 tempest-VolumesActionsTest-1850781407 tempest-VolumesActionsTest-1850781407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f44b5c1ad2204da1935d8cb7ea8bc67e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eef06dd988f343e7ae8ccf2c93217e9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:43:58.013637 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-467a5103-f8b4-4654-92c7-576042f564a7 tempest-VolumesActionsTest-1850781407 tempest-VolumesActionsTest-1850781407-project] 10.222.0.64 "GET /compute/v2.1/servers/b355f088-15f6-4993-bf18-d99417b40f98" status: 200 len: 1314 microversion: 2.1 time: 0.203039 Oct 27 15:43:58.014535 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 144/269] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:43:57 2021] GET /compute/v2.1/servers/b355f088-15f6-4993-bf18-d99417b40f98 => generated 1314 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 15:43:58.047445 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-68f020dc-95dd-4521-9a27-8f11a32b53ea tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "POST /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672/action" status: 200 len: 24516 microversion: 2.20 time: 0.109594 Oct 27 15:43:58.048120 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 126/270] 10.222.0.64 () {62 vars in 1318 bytes} [Wed Oct 27 15:43:57 2021] POST /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672/action => generated 24516 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 27 15:43:58.446142 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-28dd4217-afed-4b3b-8455-942f84ae60dd tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:43:58.447233 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-28dd4217-afed-4b3b-8455-942f84ae60dd tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] [instance: a4e225e4-7815-4f6a-b1e6-53edab3c1abd] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:43:58.453712 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-28dd4217-afed-4b3b-8455-942f84ae60dd tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:43:58.454150 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-28dd4217-afed-4b3b-8455-942f84ae60dd tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:43:58.455386 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-28dd4217-afed-4b3b-8455-942f84ae60dd tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:43:58.456603 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-28dd4217-afed-4b3b-8455-942f84ae60dd tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:43:58.490246 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-28dd4217-afed-4b3b-8455-942f84ae60dd tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] 10.222.0.64 "GET /compute/v2.1/servers/a4e225e4-7815-4f6a-b1e6-53edab3c1abd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047786 Oct 27 15:43:58.490796 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 145/271] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Oct 27 15:43:58 2021] GET /compute/v2.1/servers/a4e225e4-7815-4f6a-b1e6-53edab3c1abd/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 15:43:58.659492 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-799b8bf5-2ce5-4c8d-b315-0826973ed4f7 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:43:58.660145 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-799b8bf5-2ce5-4c8d-b315-0826973ed4f7 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: bced4f24-572a-4316-97e8-3ceedc61a621] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:43:58.666931 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-799b8bf5-2ce5-4c8d-b315-0826973ed4f7 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:43:58.667376 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-799b8bf5-2ce5-4c8d-b315-0826973ed4f7 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:43:58.668190 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-799b8bf5-2ce5-4c8d-b315-0826973ed4f7 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:43:58.668630 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-799b8bf5-2ce5-4c8d-b315-0826973ed4f7 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:43:58.792560 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-799b8bf5-2ce5-4c8d-b315-0826973ed4f7 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96b599f8890b4281a7e311cf37a039e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d7fcab5d3f465793d650f16c6ea8de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:43:58.800376 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-799b8bf5-2ce5-4c8d-b315-0826973ed4f7 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/bced4f24-572a-4316-97e8-3ceedc61a621" status: 200 len: 1520 microversion: 2.1 time: 0.145867 Oct 27 15:43:58.800938 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 127/272] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:43:58 2021] GET /compute/v2.1/servers/bced4f24-572a-4316-97e8-3ceedc61a621 => generated 1520 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 15:43:59.036777 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-d811ec35-edef-43e3-9fba-30af4a462536 tempest-VolumesActionsTest-1850781407 tempest-VolumesActionsTest-1850781407-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:43:59.037283 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-d811ec35-edef-43e3-9fba-30af4a462536 tempest-VolumesActionsTest-1850781407 tempest-VolumesActionsTest-1850781407-project] [instance: b355f088-15f6-4993-bf18-d99417b40f98] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:43:59.043788 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-d811ec35-edef-43e3-9fba-30af4a462536 tempest-VolumesActionsTest-1850781407 tempest-VolumesActionsTest-1850781407-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:43:59.044552 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-d811ec35-edef-43e3-9fba-30af4a462536 tempest-VolumesActionsTest-1850781407 tempest-VolumesActionsTest-1850781407-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:43:59.045513 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-d811ec35-edef-43e3-9fba-30af4a462536 tempest-VolumesActionsTest-1850781407 tempest-VolumesActionsTest-1850781407-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:43:59.045953 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-d811ec35-edef-43e3-9fba-30af4a462536 tempest-VolumesActionsTest-1850781407 tempest-VolumesActionsTest-1850781407-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:43:59.059475 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-0c96baaf-cfbb-4f9c-8ca5-84b0f91e9c0c tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 15:43:59.060408 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-0c96baaf-cfbb-4f9c-8ca5-84b0f91e9c0c tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:43:59.067417 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-0c96baaf-cfbb-4f9c-8ca5-84b0f91e9c0c tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:43:59.068158 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-0c96baaf-cfbb-4f9c-8ca5-84b0f91e9c0c tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:43:59.068690 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-0c96baaf-cfbb-4f9c-8ca5-84b0f91e9c0c tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:43:59.069250 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-0c96baaf-cfbb-4f9c-8ca5-84b0f91e9c0c tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:43:59.176173 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-d811ec35-edef-43e3-9fba-30af4a462536 tempest-VolumesActionsTest-1850781407 tempest-VolumesActionsTest-1850781407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f44b5c1ad2204da1935d8cb7ea8bc67e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eef06dd988f343e7ae8ccf2c93217e9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:43:59.183273 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-d811ec35-edef-43e3-9fba-30af4a462536 tempest-VolumesActionsTest-1850781407 tempest-VolumesActionsTest-1850781407-project] 10.222.0.64 "GET /compute/v2.1/servers/b355f088-15f6-4993-bf18-d99417b40f98" status: 200 len: 1314 microversion: 2.1 time: 0.151327 Oct 27 15:43:59.183843 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 146/273] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:43:59 2021] GET /compute/v2.1/servers/b355f088-15f6-4993-bf18-d99417b40f98 => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 15:43:59.501563 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-dd0244ec-82cd-4de9-aaa4-05911497f4d2 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:43:59.503061 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-dd0244ec-82cd-4de9-aaa4-05911497f4d2 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] [instance: a4e225e4-7815-4f6a-b1e6-53edab3c1abd] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:43:59.510984 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-dd0244ec-82cd-4de9-aaa4-05911497f4d2 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:43:59.510984 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-dd0244ec-82cd-4de9-aaa4-05911497f4d2 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:43:59.510984 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-dd0244ec-82cd-4de9-aaa4-05911497f4d2 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:43:59.510984 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-dd0244ec-82cd-4de9-aaa4-05911497f4d2 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:43:59.539046 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-dd0244ec-82cd-4de9-aaa4-05911497f4d2 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] 10.222.0.64 "GET /compute/v2.1/servers/a4e225e4-7815-4f6a-b1e6-53edab3c1abd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041137 Oct 27 15:43:59.539600 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 147/274] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Oct 27 15:43:59 2021] GET /compute/v2.1/servers/a4e225e4-7815-4f6a-b1e6-53edab3c1abd/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 15:43:59.817714 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-069ca142-293b-4929-83ea-d34549b8f6cf tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:43:59.818226 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-069ca142-293b-4929-83ea-d34549b8f6cf tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: bced4f24-572a-4316-97e8-3ceedc61a621] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:43:59.823985 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-069ca142-293b-4929-83ea-d34549b8f6cf tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:43:59.824425 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-069ca142-293b-4929-83ea-d34549b8f6cf tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:43:59.825183 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-069ca142-293b-4929-83ea-d34549b8f6cf tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:43:59.825614 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-069ca142-293b-4929-83ea-d34549b8f6cf tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:43:59.949858 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-069ca142-293b-4929-83ea-d34549b8f6cf tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96b599f8890b4281a7e311cf37a039e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d7fcab5d3f465793d650f16c6ea8de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:43:59.957687 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-069ca142-293b-4929-83ea-d34549b8f6cf tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/bced4f24-572a-4316-97e8-3ceedc61a621" status: 200 len: 1520 microversion: 2.1 time: 0.144383 Oct 27 15:43:59.958245 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 148/275] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:43:59 2021] GET /compute/v2.1/servers/bced4f24-572a-4316-97e8-3ceedc61a621 => generated 1520 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 15:44:00.200085 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-7c0b17df-8290-40ea-b272-92119b6158ee tempest-VolumesActionsTest-1850781407 tempest-VolumesActionsTest-1850781407-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:44:00.200750 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-7c0b17df-8290-40ea-b272-92119b6158ee tempest-VolumesActionsTest-1850781407 tempest-VolumesActionsTest-1850781407-project] [instance: b355f088-15f6-4993-bf18-d99417b40f98] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:44:00.207682 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-7c0b17df-8290-40ea-b272-92119b6158ee tempest-VolumesActionsTest-1850781407 tempest-VolumesActionsTest-1850781407-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:44:00.208161 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-7c0b17df-8290-40ea-b272-92119b6158ee tempest-VolumesActionsTest-1850781407 tempest-VolumesActionsTest-1850781407-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:44:00.208937 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-7c0b17df-8290-40ea-b272-92119b6158ee tempest-VolumesActionsTest-1850781407 tempest-VolumesActionsTest-1850781407-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:44:00.209371 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-7c0b17df-8290-40ea-b272-92119b6158ee tempest-VolumesActionsTest-1850781407 tempest-VolumesActionsTest-1850781407-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:44:00.328626 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-7c0b17df-8290-40ea-b272-92119b6158ee tempest-VolumesActionsTest-1850781407 tempest-VolumesActionsTest-1850781407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f44b5c1ad2204da1935d8cb7ea8bc67e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eef06dd988f343e7ae8ccf2c93217e9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:44:00.335740 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-7c0b17df-8290-40ea-b272-92119b6158ee tempest-VolumesActionsTest-1850781407 tempest-VolumesActionsTest-1850781407-project] 10.222.0.64 "GET /compute/v2.1/servers/b355f088-15f6-4993-bf18-d99417b40f98" status: 200 len: 1314 microversion: 2.1 time: 0.139324 Oct 27 15:44:00.336525 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 149/276] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:44:00 2021] GET /compute/v2.1/servers/b355f088-15f6-4993-bf18-d99417b40f98 => generated 1314 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 15:44:00.550936 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-83ef22b9-0147-4040-a48a-7cfbd3fa18ca tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:44:00.551960 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-83ef22b9-0147-4040-a48a-7cfbd3fa18ca tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] [instance: a4e225e4-7815-4f6a-b1e6-53edab3c1abd] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:44:00.557740 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-83ef22b9-0147-4040-a48a-7cfbd3fa18ca tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:44:00.558179 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-83ef22b9-0147-4040-a48a-7cfbd3fa18ca tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:44:00.558944 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-83ef22b9-0147-4040-a48a-7cfbd3fa18ca tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:44:00.559375 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-83ef22b9-0147-4040-a48a-7cfbd3fa18ca tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:44:00.586958 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-83ef22b9-0147-4040-a48a-7cfbd3fa18ca tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] 10.222.0.64 "GET /compute/v2.1/servers/a4e225e4-7815-4f6a-b1e6-53edab3c1abd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040211 Oct 27 15:44:00.587439 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 150/277] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Oct 27 15:44:00 2021] GET /compute/v2.1/servers/a4e225e4-7815-4f6a-b1e6-53edab3c1abd/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 15:44:00.975608 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-36ca2329-b858-46bb-8e62-a953256c2873 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:44:00.976260 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-36ca2329-b858-46bb-8e62-a953256c2873 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: bced4f24-572a-4316-97e8-3ceedc61a621] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:44:00.982056 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-36ca2329-b858-46bb-8e62-a953256c2873 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:44:00.982495 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-36ca2329-b858-46bb-8e62-a953256c2873 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:44:00.983244 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-36ca2329-b858-46bb-8e62-a953256c2873 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:44:00.983665 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-36ca2329-b858-46bb-8e62-a953256c2873 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:44:01.105186 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-36ca2329-b858-46bb-8e62-a953256c2873 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96b599f8890b4281a7e311cf37a039e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d7fcab5d3f465793d650f16c6ea8de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:44:01.112482 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-36ca2329-b858-46bb-8e62-a953256c2873 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/bced4f24-572a-4316-97e8-3ceedc61a621" status: 200 len: 1520 microversion: 2.1 time: 0.141843 Oct 27 15:44:01.113025 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 151/278] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:44:00 2021] GET /compute/v2.1/servers/bced4f24-572a-4316-97e8-3ceedc61a621 => generated 1520 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 15:44:01.352872 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-88120b73-83ac-411f-9e27-f2ac1f18b287 tempest-VolumesActionsTest-1850781407 tempest-VolumesActionsTest-1850781407-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:44:01.353531 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-88120b73-83ac-411f-9e27-f2ac1f18b287 tempest-VolumesActionsTest-1850781407 tempest-VolumesActionsTest-1850781407-project] [instance: b355f088-15f6-4993-bf18-d99417b40f98] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:44:01.359513 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-88120b73-83ac-411f-9e27-f2ac1f18b287 tempest-VolumesActionsTest-1850781407 tempest-VolumesActionsTest-1850781407-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:44:01.359989 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-88120b73-83ac-411f-9e27-f2ac1f18b287 tempest-VolumesActionsTest-1850781407 tempest-VolumesActionsTest-1850781407-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:44:01.360770 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-88120b73-83ac-411f-9e27-f2ac1f18b287 tempest-VolumesActionsTest-1850781407 tempest-VolumesActionsTest-1850781407-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:44:01.361299 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-88120b73-83ac-411f-9e27-f2ac1f18b287 tempest-VolumesActionsTest-1850781407 tempest-VolumesActionsTest-1850781407-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:44:01.490411 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-88120b73-83ac-411f-9e27-f2ac1f18b287 tempest-VolumesActionsTest-1850781407 tempest-VolumesActionsTest-1850781407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f44b5c1ad2204da1935d8cb7ea8bc67e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eef06dd988f343e7ae8ccf2c93217e9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:44:01.497516 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-88120b73-83ac-411f-9e27-f2ac1f18b287 tempest-VolumesActionsTest-1850781407 tempest-VolumesActionsTest-1850781407-project] 10.222.0.64 "GET /compute/v2.1/servers/b355f088-15f6-4993-bf18-d99417b40f98" status: 200 len: 1314 microversion: 2.1 time: 0.148532 Oct 27 15:44:01.498073 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 152/279] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:44:01 2021] GET /compute/v2.1/servers/b355f088-15f6-4993-bf18-d99417b40f98 => generated 1314 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 15:44:01.597947 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-02e08d03-dc76-487f-be12-40ea40bc81ca tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:44:01.598865 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-02e08d03-dc76-487f-be12-40ea40bc81ca tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] [instance: a4e225e4-7815-4f6a-b1e6-53edab3c1abd] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:44:01.605164 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-02e08d03-dc76-487f-be12-40ea40bc81ca tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:44:01.605549 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-02e08d03-dc76-487f-be12-40ea40bc81ca tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:44:01.606350 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-02e08d03-dc76-487f-be12-40ea40bc81ca tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:44:01.606784 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-02e08d03-dc76-487f-be12-40ea40bc81ca tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:44:01.635279 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-02e08d03-dc76-487f-be12-40ea40bc81ca tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] 10.222.0.64 "GET /compute/v2.1/servers/a4e225e4-7815-4f6a-b1e6-53edab3c1abd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041550 Oct 27 15:44:01.635867 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 153/280] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Oct 27 15:44:01 2021] GET /compute/v2.1/servers/a4e225e4-7815-4f6a-b1e6-53edab3c1abd/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 15:44:01.771136 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-0c96baaf-cfbb-4f9c-8ca5-84b0f91e9c0c tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "POST /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672/action" status: 200 len: 26941 microversion: 2.20 time: 2.715148 Oct 27 15:44:01.771781 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 128/281] 10.222.0.64 () {62 vars in 1318 bytes} [Wed Oct 27 15:43:59 2021] POST /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672/action => generated 26941 bytes in 2717 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 27 15:44:02.128518 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-16adf026-5728-4886-b1c0-4e7bb0c9d1e9 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:44:02.129125 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-16adf026-5728-4886-b1c0-4e7bb0c9d1e9 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: bced4f24-572a-4316-97e8-3ceedc61a621] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:44:02.134824 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-16adf026-5728-4886-b1c0-4e7bb0c9d1e9 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:44:02.135285 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-16adf026-5728-4886-b1c0-4e7bb0c9d1e9 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:44:02.136073 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-16adf026-5728-4886-b1c0-4e7bb0c9d1e9 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:44:02.136498 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-16adf026-5728-4886-b1c0-4e7bb0c9d1e9 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:44:02.265583 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-16adf026-5728-4886-b1c0-4e7bb0c9d1e9 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96b599f8890b4281a7e311cf37a039e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d7fcab5d3f465793d650f16c6ea8de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:44:02.274072 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-16adf026-5728-4886-b1c0-4e7bb0c9d1e9 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/bced4f24-572a-4316-97e8-3ceedc61a621" status: 200 len: 1520 microversion: 2.1 time: 0.149616 Oct 27 15:44:02.274649 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 154/282] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:44:02 2021] GET /compute/v2.1/servers/bced4f24-572a-4316-97e8-3ceedc61a621 => generated 1520 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 15:44:02.516000 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-f41342d8-b743-4bc6-b435-3b36a345aad4 tempest-VolumesActionsTest-1850781407 tempest-VolumesActionsTest-1850781407-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:44:02.516693 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-f41342d8-b743-4bc6-b435-3b36a345aad4 tempest-VolumesActionsTest-1850781407 tempest-VolumesActionsTest-1850781407-project] [instance: b355f088-15f6-4993-bf18-d99417b40f98] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:44:02.523264 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-f41342d8-b743-4bc6-b435-3b36a345aad4 tempest-VolumesActionsTest-1850781407 tempest-VolumesActionsTest-1850781407-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:44:02.523703 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-f41342d8-b743-4bc6-b435-3b36a345aad4 tempest-VolumesActionsTest-1850781407 tempest-VolumesActionsTest-1850781407-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:44:02.524502 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-f41342d8-b743-4bc6-b435-3b36a345aad4 tempest-VolumesActionsTest-1850781407 tempest-VolumesActionsTest-1850781407-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:44:02.524932 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-f41342d8-b743-4bc6-b435-3b36a345aad4 tempest-VolumesActionsTest-1850781407 tempest-VolumesActionsTest-1850781407-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:44:02.647220 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-5d777a31-b15c-4aaa-a8be-b2e84e50250f tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:44:02.648338 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-5d777a31-b15c-4aaa-a8be-b2e84e50250f tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] [instance: a4e225e4-7815-4f6a-b1e6-53edab3c1abd] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:44:02.654808 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-5d777a31-b15c-4aaa-a8be-b2e84e50250f tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:44:02.655335 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-5d777a31-b15c-4aaa-a8be-b2e84e50250f tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:44:02.656222 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-5d777a31-b15c-4aaa-a8be-b2e84e50250f tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:44:02.656888 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-5d777a31-b15c-4aaa-a8be-b2e84e50250f tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:44:02.657367 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-f41342d8-b743-4bc6-b435-3b36a345aad4 tempest-VolumesActionsTest-1850781407 tempest-VolumesActionsTest-1850781407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f44b5c1ad2204da1935d8cb7ea8bc67e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eef06dd988f343e7ae8ccf2c93217e9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:44:02.666793 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-f41342d8-b743-4bc6-b435-3b36a345aad4 tempest-VolumesActionsTest-1850781407 tempest-VolumesActionsTest-1850781407-project] 10.222.0.64 "GET /compute/v2.1/servers/b355f088-15f6-4993-bf18-d99417b40f98" status: 200 len: 1314 microversion: 2.1 time: 0.154802 Oct 27 15:44:02.667495 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 129/283] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:44:02 2021] GET /compute/v2.1/servers/b355f088-15f6-4993-bf18-d99417b40f98 => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 15:44:02.688273 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-5d777a31-b15c-4aaa-a8be-b2e84e50250f tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] 10.222.0.64 "GET /compute/v2.1/servers/a4e225e4-7815-4f6a-b1e6-53edab3c1abd/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045641 Oct 27 15:44:02.692524 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 155/284] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Oct 27 15:44:02 2021] GET /compute/v2.1/servers/a4e225e4-7815-4f6a-b1e6-53edab3c1abd/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 27 15:44:02.782931 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-dd810d34-fdb8-4784-bd8c-aab7f0fe9581 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 15:44:02.783817 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-dd810d34-fdb8-4784-bd8c-aab7f0fe9581 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:44:02.790788 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-dd810d34-fdb8-4784-bd8c-aab7f0fe9581 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:44:02.791234 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-dd810d34-fdb8-4784-bd8c-aab7f0fe9581 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:44:02.792032 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-dd810d34-fdb8-4784-bd8c-aab7f0fe9581 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:44:02.792503 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-dd810d34-fdb8-4784-bd8c-aab7f0fe9581 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:44:02.876144 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-a9df27d4-eb18-459e-94f3-5eacb9494aae tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1980493969", "imageRef": "b585ffbc-6a36-48c9-81b3-e26f9bd0fcba", "flavorRef": "452", "networks": [{"uuid": "d9775d1d-2e09-490f-b5c0-23cc640635a9"}]}} {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 15:44:02.927085 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.network.neutron [None req-a9df27d4-eb18-459e-94f3-5eacb9494aae tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] validate_networks() for [('d9775d1d-2e09-490f-b5c0-23cc640635a9', None, None, None, None, None)] {{(pid=122224) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Oct 27 15:44:03.283320 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.virt.hardware [None req-a9df27d4-eb18-459e-94f3-5eacb9494aae tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Flavor limits 0:0:0 {{(pid=122224) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 15:44:03.283675 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.virt.hardware [None req-a9df27d4-eb18-459e-94f3-5eacb9494aae tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Image limits 0:0:0 {{(pid=122224) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 15:44:03.284356 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.virt.hardware [None req-a9df27d4-eb18-459e-94f3-5eacb9494aae tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Flavor pref 0:0:0 {{(pid=122224) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 15:44:03.284756 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.virt.hardware [None req-a9df27d4-eb18-459e-94f3-5eacb9494aae tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Image pref 0:0:0 {{(pid=122224) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 15:44:03.285159 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.virt.hardware [None req-a9df27d4-eb18-459e-94f3-5eacb9494aae tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122224) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 15:44:03.293587 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-a9df27d4-eb18-459e-94f3-5eacb9494aae tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:44:03.294022 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-a9df27d4-eb18-459e-94f3-5eacb9494aae tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:44:03.294815 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-a9df27d4-eb18-459e-94f3-5eacb9494aae tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:44:03.295241 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-a9df27d4-eb18-459e-94f3-5eacb9494aae tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:44:03.312674 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.quota [None req-a9df27d4-eb18-459e-94f3-5eacb9494aae tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Getting quotas for project 4fc48df471f247809d82ddf926bfdc6c. Resources: {'ram', 'instances', 'cores'} {{(pid=122224) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 27 15:44:03.317227 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.quota [None req-a9df27d4-eb18-459e-94f3-5eacb9494aae tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Getting quotas for user 0abe23cb5f314bc883ef7958b0ed9b5f and project 4fc48df471f247809d82ddf926bfdc6c. Resources: {'ram', 'instances', 'cores'} {{(pid=122224) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 27 15:44:03.327446 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-a9df27d4-eb18-459e-94f3-5eacb9494aae tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Going to run 1 instances... {{(pid=122224) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Oct 27 15:44:03.329749 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-a9df27d4-eb18-459e-94f3-5eacb9494aae tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] [instance: 3d2e562b-a203-495d-b337-756545861f78] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b585ffbc-6a36-48c9-81b3-e26f9bd0fcba',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122224) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Oct 27 15:44:03.374421 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-a9df27d4-eb18-459e-94f3-5eacb9494aae tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.501850 Oct 27 15:44:03.375062 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 156/285] 10.222.0.64 () {60 vars in 1146 bytes} [Wed Oct 27 15:44:02 2021] POST /compute/v2.1/servers => generated 380 bytes in 503 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 27 15:44:03.380306 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-7136686a-d9a9-4ed0-a511-7c6bdc1c67e4 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:44:03.380901 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-7136686a-d9a9-4ed0-a511-7c6bdc1c67e4 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: bced4f24-572a-4316-97e8-3ceedc61a621] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:44:03.386544 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-7136686a-d9a9-4ed0-a511-7c6bdc1c67e4 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:44:03.386977 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-7136686a-d9a9-4ed0-a511-7c6bdc1c67e4 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:44:03.387732 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-7136686a-d9a9-4ed0-a511-7c6bdc1c67e4 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:44:03.388186 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-7136686a-d9a9-4ed0-a511-7c6bdc1c67e4 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:44:03.512491 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-7136686a-d9a9-4ed0-a511-7c6bdc1c67e4 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96b599f8890b4281a7e311cf37a039e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d7fcab5d3f465793d650f16c6ea8de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:44:03.519720 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-7136686a-d9a9-4ed0-a511-7c6bdc1c67e4 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/bced4f24-572a-4316-97e8-3ceedc61a621" status: 200 len: 1520 microversion: 2.1 time: 0.142864 Oct 27 15:44:03.520302 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 157/286] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:44:03 2021] GET /compute/v2.1/servers/bced4f24-572a-4316-97e8-3ceedc61a621 => generated 1520 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 15:44:03.524651 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-cff91627-9869-48b4-82d6-99d980641f0b tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:44:03.525576 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-cff91627-9869-48b4-82d6-99d980641f0b tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] [instance: 3d2e562b-a203-495d-b337-756545861f78] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:44:03.585429 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-cff91627-9869-48b4-82d6-99d980641f0b tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0abe23cb5f314bc883ef7958b0ed9b5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fc48df471f247809d82ddf926bfdc6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:44:03.591871 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-cff91627-9869-48b4-82d6-99d980641f0b tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] 10.222.0.64 "GET /compute/v2.1/servers/3d2e562b-a203-495d-b337-756545861f78" status: 200 len: 1218 microversion: 2.1 time: 0.070629 Oct 27 15:44:03.592518 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 158/287] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:44:03 2021] GET /compute/v2.1/servers/3d2e562b-a203-495d-b337-756545861f78 => generated 1218 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 15:44:03.683599 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-5075d8cb-fc4b-40e4-a002-78f22d3c5daf tempest-VolumesActionsTest-1850781407 tempest-VolumesActionsTest-1850781407-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:44:03.684255 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-5075d8cb-fc4b-40e4-a002-78f22d3c5daf tempest-VolumesActionsTest-1850781407 tempest-VolumesActionsTest-1850781407-project] [instance: b355f088-15f6-4993-bf18-d99417b40f98] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:44:03.690728 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-5075d8cb-fc4b-40e4-a002-78f22d3c5daf tempest-VolumesActionsTest-1850781407 tempest-VolumesActionsTest-1850781407-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:44:03.691202 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-5075d8cb-fc4b-40e4-a002-78f22d3c5daf tempest-VolumesActionsTest-1850781407 tempest-VolumesActionsTest-1850781407-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:44:03.692080 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-5075d8cb-fc4b-40e4-a002-78f22d3c5daf tempest-VolumesActionsTest-1850781407 tempest-VolumesActionsTest-1850781407-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:44:03.692539 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-5075d8cb-fc4b-40e4-a002-78f22d3c5daf tempest-VolumesActionsTest-1850781407 tempest-VolumesActionsTest-1850781407-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:44:03.956168 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-5075d8cb-fc4b-40e4-a002-78f22d3c5daf tempest-VolumesActionsTest-1850781407 tempest-VolumesActionsTest-1850781407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f44b5c1ad2204da1935d8cb7ea8bc67e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eef06dd988f343e7ae8ccf2c93217e9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:44:03.963598 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-5075d8cb-fc4b-40e4-a002-78f22d3c5daf tempest-VolumesActionsTest-1850781407 tempest-VolumesActionsTest-1850781407-project] 10.222.0.64 "GET /compute/v2.1/servers/b355f088-15f6-4993-bf18-d99417b40f98" status: 200 len: 1314 microversion: 2.1 time: 0.284214 Oct 27 15:44:03.964187 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 159/288] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:44:03 2021] GET /compute/v2.1/servers/b355f088-15f6-4993-bf18-d99417b40f98 => generated 1314 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 15:44:04.536795 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-10d5c671-8c18-4e98-9a46-6866f8eaaf75 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:44:04.537394 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-10d5c671-8c18-4e98-9a46-6866f8eaaf75 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: bced4f24-572a-4316-97e8-3ceedc61a621] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:44:04.543135 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-10d5c671-8c18-4e98-9a46-6866f8eaaf75 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:44:04.543579 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-10d5c671-8c18-4e98-9a46-6866f8eaaf75 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:44:04.544369 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-10d5c671-8c18-4e98-9a46-6866f8eaaf75 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:44:04.544804 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-10d5c671-8c18-4e98-9a46-6866f8eaaf75 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:44:04.662355 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-10d5c671-8c18-4e98-9a46-6866f8eaaf75 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96b599f8890b4281a7e311cf37a039e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d7fcab5d3f465793d650f16c6ea8de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:44:04.669503 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-10d5c671-8c18-4e98-9a46-6866f8eaaf75 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/bced4f24-572a-4316-97e8-3ceedc61a621" status: 200 len: 1520 microversion: 2.1 time: 0.137044 Oct 27 15:44:04.670054 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 160/289] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:44:04 2021] GET /compute/v2.1/servers/bced4f24-572a-4316-97e8-3ceedc61a621 => generated 1520 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 15:44:04.674213 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-d4b648c4-3641-4afe-9191-ca2174e5edcd tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:44:04.674801 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-d4b648c4-3641-4afe-9191-ca2174e5edcd tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] [instance: 3d2e562b-a203-495d-b337-756545861f78] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:44:04.680657 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-d4b648c4-3641-4afe-9191-ca2174e5edcd tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:44:04.681101 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-d4b648c4-3641-4afe-9191-ca2174e5edcd tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:44:04.681854 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-d4b648c4-3641-4afe-9191-ca2174e5edcd tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:44:04.682282 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-d4b648c4-3641-4afe-9191-ca2174e5edcd tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:44:04.743004 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-d4b648c4-3641-4afe-9191-ca2174e5edcd tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0abe23cb5f314bc883ef7958b0ed9b5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fc48df471f247809d82ddf926bfdc6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:44:04.749994 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-d4b648c4-3641-4afe-9191-ca2174e5edcd tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] 10.222.0.64 "GET /compute/v2.1/servers/3d2e562b-a203-495d-b337-756545861f78" status: 200 len: 1222 microversion: 2.1 time: 0.078997 Oct 27 15:44:04.750544 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 161/290] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:44:04 2021] GET /compute/v2.1/servers/3d2e562b-a203-495d-b337-756545861f78 => generated 1222 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 15:44:04.981479 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-65af19cf-1059-45ef-a3bb-2a92e4894b2d tempest-VolumesActionsTest-1850781407 tempest-VolumesActionsTest-1850781407-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:44:04.982078 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-65af19cf-1059-45ef-a3bb-2a92e4894b2d tempest-VolumesActionsTest-1850781407 tempest-VolumesActionsTest-1850781407-project] [instance: b355f088-15f6-4993-bf18-d99417b40f98] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:44:04.988104 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-65af19cf-1059-45ef-a3bb-2a92e4894b2d tempest-VolumesActionsTest-1850781407 tempest-VolumesActionsTest-1850781407-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:44:04.988552 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-65af19cf-1059-45ef-a3bb-2a92e4894b2d tempest-VolumesActionsTest-1850781407 tempest-VolumesActionsTest-1850781407-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:44:04.989315 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-65af19cf-1059-45ef-a3bb-2a92e4894b2d tempest-VolumesActionsTest-1850781407 tempest-VolumesActionsTest-1850781407-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:44:04.989746 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-65af19cf-1059-45ef-a3bb-2a92e4894b2d tempest-VolumesActionsTest-1850781407 tempest-VolumesActionsTest-1850781407-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:44:05.107721 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-65af19cf-1059-45ef-a3bb-2a92e4894b2d tempest-VolumesActionsTest-1850781407 tempest-VolumesActionsTest-1850781407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f44b5c1ad2204da1935d8cb7ea8bc67e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eef06dd988f343e7ae8ccf2c93217e9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:44:05.114813 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-65af19cf-1059-45ef-a3bb-2a92e4894b2d tempest-VolumesActionsTest-1850781407 tempest-VolumesActionsTest-1850781407-project] 10.222.0.64 "GET /compute/v2.1/servers/b355f088-15f6-4993-bf18-d99417b40f98" status: 200 len: 1314 microversion: 2.1 time: 0.137340 Oct 27 15:44:05.115371 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 162/291] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:44:04 2021] GET /compute/v2.1/servers/b355f088-15f6-4993-bf18-d99417b40f98 => generated 1314 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 15:44:05.686375 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-232ce75f-81f7-43c5-8c16-abc9ab383885 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:44:05.686976 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-232ce75f-81f7-43c5-8c16-abc9ab383885 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: bced4f24-572a-4316-97e8-3ceedc61a621] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:44:05.693487 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-232ce75f-81f7-43c5-8c16-abc9ab383885 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:44:05.693927 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-232ce75f-81f7-43c5-8c16-abc9ab383885 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:44:05.694688 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-232ce75f-81f7-43c5-8c16-abc9ab383885 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:44:05.695125 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-232ce75f-81f7-43c5-8c16-abc9ab383885 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:44:05.813248 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-232ce75f-81f7-43c5-8c16-abc9ab383885 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96b599f8890b4281a7e311cf37a039e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d7fcab5d3f465793d650f16c6ea8de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:44:05.821235 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-232ce75f-81f7-43c5-8c16-abc9ab383885 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/bced4f24-572a-4316-97e8-3ceedc61a621" status: 200 len: 1520 microversion: 2.1 time: 0.138558 Oct 27 15:44:05.821791 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 163/292] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:44:05 2021] GET /compute/v2.1/servers/bced4f24-572a-4316-97e8-3ceedc61a621 => generated 1520 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 15:44:05.825900 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-df2a6efc-1de1-4bb7-a985-1359234baddd tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:44:05.826485 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-df2a6efc-1de1-4bb7-a985-1359234baddd tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] [instance: 3d2e562b-a203-495d-b337-756545861f78] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:44:05.832254 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-df2a6efc-1de1-4bb7-a985-1359234baddd tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:44:05.832693 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-df2a6efc-1de1-4bb7-a985-1359234baddd tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:44:05.833441 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-df2a6efc-1de1-4bb7-a985-1359234baddd tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:44:05.833870 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-df2a6efc-1de1-4bb7-a985-1359234baddd tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:44:05.893014 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-df2a6efc-1de1-4bb7-a985-1359234baddd tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0abe23cb5f314bc883ef7958b0ed9b5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fc48df471f247809d82ddf926bfdc6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:44:05.900294 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-df2a6efc-1de1-4bb7-a985-1359234baddd tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] 10.222.0.64 "GET /compute/v2.1/servers/3d2e562b-a203-495d-b337-756545861f78" status: 200 len: 1222 microversion: 2.1 time: 0.077531 Oct 27 15:44:05.900846 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 164/293] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:44:05 2021] GET /compute/v2.1/servers/3d2e562b-a203-495d-b337-756545861f78 => generated 1222 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 15:44:06.061074 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-dd810d34-fdb8-4784-bd8c-aab7f0fe9581 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "POST /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672/action" status: 200 len: 27806 microversion: 2.20 time: 3.281798 Oct 27 15:44:06.061720 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 130/294] 10.222.0.64 () {62 vars in 1318 bytes} [Wed Oct 27 15:44:02 2021] POST /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672/action => generated 27806 bytes in 3283 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 27 15:44:06.131299 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-bd0d0c02-fb24-4f13-ba6b-2602b0f254ea tempest-VolumesActionsTest-1850781407 tempest-VolumesActionsTest-1850781407-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:44:06.132042 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-bd0d0c02-fb24-4f13-ba6b-2602b0f254ea tempest-VolumesActionsTest-1850781407 tempest-VolumesActionsTest-1850781407-project] [instance: b355f088-15f6-4993-bf18-d99417b40f98] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:44:06.137804 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-bd0d0c02-fb24-4f13-ba6b-2602b0f254ea tempest-VolumesActionsTest-1850781407 tempest-VolumesActionsTest-1850781407-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:44:06.138251 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-bd0d0c02-fb24-4f13-ba6b-2602b0f254ea tempest-VolumesActionsTest-1850781407 tempest-VolumesActionsTest-1850781407-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:44:06.139048 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-bd0d0c02-fb24-4f13-ba6b-2602b0f254ea tempest-VolumesActionsTest-1850781407 tempest-VolumesActionsTest-1850781407-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:44:06.139477 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-bd0d0c02-fb24-4f13-ba6b-2602b0f254ea tempest-VolumesActionsTest-1850781407 tempest-VolumesActionsTest-1850781407-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:44:06.269586 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-bd0d0c02-fb24-4f13-ba6b-2602b0f254ea tempest-VolumesActionsTest-1850781407 tempest-VolumesActionsTest-1850781407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f44b5c1ad2204da1935d8cb7ea8bc67e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eef06dd988f343e7ae8ccf2c93217e9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:44:06.276811 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-bd0d0c02-fb24-4f13-ba6b-2602b0f254ea tempest-VolumesActionsTest-1850781407 tempest-VolumesActionsTest-1850781407-project] 10.222.0.64 "GET /compute/v2.1/servers/b355f088-15f6-4993-bf18-d99417b40f98" status: 200 len: 1314 microversion: 2.1 time: 0.149216 Oct 27 15:44:06.277378 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 165/295] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:44:06 2021] GET /compute/v2.1/servers/b355f088-15f6-4993-bf18-d99417b40f98 => generated 1314 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 15:44:06.838330 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-8d5d577b-422a-49c9-8e64-2c6adb5091d0 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:44:06.839018 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-8d5d577b-422a-49c9-8e64-2c6adb5091d0 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: bced4f24-572a-4316-97e8-3ceedc61a621] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:44:06.845670 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-8d5d577b-422a-49c9-8e64-2c6adb5091d0 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:44:06.846109 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-8d5d577b-422a-49c9-8e64-2c6adb5091d0 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:44:06.846878 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-8d5d577b-422a-49c9-8e64-2c6adb5091d0 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:44:06.847375 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-8d5d577b-422a-49c9-8e64-2c6adb5091d0 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:44:06.918430 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-2cd81292-1c6c-43ea-a601-3f3f820caba0 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:44:06.919242 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-2cd81292-1c6c-43ea-a601-3f3f820caba0 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] [instance: 3d2e562b-a203-495d-b337-756545861f78] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:44:06.927903 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-2cd81292-1c6c-43ea-a601-3f3f820caba0 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:44:06.928474 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-2cd81292-1c6c-43ea-a601-3f3f820caba0 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:44:06.929539 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-2cd81292-1c6c-43ea-a601-3f3f820caba0 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:44:06.930187 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-2cd81292-1c6c-43ea-a601-3f3f820caba0 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:44:06.995404 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-8d5d577b-422a-49c9-8e64-2c6adb5091d0 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96b599f8890b4281a7e311cf37a039e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d7fcab5d3f465793d650f16c6ea8de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:44:07.004334 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-2cd81292-1c6c-43ea-a601-3f3f820caba0 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0abe23cb5f314bc883ef7958b0ed9b5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fc48df471f247809d82ddf926bfdc6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:44:07.004784 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-8d5d577b-422a-49c9-8e64-2c6adb5091d0 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/bced4f24-572a-4316-97e8-3ceedc61a621" status: 200 len: 1520 microversion: 2.1 time: 0.169240 Oct 27 15:44:07.005662 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 131/296] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:44:06 2021] GET /compute/v2.1/servers/bced4f24-572a-4316-97e8-3ceedc61a621 => generated 1520 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 15:44:07.022401 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-2cd81292-1c6c-43ea-a601-3f3f820caba0 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] 10.222.0.64 "GET /compute/v2.1/servers/3d2e562b-a203-495d-b337-756545861f78" status: 200 len: 1270 microversion: 2.1 time: 0.108775 Oct 27 15:44:07.023512 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 166/297] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:44:06 2021] GET /compute/v2.1/servers/3d2e562b-a203-495d-b337-756545861f78 => generated 1270 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 15:44:07.073040 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-dd5be970-b82e-4591-bf6f-f68a8204f66d tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 15:44:07.073951 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-dd5be970-b82e-4591-bf6f-f68a8204f66d tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:44:07.088113 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-dd5be970-b82e-4591-bf6f-f68a8204f66d tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:44:07.088783 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-dd5be970-b82e-4591-bf6f-f68a8204f66d tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:44:07.089547 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-dd5be970-b82e-4591-bf6f-f68a8204f66d tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:44:07.090023 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-dd5be970-b82e-4591-bf6f-f68a8204f66d tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:44:07.243101 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-dd5be970-b82e-4591-bf6f-f68a8204f66d tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "POST /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672/action" status: 200 len: 27982 microversion: 2.20 time: 0.173527 Oct 27 15:44:07.244120 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 132/298] 10.222.0.64 () {62 vars in 1318 bytes} [Wed Oct 27 15:44:07 2021] POST /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672/action => generated 27982 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 27 15:44:07.293857 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-ef007001-ef12-4408-8b1b-190947ac55d6 tempest-VolumesActionsTest-1850781407 tempest-VolumesActionsTest-1850781407-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:44:07.294443 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-ef007001-ef12-4408-8b1b-190947ac55d6 tempest-VolumesActionsTest-1850781407 tempest-VolumesActionsTest-1850781407-project] [instance: b355f088-15f6-4993-bf18-d99417b40f98] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:44:07.302134 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-ef007001-ef12-4408-8b1b-190947ac55d6 tempest-VolumesActionsTest-1850781407 tempest-VolumesActionsTest-1850781407-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:44:07.303118 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-ef007001-ef12-4408-8b1b-190947ac55d6 tempest-VolumesActionsTest-1850781407 tempest-VolumesActionsTest-1850781407-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:44:07.304117 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-ef007001-ef12-4408-8b1b-190947ac55d6 tempest-VolumesActionsTest-1850781407 tempest-VolumesActionsTest-1850781407-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:44:07.305288 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-ef007001-ef12-4408-8b1b-190947ac55d6 tempest-VolumesActionsTest-1850781407 tempest-VolumesActionsTest-1850781407-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:44:07.533973 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-ef007001-ef12-4408-8b1b-190947ac55d6 tempest-VolumesActionsTest-1850781407 tempest-VolumesActionsTest-1850781407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f44b5c1ad2204da1935d8cb7ea8bc67e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eef06dd988f343e7ae8ccf2c93217e9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:44:07.542042 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-ef007001-ef12-4408-8b1b-190947ac55d6 tempest-VolumesActionsTest-1850781407 tempest-VolumesActionsTest-1850781407-project] 10.222.0.64 "GET /compute/v2.1/servers/b355f088-15f6-4993-bf18-d99417b40f98" status: 200 len: 1497 microversion: 2.1 time: 0.251818 Oct 27 15:44:07.542843 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 167/299] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:44:07 2021] GET /compute/v2.1/servers/b355f088-15f6-4993-bf18-d99417b40f98 => generated 1497 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 15:44:08.024794 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-757dfd98-fc2b-415f-bcc5-23ffa6820069 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:44:08.025779 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-757dfd98-fc2b-415f-bcc5-23ffa6820069 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: bced4f24-572a-4316-97e8-3ceedc61a621] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:44:08.033505 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-757dfd98-fc2b-415f-bcc5-23ffa6820069 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:44:08.033964 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-757dfd98-fc2b-415f-bcc5-23ffa6820069 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:44:08.035125 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-757dfd98-fc2b-415f-bcc5-23ffa6820069 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:44:08.035695 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-757dfd98-fc2b-415f-bcc5-23ffa6820069 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:44:08.055452 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-97dbff44-61a9-4ca6-a709-a9e76647ce97 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:44:08.056104 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-97dbff44-61a9-4ca6-a709-a9e76647ce97 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] [instance: 3d2e562b-a203-495d-b337-756545861f78] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:44:08.067277 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-97dbff44-61a9-4ca6-a709-a9e76647ce97 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:44:08.068046 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-97dbff44-61a9-4ca6-a709-a9e76647ce97 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:44:08.069403 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-97dbff44-61a9-4ca6-a709-a9e76647ce97 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:44:08.071035 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-97dbff44-61a9-4ca6-a709-a9e76647ce97 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:44:08.201030 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-757dfd98-fc2b-415f-bcc5-23ffa6820069 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96b599f8890b4281a7e311cf37a039e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d7fcab5d3f465793d650f16c6ea8de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:44:08.208809 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-757dfd98-fc2b-415f-bcc5-23ffa6820069 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/bced4f24-572a-4316-97e8-3ceedc61a621" status: 200 len: 1520 microversion: 2.1 time: 0.190362 Oct 27 15:44:08.209401 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 133/300] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:44:08 2021] GET /compute/v2.1/servers/bced4f24-572a-4316-97e8-3ceedc61a621 => generated 1520 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 15:44:08.255201 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-b836da7f-0bd7-4116-9470-09ddf9ddec96 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 15:44:08.256189 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-b836da7f-0bd7-4116-9470-09ddf9ddec96 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:44:08.262164 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-b836da7f-0bd7-4116-9470-09ddf9ddec96 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:44:08.262609 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-b836da7f-0bd7-4116-9470-09ddf9ddec96 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:44:08.263374 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-b836da7f-0bd7-4116-9470-09ddf9ddec96 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:44:08.263833 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-b836da7f-0bd7-4116-9470-09ddf9ddec96 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:44:08.302645 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-97dbff44-61a9-4ca6-a709-a9e76647ce97 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0abe23cb5f314bc883ef7958b0ed9b5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fc48df471f247809d82ddf926bfdc6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:44:08.309875 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-97dbff44-61a9-4ca6-a709-a9e76647ce97 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] 10.222.0.64 "GET /compute/v2.1/servers/3d2e562b-a203-495d-b337-756545861f78" status: 200 len: 1318 microversion: 2.1 time: 0.271254 Oct 27 15:44:08.310648 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 168/301] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:44:08 2021] GET /compute/v2.1/servers/3d2e562b-a203-495d-b337-756545861f78 => generated 1318 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 15:44:08.369622 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-b836da7f-0bd7-4116-9470-09ddf9ddec96 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "POST /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672/action" status: 200 len: 28164 microversion: 2.20 time: 0.118625 Oct 27 15:44:08.370679 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 134/302] 10.222.0.64 () {62 vars in 1318 bytes} [Wed Oct 27 15:44:08 2021] POST /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672/action => generated 28164 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 27 15:44:08.411303 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-9dac06d6-a326-4715-9db0-05b6d87ee587 tempest-VolumesActionsTest-1850781407 tempest-VolumesActionsTest-1850781407-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:44:08.411796 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-9dac06d6-a326-4715-9db0-05b6d87ee587 tempest-VolumesActionsTest-1850781407 tempest-VolumesActionsTest-1850781407-project] [instance: b355f088-15f6-4993-bf18-d99417b40f98] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:44:08.417927 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-9dac06d6-a326-4715-9db0-05b6d87ee587 tempest-VolumesActionsTest-1850781407 tempest-VolumesActionsTest-1850781407-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:44:08.418744 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-9dac06d6-a326-4715-9db0-05b6d87ee587 tempest-VolumesActionsTest-1850781407 tempest-VolumesActionsTest-1850781407-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:44:08.420452 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-9dac06d6-a326-4715-9db0-05b6d87ee587 tempest-VolumesActionsTest-1850781407 tempest-VolumesActionsTest-1850781407-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:44:08.421159 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-9dac06d6-a326-4715-9db0-05b6d87ee587 tempest-VolumesActionsTest-1850781407 tempest-VolumesActionsTest-1850781407-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:44:08.448325 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-9dac06d6-a326-4715-9db0-05b6d87ee587 tempest-VolumesActionsTest-1850781407 tempest-VolumesActionsTest-1850781407-project] [instance: b355f088-15f6-4993-bf18-d99417b40f98] Going to try to terminate instance {{(pid=122224) delete /opt/stack/nova/nova/compute/api.py:2612}} Oct 27 15:44:08.535153 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-9dac06d6-a326-4715-9db0-05b6d87ee587 tempest-VolumesActionsTest-1850781407 tempest-VolumesActionsTest-1850781407-project] 10.222.0.64 "DELETE /compute/v2.1/servers/b355f088-15f6-4993-bf18-d99417b40f98" status: 204 len: 0 microversion: 2.1 time: 0.126737 Oct 27 15:44:08.535975 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 169/303] 10.222.0.64 () {58 vars in 1238 bytes} [Wed Oct 27 15:44:08 2021] DELETE /compute/v2.1/servers/b355f088-15f6-4993-bf18-d99417b40f98 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 15:44:08.545092 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-928c6426-8537-4a03-9930-4a29aeeba464 tempest-VolumesActionsTest-1850781407 tempest-VolumesActionsTest-1850781407-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:44:08.546401 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-928c6426-8537-4a03-9930-4a29aeeba464 tempest-VolumesActionsTest-1850781407 tempest-VolumesActionsTest-1850781407-project] [instance: b355f088-15f6-4993-bf18-d99417b40f98] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:44:08.554463 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-928c6426-8537-4a03-9930-4a29aeeba464 tempest-VolumesActionsTest-1850781407 tempest-VolumesActionsTest-1850781407-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:44:08.554911 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-928c6426-8537-4a03-9930-4a29aeeba464 tempest-VolumesActionsTest-1850781407 tempest-VolumesActionsTest-1850781407-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:44:08.555732 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-928c6426-8537-4a03-9930-4a29aeeba464 tempest-VolumesActionsTest-1850781407 tempest-VolumesActionsTest-1850781407-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:44:08.556411 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-928c6426-8537-4a03-9930-4a29aeeba464 tempest-VolumesActionsTest-1850781407 tempest-VolumesActionsTest-1850781407-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:44:08.690192 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-928c6426-8537-4a03-9930-4a29aeeba464 tempest-VolumesActionsTest-1850781407 tempest-VolumesActionsTest-1850781407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f44b5c1ad2204da1935d8cb7ea8bc67e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eef06dd988f343e7ae8ccf2c93217e9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:44:08.701007 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-928c6426-8537-4a03-9930-4a29aeeba464 tempest-VolumesActionsTest-1850781407 tempest-VolumesActionsTest-1850781407-project] 10.222.0.64 "GET /compute/v2.1/servers/b355f088-15f6-4993-bf18-d99417b40f98" status: 200 len: 1503 microversion: 2.1 time: 0.160195 Oct 27 15:44:08.701725 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 135/304] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:44:08 2021] GET /compute/v2.1/servers/b355f088-15f6-4993-bf18-d99417b40f98 => generated 1503 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 15:44:08.799739 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [req-50be25c2-27fb-4f64-b6a5-37bd37cc7e63 req-6c518004-5d03-4ba5-8b93-d2de83892177 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3d2e562b-a203-495d-b337-756545861f78", "tag": "a76fa086-d710-4480-89a0-e6f5c183bfcf"}]} {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 15:44:08.802571 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 27 15:44:08.802571 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: warnings.warn(msg) Oct 27 15:44:08.812081 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [req-50be25c2-27fb-4f64-b6a5-37bd37cc7e63 req-6c518004-5d03-4ba5-8b93-d2de83892177 service nova] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:44:08.813312 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [req-50be25c2-27fb-4f64-b6a5-37bd37cc7e63 req-6c518004-5d03-4ba5-8b93-d2de83892177 service nova] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:44:08.828684 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.compute.server_external_events [req-50be25c2-27fb-4f64-b6a5-37bd37cc7e63 req-6c518004-5d03-4ba5-8b93-d2de83892177 service nova] Creating event network-changed:a76fa086-d710-4480-89a0-e6f5c183bfcf for instance 3d2e562b-a203-495d-b337-756545861f78 on hv-cinder-80070 Oct 27 15:44:08.833980 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [req-50be25c2-27fb-4f64-b6a5-37bd37cc7e63 req-6c518004-5d03-4ba5-8b93-d2de83892177 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039312 Oct 27 15:44:08.834572 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 170/305] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Oct 27 15:44:08 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 15:44:09.226589 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-b21d7fae-e9e0-4590-90b0-538dccbf1d13 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:44:09.227198 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-b21d7fae-e9e0-4590-90b0-538dccbf1d13 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: bced4f24-572a-4316-97e8-3ceedc61a621] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:44:09.233335 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-b21d7fae-e9e0-4590-90b0-538dccbf1d13 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:44:09.233782 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-b21d7fae-e9e0-4590-90b0-538dccbf1d13 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:44:09.234563 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-b21d7fae-e9e0-4590-90b0-538dccbf1d13 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:44:09.235009 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-b21d7fae-e9e0-4590-90b0-538dccbf1d13 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:44:09.327220 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-afcdfe9b-5ed6-4507-8473-b6d348044182 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:44:09.328149 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-afcdfe9b-5ed6-4507-8473-b6d348044182 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] [instance: 3d2e562b-a203-495d-b337-756545861f78] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:44:09.335279 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-afcdfe9b-5ed6-4507-8473-b6d348044182 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:44:09.335994 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-afcdfe9b-5ed6-4507-8473-b6d348044182 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:44:09.336777 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-afcdfe9b-5ed6-4507-8473-b6d348044182 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:44:09.337208 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-afcdfe9b-5ed6-4507-8473-b6d348044182 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:44:09.368616 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-b21d7fae-e9e0-4590-90b0-538dccbf1d13 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96b599f8890b4281a7e311cf37a039e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d7fcab5d3f465793d650f16c6ea8de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:44:09.380652 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-b21d7fae-e9e0-4590-90b0-538dccbf1d13 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/bced4f24-572a-4316-97e8-3ceedc61a621" status: 200 len: 1520 microversion: 2.1 time: 0.158550 Oct 27 15:44:09.381531 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 136/306] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:44:09 2021] GET /compute/v2.1/servers/bced4f24-572a-4316-97e8-3ceedc61a621 => generated 1520 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 15:44:09.386013 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-b2051391-c004-44b8-a995-ffab87206ea3 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 15:44:09.386928 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-b2051391-c004-44b8-a995-ffab87206ea3 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:44:09.392896 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-b2051391-c004-44b8-a995-ffab87206ea3 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:44:09.393327 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-b2051391-c004-44b8-a995-ffab87206ea3 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:44:09.395384 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-b2051391-c004-44b8-a995-ffab87206ea3 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:44:09.395821 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-b2051391-c004-44b8-a995-ffab87206ea3 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:44:09.492842 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-b2051391-c004-44b8-a995-ffab87206ea3 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "POST /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672/action" status: 200 len: 28164 microversion: 2.20 time: 0.110035 Oct 27 15:44:09.493670 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 137/307] 10.222.0.64 () {62 vars in 1318 bytes} [Wed Oct 27 15:44:09 2021] POST /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672/action => generated 28164 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 27 15:44:09.534344 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-afcdfe9b-5ed6-4507-8473-b6d348044182 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0abe23cb5f314bc883ef7958b0ed9b5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fc48df471f247809d82ddf926bfdc6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:44:09.541527 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-afcdfe9b-5ed6-4507-8473-b6d348044182 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] 10.222.0.64 "GET /compute/v2.1/servers/3d2e562b-a203-495d-b337-756545861f78" status: 200 len: 1318 microversion: 2.1 time: 0.218278 Oct 27 15:44:09.542095 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 171/308] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:44:09 2021] GET /compute/v2.1/servers/3d2e562b-a203-495d-b337-756545861f78 => generated 1318 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 15:44:09.718455 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-271b255f-95e1-41e7-82c0-4a78b6a94195 tempest-VolumesActionsTest-1850781407 tempest-VolumesActionsTest-1850781407-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:44:09.719291 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-271b255f-95e1-41e7-82c0-4a78b6a94195 tempest-VolumesActionsTest-1850781407 tempest-VolumesActionsTest-1850781407-project] [instance: b355f088-15f6-4993-bf18-d99417b40f98] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:44:09.726794 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-271b255f-95e1-41e7-82c0-4a78b6a94195 tempest-VolumesActionsTest-1850781407 tempest-VolumesActionsTest-1850781407-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:44:09.727234 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-271b255f-95e1-41e7-82c0-4a78b6a94195 tempest-VolumesActionsTest-1850781407 tempest-VolumesActionsTest-1850781407-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:44:09.728030 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-271b255f-95e1-41e7-82c0-4a78b6a94195 tempest-VolumesActionsTest-1850781407 tempest-VolumesActionsTest-1850781407-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:44:09.728465 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-271b255f-95e1-41e7-82c0-4a78b6a94195 tempest-VolumesActionsTest-1850781407 tempest-VolumesActionsTest-1850781407-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:44:09.860999 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-271b255f-95e1-41e7-82c0-4a78b6a94195 tempest-VolumesActionsTest-1850781407 tempest-VolumesActionsTest-1850781407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f44b5c1ad2204da1935d8cb7ea8bc67e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eef06dd988f343e7ae8ccf2c93217e9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:44:09.870401 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-271b255f-95e1-41e7-82c0-4a78b6a94195 tempest-VolumesActionsTest-1850781407 tempest-VolumesActionsTest-1850781407-project] 10.222.0.64 "GET /compute/v2.1/servers/b355f088-15f6-4993-bf18-d99417b40f98" status: 200 len: 1503 microversion: 2.1 time: 0.155896 Oct 27 15:44:09.870962 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 138/309] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:44:09 2021] GET /compute/v2.1/servers/b355f088-15f6-4993-bf18-d99417b40f98 => generated 1503 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 15:44:10.397485 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-b63d8c6a-6260-4be5-8f20-1da24cdd1c2e tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:44:10.398051 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-b63d8c6a-6260-4be5-8f20-1da24cdd1c2e tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: bced4f24-572a-4316-97e8-3ceedc61a621] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:44:10.404246 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-b63d8c6a-6260-4be5-8f20-1da24cdd1c2e tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:44:10.404695 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-b63d8c6a-6260-4be5-8f20-1da24cdd1c2e tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:44:10.405463 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-b63d8c6a-6260-4be5-8f20-1da24cdd1c2e tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:44:10.405896 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-b63d8c6a-6260-4be5-8f20-1da24cdd1c2e tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:44:10.504878 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-182908f1-3190-4a0b-a531-f77c9be583f1 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 15:44:10.505783 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-182908f1-3190-4a0b-a531-f77c9be583f1 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:44:10.512413 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-182908f1-3190-4a0b-a531-f77c9be583f1 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:44:10.512867 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-182908f1-3190-4a0b-a531-f77c9be583f1 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:44:10.513709 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-182908f1-3190-4a0b-a531-f77c9be583f1 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:44:10.514166 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-182908f1-3190-4a0b-a531-f77c9be583f1 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:44:10.533058 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-b63d8c6a-6260-4be5-8f20-1da24cdd1c2e tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96b599f8890b4281a7e311cf37a039e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d7fcab5d3f465793d650f16c6ea8de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:44:10.541092 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-b63d8c6a-6260-4be5-8f20-1da24cdd1c2e tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/bced4f24-572a-4316-97e8-3ceedc61a621" status: 200 len: 1520 microversion: 2.1 time: 0.147357 Oct 27 15:44:10.541886 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 172/310] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:44:10 2021] GET /compute/v2.1/servers/bced4f24-572a-4316-97e8-3ceedc61a621 => generated 1520 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 15:44:10.557729 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-5f0c9700-865e-4778-a828-a588e8b61680 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:44:10.558335 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-5f0c9700-865e-4778-a828-a588e8b61680 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] [instance: 3d2e562b-a203-495d-b337-756545861f78] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:44:10.564055 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-5f0c9700-865e-4778-a828-a588e8b61680 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:44:10.564500 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-5f0c9700-865e-4778-a828-a588e8b61680 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:44:10.565264 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-5f0c9700-865e-4778-a828-a588e8b61680 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:44:10.565728 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-5f0c9700-865e-4778-a828-a588e8b61680 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:44:10.602672 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-182908f1-3190-4a0b-a531-f77c9be583f1 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "POST /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672/action" status: 200 len: 28164 microversion: 2.20 time: 0.101448 Oct 27 15:44:10.604060 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 139/311] 10.222.0.64 () {62 vars in 1318 bytes} [Wed Oct 27 15:44:10 2021] POST /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672/action => generated 28164 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 27 15:44:10.690667 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-5f0c9700-865e-4778-a828-a588e8b61680 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0abe23cb5f314bc883ef7958b0ed9b5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fc48df471f247809d82ddf926bfdc6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:44:10.697879 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-5f0c9700-865e-4778-a828-a588e8b61680 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] 10.222.0.64 "GET /compute/v2.1/servers/3d2e562b-a203-495d-b337-756545861f78" status: 200 len: 1318 microversion: 2.1 time: 0.143693 Oct 27 15:44:10.698445 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 173/312] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:44:10 2021] GET /compute/v2.1/servers/3d2e562b-a203-495d-b337-756545861f78 => generated 1318 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 15:44:10.888467 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-319b7807-97bb-43fc-a36d-0bd949876807 tempest-VolumesActionsTest-1850781407 tempest-VolumesActionsTest-1850781407-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:44:10.889158 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-319b7807-97bb-43fc-a36d-0bd949876807 tempest-VolumesActionsTest-1850781407 tempest-VolumesActionsTest-1850781407-project] [instance: b355f088-15f6-4993-bf18-d99417b40f98] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:44:10.896008 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-319b7807-97bb-43fc-a36d-0bd949876807 tempest-VolumesActionsTest-1850781407 tempest-VolumesActionsTest-1850781407-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:44:10.896457 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-319b7807-97bb-43fc-a36d-0bd949876807 tempest-VolumesActionsTest-1850781407 tempest-VolumesActionsTest-1850781407-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:44:10.897217 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-319b7807-97bb-43fc-a36d-0bd949876807 tempest-VolumesActionsTest-1850781407 tempest-VolumesActionsTest-1850781407-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:44:10.897647 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-319b7807-97bb-43fc-a36d-0bd949876807 tempest-VolumesActionsTest-1850781407 tempest-VolumesActionsTest-1850781407-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:44:11.017631 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-319b7807-97bb-43fc-a36d-0bd949876807 tempest-VolumesActionsTest-1850781407 tempest-VolumesActionsTest-1850781407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f44b5c1ad2204da1935d8cb7ea8bc67e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eef06dd988f343e7ae8ccf2c93217e9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:44:11.025093 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-319b7807-97bb-43fc-a36d-0bd949876807 tempest-VolumesActionsTest-1850781407 tempest-VolumesActionsTest-1850781407-project] 10.222.0.64 "GET /compute/v2.1/servers/b355f088-15f6-4993-bf18-d99417b40f98" status: 200 len: 1503 microversion: 2.1 time: 0.140670 Oct 27 15:44:11.025655 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 140/313] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:44:10 2021] GET /compute/v2.1/servers/b355f088-15f6-4993-bf18-d99417b40f98 => generated 1503 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 15:44:11.557926 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-d4312101-3002-4ab3-86d6-94cc1c81edf1 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:44:11.558525 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-d4312101-3002-4ab3-86d6-94cc1c81edf1 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: bced4f24-572a-4316-97e8-3ceedc61a621] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:44:11.564896 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-d4312101-3002-4ab3-86d6-94cc1c81edf1 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:44:11.565335 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-d4312101-3002-4ab3-86d6-94cc1c81edf1 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:44:11.566092 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-d4312101-3002-4ab3-86d6-94cc1c81edf1 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:44:11.566515 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-d4312101-3002-4ab3-86d6-94cc1c81edf1 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:44:11.614273 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-5ad68880-a0b6-43b5-ad17-b2233029393a tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 15:44:11.615182 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-5ad68880-a0b6-43b5-ad17-b2233029393a tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:44:11.621360 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-5ad68880-a0b6-43b5-ad17-b2233029393a tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:44:11.621804 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-5ad68880-a0b6-43b5-ad17-b2233029393a tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:44:11.622606 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-5ad68880-a0b6-43b5-ad17-b2233029393a tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:44:11.623040 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-5ad68880-a0b6-43b5-ad17-b2233029393a tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:44:11.697212 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-d4312101-3002-4ab3-86d6-94cc1c81edf1 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96b599f8890b4281a7e311cf37a039e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d7fcab5d3f465793d650f16c6ea8de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:44:11.704473 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-d4312101-3002-4ab3-86d6-94cc1c81edf1 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/bced4f24-572a-4316-97e8-3ceedc61a621" status: 200 len: 1520 microversion: 2.1 time: 0.150242 Oct 27 15:44:11.705032 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 174/314] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:44:11 2021] GET /compute/v2.1/servers/bced4f24-572a-4316-97e8-3ceedc61a621 => generated 1520 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 15:44:11.714958 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-77a9467f-49d8-4e7a-834b-5f9ddb62cf07 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:44:11.715570 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-77a9467f-49d8-4e7a-834b-5f9ddb62cf07 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] [instance: 3d2e562b-a203-495d-b337-756545861f78] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:44:11.721444 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-77a9467f-49d8-4e7a-834b-5f9ddb62cf07 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:44:11.721886 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-77a9467f-49d8-4e7a-834b-5f9ddb62cf07 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:44:11.722675 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-77a9467f-49d8-4e7a-834b-5f9ddb62cf07 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:44:11.723157 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-77a9467f-49d8-4e7a-834b-5f9ddb62cf07 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:44:11.848316 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-77a9467f-49d8-4e7a-834b-5f9ddb62cf07 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0abe23cb5f314bc883ef7958b0ed9b5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fc48df471f247809d82ddf926bfdc6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:44:11.855738 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-77a9467f-49d8-4e7a-834b-5f9ddb62cf07 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] 10.222.0.64 "GET /compute/v2.1/servers/3d2e562b-a203-495d-b337-756545861f78" status: 200 len: 1318 microversion: 2.1 time: 0.144289 Oct 27 15:44:11.856335 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 175/315] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:44:11 2021] GET /compute/v2.1/servers/3d2e562b-a203-495d-b337-756545861f78 => generated 1318 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 15:44:12.042272 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-58bfdf31-96c6-4004-8323-14b5365e2a6c tempest-VolumesActionsTest-1850781407 tempest-VolumesActionsTest-1850781407-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:44:12.042877 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-58bfdf31-96c6-4004-8323-14b5365e2a6c tempest-VolumesActionsTest-1850781407 tempest-VolumesActionsTest-1850781407-project] [instance: b355f088-15f6-4993-bf18-d99417b40f98] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:44:12.049382 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-58bfdf31-96c6-4004-8323-14b5365e2a6c tempest-VolumesActionsTest-1850781407 tempest-VolumesActionsTest-1850781407-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:44:12.049819 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-58bfdf31-96c6-4004-8323-14b5365e2a6c tempest-VolumesActionsTest-1850781407 tempest-VolumesActionsTest-1850781407-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:44:12.050583 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-58bfdf31-96c6-4004-8323-14b5365e2a6c tempest-VolumesActionsTest-1850781407 tempest-VolumesActionsTest-1850781407-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:44:12.051009 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-58bfdf31-96c6-4004-8323-14b5365e2a6c tempest-VolumesActionsTest-1850781407 tempest-VolumesActionsTest-1850781407-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:44:12.175934 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-58bfdf31-96c6-4004-8323-14b5365e2a6c tempest-VolumesActionsTest-1850781407 tempest-VolumesActionsTest-1850781407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f44b5c1ad2204da1935d8cb7ea8bc67e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eef06dd988f343e7ae8ccf2c93217e9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:44:12.183221 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-58bfdf31-96c6-4004-8323-14b5365e2a6c tempest-VolumesActionsTest-1850781407 tempest-VolumesActionsTest-1850781407-project] 10.222.0.64 "GET /compute/v2.1/servers/b355f088-15f6-4993-bf18-d99417b40f98" status: 200 len: 1503 microversion: 2.1 time: 0.144534 Oct 27 15:44:12.183790 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 176/316] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:44:12 2021] GET /compute/v2.1/servers/b355f088-15f6-4993-bf18-d99417b40f98 => generated 1503 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 15:44:12.721836 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-46c7f077-2324-4144-b3c1-fdfa1a86782c tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:44:12.722460 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-46c7f077-2324-4144-b3c1-fdfa1a86782c tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: bced4f24-572a-4316-97e8-3ceedc61a621] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:44:12.729239 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-46c7f077-2324-4144-b3c1-fdfa1a86782c tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:44:12.729675 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-46c7f077-2324-4144-b3c1-fdfa1a86782c tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:44:12.730432 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-46c7f077-2324-4144-b3c1-fdfa1a86782c tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:44:12.730858 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-46c7f077-2324-4144-b3c1-fdfa1a86782c tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:44:12.851599 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-46c7f077-2324-4144-b3c1-fdfa1a86782c tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96b599f8890b4281a7e311cf37a039e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d7fcab5d3f465793d650f16c6ea8de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:44:12.858705 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-46c7f077-2324-4144-b3c1-fdfa1a86782c tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/bced4f24-572a-4316-97e8-3ceedc61a621" status: 200 len: 1520 microversion: 2.1 time: 0.140538 Oct 27 15:44:12.859315 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 177/317] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:44:12 2021] GET /compute/v2.1/servers/bced4f24-572a-4316-97e8-3ceedc61a621 => generated 1520 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 15:44:12.871257 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-11c514d4-5f8a-4024-b1b8-2824712b3c99 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:44:12.872008 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-11c514d4-5f8a-4024-b1b8-2824712b3c99 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] [instance: 3d2e562b-a203-495d-b337-756545861f78] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:44:12.877391 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-11c514d4-5f8a-4024-b1b8-2824712b3c99 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:44:12.877838 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-11c514d4-5f8a-4024-b1b8-2824712b3c99 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:44:12.878595 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-11c514d4-5f8a-4024-b1b8-2824712b3c99 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:44:12.879022 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-11c514d4-5f8a-4024-b1b8-2824712b3c99 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:44:13.002694 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-11c514d4-5f8a-4024-b1b8-2824712b3c99 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0abe23cb5f314bc883ef7958b0ed9b5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fc48df471f247809d82ddf926bfdc6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:44:13.010944 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-11c514d4-5f8a-4024-b1b8-2824712b3c99 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] 10.222.0.64 "GET /compute/v2.1/servers/3d2e562b-a203-495d-b337-756545861f78" status: 200 len: 1318 microversion: 2.1 time: 0.143036 Oct 27 15:44:13.011501 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 178/318] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:44:12 2021] GET /compute/v2.1/servers/3d2e562b-a203-495d-b337-756545861f78 => generated 1318 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 15:44:13.200067 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-ad904d22-c016-4c70-8369-a563ca993d2a tempest-VolumesActionsTest-1850781407 tempest-VolumesActionsTest-1850781407-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:44:13.200663 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-ad904d22-c016-4c70-8369-a563ca993d2a tempest-VolumesActionsTest-1850781407 tempest-VolumesActionsTest-1850781407-project] [instance: b355f088-15f6-4993-bf18-d99417b40f98] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:44:13.206402 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-ad904d22-c016-4c70-8369-a563ca993d2a tempest-VolumesActionsTest-1850781407 tempest-VolumesActionsTest-1850781407-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:44:13.206841 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-ad904d22-c016-4c70-8369-a563ca993d2a tempest-VolumesActionsTest-1850781407 tempest-VolumesActionsTest-1850781407-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:44:13.207650 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-ad904d22-c016-4c70-8369-a563ca993d2a tempest-VolumesActionsTest-1850781407 tempest-VolumesActionsTest-1850781407-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:44:13.208292 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-ad904d22-c016-4c70-8369-a563ca993d2a tempest-VolumesActionsTest-1850781407 tempest-VolumesActionsTest-1850781407-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:44:13.330997 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-ad904d22-c016-4c70-8369-a563ca993d2a tempest-VolumesActionsTest-1850781407 tempest-VolumesActionsTest-1850781407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f44b5c1ad2204da1935d8cb7ea8bc67e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eef06dd988f343e7ae8ccf2c93217e9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:44:13.338146 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-ad904d22-c016-4c70-8369-a563ca993d2a tempest-VolumesActionsTest-1850781407 tempest-VolumesActionsTest-1850781407-project] 10.222.0.64 "GET /compute/v2.1/servers/b355f088-15f6-4993-bf18-d99417b40f98" status: 200 len: 1503 microversion: 2.1 time: 0.141733 Oct 27 15:44:13.338701 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 179/319] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:44:13 2021] GET /compute/v2.1/servers/b355f088-15f6-4993-bf18-d99417b40f98 => generated 1503 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 15:44:13.876302 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-ad6127ef-8460-4107-9bc1-d2eda61f9bbb tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:44:13.876953 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-ad6127ef-8460-4107-9bc1-d2eda61f9bbb tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: bced4f24-572a-4316-97e8-3ceedc61a621] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:44:13.883625 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-ad6127ef-8460-4107-9bc1-d2eda61f9bbb tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:44:13.884102 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-ad6127ef-8460-4107-9bc1-d2eda61f9bbb tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:44:13.884868 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-ad6127ef-8460-4107-9bc1-d2eda61f9bbb tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:44:13.885300 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-ad6127ef-8460-4107-9bc1-d2eda61f9bbb tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:44:14.006844 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-ad6127ef-8460-4107-9bc1-d2eda61f9bbb tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96b599f8890b4281a7e311cf37a039e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d7fcab5d3f465793d650f16c6ea8de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:44:14.014056 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-ad6127ef-8460-4107-9bc1-d2eda61f9bbb tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/bced4f24-572a-4316-97e8-3ceedc61a621" status: 200 len: 1520 microversion: 2.1 time: 0.141446 Oct 27 15:44:14.014612 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 180/320] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:44:13 2021] GET /compute/v2.1/servers/bced4f24-572a-4316-97e8-3ceedc61a621 => generated 1520 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 15:44:14.028011 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-bb92d476-c4d6-4a63-92b8-276c2ab4a794 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:44:14.028611 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-bb92d476-c4d6-4a63-92b8-276c2ab4a794 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] [instance: 3d2e562b-a203-495d-b337-756545861f78] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:44:14.034297 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-bb92d476-c4d6-4a63-92b8-276c2ab4a794 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:44:14.034723 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-bb92d476-c4d6-4a63-92b8-276c2ab4a794 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:44:14.035476 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-bb92d476-c4d6-4a63-92b8-276c2ab4a794 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:44:14.036418 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-bb92d476-c4d6-4a63-92b8-276c2ab4a794 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:44:14.103828 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-5ad68880-a0b6-43b5-ad17-b2233029393a tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "POST /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672/action" status: 200 len: 28164 microversion: 2.20 time: 2.493136 Oct 27 15:44:14.106501 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 141/321] 10.222.0.64 () {62 vars in 1318 bytes} [Wed Oct 27 15:44:11 2021] POST /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672/action => generated 28164 bytes in 2497 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 27 15:44:14.169112 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-bb92d476-c4d6-4a63-92b8-276c2ab4a794 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0abe23cb5f314bc883ef7958b0ed9b5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fc48df471f247809d82ddf926bfdc6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:44:14.177744 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-bb92d476-c4d6-4a63-92b8-276c2ab4a794 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] 10.222.0.64 "GET /compute/v2.1/servers/3d2e562b-a203-495d-b337-756545861f78" status: 200 len: 1318 microversion: 2.1 time: 0.152860 Oct 27 15:44:14.178528 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 181/322] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:44:14 2021] GET /compute/v2.1/servers/3d2e562b-a203-495d-b337-756545861f78 => generated 1318 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 15:44:14.356309 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-63921fc5-cf15-4eed-a481-f395ca31b69d tempest-VolumesActionsTest-1850781407 tempest-VolumesActionsTest-1850781407-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:44:14.357012 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-63921fc5-cf15-4eed-a481-f395ca31b69d tempest-VolumesActionsTest-1850781407 tempest-VolumesActionsTest-1850781407-project] [instance: b355f088-15f6-4993-bf18-d99417b40f98] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:44:14.363879 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-63921fc5-cf15-4eed-a481-f395ca31b69d tempest-VolumesActionsTest-1850781407 tempest-VolumesActionsTest-1850781407-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:44:14.364328 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-63921fc5-cf15-4eed-a481-f395ca31b69d tempest-VolumesActionsTest-1850781407 tempest-VolumesActionsTest-1850781407-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:44:14.365106 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-63921fc5-cf15-4eed-a481-f395ca31b69d tempest-VolumesActionsTest-1850781407 tempest-VolumesActionsTest-1850781407-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:44:14.365540 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-63921fc5-cf15-4eed-a481-f395ca31b69d tempest-VolumesActionsTest-1850781407 tempest-VolumesActionsTest-1850781407-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:44:14.498108 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-63921fc5-cf15-4eed-a481-f395ca31b69d tempest-VolumesActionsTest-1850781407 tempest-VolumesActionsTest-1850781407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f44b5c1ad2204da1935d8cb7ea8bc67e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eef06dd988f343e7ae8ccf2c93217e9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:44:14.505988 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-63921fc5-cf15-4eed-a481-f395ca31b69d tempest-VolumesActionsTest-1850781407 tempest-VolumesActionsTest-1850781407-project] 10.222.0.64 "GET /compute/v2.1/servers/b355f088-15f6-4993-bf18-d99417b40f98" status: 200 len: 1503 microversion: 2.1 time: 0.153751 Oct 27 15:44:14.506568 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 142/323] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:44:14 2021] GET /compute/v2.1/servers/b355f088-15f6-4993-bf18-d99417b40f98 => generated 1503 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 15:44:15.032029 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [req-1b812e2d-971d-4478-996a-313611ce8bd1 req-e216b51e-01cf-4593-b4f3-7d3f5bfadef2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b355f088-15f6-4993-bf18-d99417b40f98", "name": "network-vif-deleted", "tag": "74629cf8-105c-46a7-9f14-6b76b6add445"}]} {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 15:44:15.032620 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-6e65a5d1-7e83-4369-aeb5-06605e6e3080 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:44:15.032726 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-6e65a5d1-7e83-4369-aeb5-06605e6e3080 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: bced4f24-572a-4316-97e8-3ceedc61a621] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:44:15.033695 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 27 15:44:15.033695 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: warnings.warn(msg) Oct 27 15:44:15.040420 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-6e65a5d1-7e83-4369-aeb5-06605e6e3080 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:44:15.040859 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-6e65a5d1-7e83-4369-aeb5-06605e6e3080 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:44:15.041627 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-6e65a5d1-7e83-4369-aeb5-06605e6e3080 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:44:15.041961 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [req-1b812e2d-971d-4478-996a-313611ce8bd1 req-e216b51e-01cf-4593-b4f3-7d3f5bfadef2 service nova] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:44:15.042064 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-6e65a5d1-7e83-4369-aeb5-06605e6e3080 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:44:15.042405 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [req-1b812e2d-971d-4478-996a-313611ce8bd1 req-e216b51e-01cf-4593-b4f3-7d3f5bfadef2 service nova] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:44:15.054734 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.compute.server_external_events [req-1b812e2d-971d-4478-996a-313611ce8bd1 req-e216b51e-01cf-4593-b4f3-7d3f5bfadef2 service nova] Creating event network-vif-deleted:74629cf8-105c-46a7-9f14-6b76b6add445 for instance b355f088-15f6-4993-bf18-d99417b40f98 on hv-cinder-80070 Oct 27 15:44:15.059906 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [req-1b812e2d-971d-4478-996a-313611ce8bd1 req-e216b51e-01cf-4593-b4f3-7d3f5bfadef2 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031255 Oct 27 15:44:15.060590 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 182/324] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Oct 27 15:44:15 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 15:44:15.117592 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-905f949b-ea01-404e-97b3-f9ca8478c8dd tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 15:44:15.118787 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-905f949b-ea01-404e-97b3-f9ca8478c8dd tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:44:15.125408 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-905f949b-ea01-404e-97b3-f9ca8478c8dd tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:44:15.125855 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-905f949b-ea01-404e-97b3-f9ca8478c8dd tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:44:15.127641 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-905f949b-ea01-404e-97b3-f9ca8478c8dd tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:44:15.132201 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-905f949b-ea01-404e-97b3-f9ca8478c8dd tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:44:15.177003 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-6e65a5d1-7e83-4369-aeb5-06605e6e3080 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96b599f8890b4281a7e311cf37a039e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d7fcab5d3f465793d650f16c6ea8de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:44:15.184393 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-6e65a5d1-7e83-4369-aeb5-06605e6e3080 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/bced4f24-572a-4316-97e8-3ceedc61a621" status: 200 len: 1520 microversion: 2.1 time: 0.156013 Oct 27 15:44:15.184959 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 143/325] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:44:15 2021] GET /compute/v2.1/servers/bced4f24-572a-4316-97e8-3ceedc61a621 => generated 1520 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 15:44:15.195682 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-a7a98207-1e25-490a-b225-62435648f67b tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:44:15.196396 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-a7a98207-1e25-490a-b225-62435648f67b tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] [instance: 3d2e562b-a203-495d-b337-756545861f78] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:44:15.202495 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-a7a98207-1e25-490a-b225-62435648f67b tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:44:15.202932 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-a7a98207-1e25-490a-b225-62435648f67b tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:44:15.203684 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-a7a98207-1e25-490a-b225-62435648f67b tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:44:15.204140 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-a7a98207-1e25-490a-b225-62435648f67b tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:44:15.227333 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-905f949b-ea01-404e-97b3-f9ca8478c8dd tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "POST /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672/action" status: 200 len: 28164 microversion: 2.20 time: 0.113741 Oct 27 15:44:15.227908 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 183/326] 10.222.0.64 () {62 vars in 1318 bytes} [Wed Oct 27 15:44:15 2021] POST /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672/action => generated 28164 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 27 15:44:15.328555 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-a7a98207-1e25-490a-b225-62435648f67b tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0abe23cb5f314bc883ef7958b0ed9b5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fc48df471f247809d82ddf926bfdc6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:44:15.336375 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-a7a98207-1e25-490a-b225-62435648f67b tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] 10.222.0.64 "GET /compute/v2.1/servers/3d2e562b-a203-495d-b337-756545861f78" status: 200 len: 1318 microversion: 2.1 time: 0.145813 Oct 27 15:44:15.336956 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 144/327] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:44:15 2021] GET /compute/v2.1/servers/3d2e562b-a203-495d-b337-756545861f78 => generated 1318 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 15:44:15.524902 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-910c4348-1713-4008-9d8a-2643616b822c tempest-VolumesActionsTest-1850781407 tempest-VolumesActionsTest-1850781407-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:44:15.525580 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-910c4348-1713-4008-9d8a-2643616b822c tempest-VolumesActionsTest-1850781407 tempest-VolumesActionsTest-1850781407-project] [instance: b355f088-15f6-4993-bf18-d99417b40f98] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:44:15.533343 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-910c4348-1713-4008-9d8a-2643616b822c tempest-VolumesActionsTest-1850781407 tempest-VolumesActionsTest-1850781407-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:44:15.533786 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-910c4348-1713-4008-9d8a-2643616b822c tempest-VolumesActionsTest-1850781407 tempest-VolumesActionsTest-1850781407-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:44:15.534551 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-910c4348-1713-4008-9d8a-2643616b822c tempest-VolumesActionsTest-1850781407 tempest-VolumesActionsTest-1850781407-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:44:15.534981 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-910c4348-1713-4008-9d8a-2643616b822c tempest-VolumesActionsTest-1850781407 tempest-VolumesActionsTest-1850781407-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:44:15.572193 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-910c4348-1713-4008-9d8a-2643616b822c tempest-VolumesActionsTest-1850781407 tempest-VolumesActionsTest-1850781407-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:44:15.573107 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-910c4348-1713-4008-9d8a-2643616b822c tempest-VolumesActionsTest-1850781407 tempest-VolumesActionsTest-1850781407-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:44:15.573466 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.objects.instance [None req-910c4348-1713-4008-9d8a-2643616b822c tempest-VolumesActionsTest-1850781407 tempest-VolumesActionsTest-1850781407-project] Lazy-loading 'fault' on Instance uuid b355f088-15f6-4993-bf18-d99417b40f98 {{(pid=122224) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 27 15:44:15.618447 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-910c4348-1713-4008-9d8a-2643616b822c tempest-VolumesActionsTest-1850781407 tempest-VolumesActionsTest-1850781407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f44b5c1ad2204da1935d8cb7ea8bc67e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eef06dd988f343e7ae8ccf2c93217e9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:44:15.627167 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-910c4348-1713-4008-9d8a-2643616b822c tempest-VolumesActionsTest-1850781407 tempest-VolumesActionsTest-1850781407-project] 10.222.0.64 "GET /compute/v2.1/servers/b355f088-15f6-4993-bf18-d99417b40f98" status: 200 len: 1304 microversion: 2.1 time: 0.106992 Oct 27 15:44:15.628329 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 184/328] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:44:15 2021] GET /compute/v2.1/servers/b355f088-15f6-4993-bf18-d99417b40f98 => generated 1304 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 15:44:16.201375 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-70072ced-caa0-4a44-80d3-94159fdce108 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:44:16.201985 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-70072ced-caa0-4a44-80d3-94159fdce108 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: bced4f24-572a-4316-97e8-3ceedc61a621] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:44:16.208435 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-70072ced-caa0-4a44-80d3-94159fdce108 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:44:16.208878 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-70072ced-caa0-4a44-80d3-94159fdce108 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:44:16.209678 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-70072ced-caa0-4a44-80d3-94159fdce108 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:44:16.210116 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-70072ced-caa0-4a44-80d3-94159fdce108 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:44:16.239629 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-612de818-bd50-4b34-bc69-4c6c71ed0be0 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 15:44:16.240556 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-612de818-bd50-4b34-bc69-4c6c71ed0be0 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:44:16.246907 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-612de818-bd50-4b34-bc69-4c6c71ed0be0 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:44:16.247352 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-612de818-bd50-4b34-bc69-4c6c71ed0be0 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:44:16.248317 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-612de818-bd50-4b34-bc69-4c6c71ed0be0 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:44:16.248755 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-612de818-bd50-4b34-bc69-4c6c71ed0be0 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:44:16.342020 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-70072ced-caa0-4a44-80d3-94159fdce108 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96b599f8890b4281a7e311cf37a039e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d7fcab5d3f465793d650f16c6ea8de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:44:16.350743 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-70072ced-caa0-4a44-80d3-94159fdce108 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/bced4f24-572a-4316-97e8-3ceedc61a621" status: 200 len: 1520 microversion: 2.1 time: 0.152952 Oct 27 15:44:16.351339 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 145/329] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:44:16 2021] GET /compute/v2.1/servers/bced4f24-572a-4316-97e8-3ceedc61a621 => generated 1520 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 15:44:16.356314 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-444367fe-c19e-426f-b063-2b5db4d34258 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:44:16.356809 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-444367fe-c19e-426f-b063-2b5db4d34258 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] [instance: 3d2e562b-a203-495d-b337-756545861f78] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:44:16.363353 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-444367fe-c19e-426f-b063-2b5db4d34258 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:44:16.364987 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-444367fe-c19e-426f-b063-2b5db4d34258 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:44:16.365474 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-444367fe-c19e-426f-b063-2b5db4d34258 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:44:16.365914 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-444367fe-c19e-426f-b063-2b5db4d34258 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:44:16.369009 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-612de818-bd50-4b34-bc69-4c6c71ed0be0 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "POST /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672/action" status: 200 len: 28356 microversion: 2.20 time: 0.133905 Oct 27 15:44:16.369738 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 185/330] 10.222.0.64 () {62 vars in 1318 bytes} [Wed Oct 27 15:44:16 2021] POST /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672/action => generated 28356 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 27 15:44:16.505285 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-444367fe-c19e-426f-b063-2b5db4d34258 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0abe23cb5f314bc883ef7958b0ed9b5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fc48df471f247809d82ddf926bfdc6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:44:16.514004 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-444367fe-c19e-426f-b063-2b5db4d34258 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] 10.222.0.64 "GET /compute/v2.1/servers/3d2e562b-a203-495d-b337-756545861f78" status: 200 len: 1318 microversion: 2.1 time: 0.161347 Oct 27 15:44:16.514946 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 146/331] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:44:16 2021] GET /compute/v2.1/servers/3d2e562b-a203-495d-b337-756545861f78 => generated 1318 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 15:44:16.650979 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-6c2322e2-1a55-4853-88b0-96975f7ef5db tempest-VolumesActionsTest-1850781407 tempest-VolumesActionsTest-1850781407-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:44:16.650979 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-6c2322e2-1a55-4853-88b0-96975f7ef5db tempest-VolumesActionsTest-1850781407 tempest-VolumesActionsTest-1850781407-project] [instance: b355f088-15f6-4993-bf18-d99417b40f98] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:44:16.654305 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-6c2322e2-1a55-4853-88b0-96975f7ef5db tempest-VolumesActionsTest-1850781407 tempest-VolumesActionsTest-1850781407-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:44:16.654748 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-6c2322e2-1a55-4853-88b0-96975f7ef5db tempest-VolumesActionsTest-1850781407 tempest-VolumesActionsTest-1850781407-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:44:16.655609 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-6c2322e2-1a55-4853-88b0-96975f7ef5db tempest-VolumesActionsTest-1850781407 tempest-VolumesActionsTest-1850781407-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:44:16.655963 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-6c2322e2-1a55-4853-88b0-96975f7ef5db tempest-VolumesActionsTest-1850781407 tempest-VolumesActionsTest-1850781407-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:44:16.670927 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.wsgi [None req-6c2322e2-1a55-4853-88b0-96975f7ef5db tempest-VolumesActionsTest-1850781407 tempest-VolumesActionsTest-1850781407-project] HTTP exception thrown: Instance b355f088-15f6-4993-bf18-d99417b40f98 could not be found. Oct 27 15:44:16.671929 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-6c2322e2-1a55-4853-88b0-96975f7ef5db tempest-VolumesActionsTest-1850781407 tempest-VolumesActionsTest-1850781407-project] Returning 404 to user: Instance b355f088-15f6-4993-bf18-d99417b40f98 could not be found. {{(pid=122224) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 27 15:44:16.672801 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-6c2322e2-1a55-4853-88b0-96975f7ef5db tempest-VolumesActionsTest-1850781407 tempest-VolumesActionsTest-1850781407-project] 10.222.0.64 "GET /compute/v2.1/servers/b355f088-15f6-4993-bf18-d99417b40f98" status: 404 len: 111 microversion: 2.1 time: 0.031136 Oct 27 15:44:16.673358 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 186/332] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:44:16 2021] GET /compute/v2.1/servers/b355f088-15f6-4993-bf18-d99417b40f98 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 15:44:17.370935 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-6614866d-bb2a-4c7e-ab13-7672997f8015 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:44:17.370935 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-6614866d-bb2a-4c7e-ab13-7672997f8015 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: bced4f24-572a-4316-97e8-3ceedc61a621] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:44:17.376865 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-6614866d-bb2a-4c7e-ab13-7672997f8015 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:44:17.377289 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-6614866d-bb2a-4c7e-ab13-7672997f8015 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:44:17.378534 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-6614866d-bb2a-4c7e-ab13-7672997f8015 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:44:17.379934 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-6614866d-bb2a-4c7e-ab13-7672997f8015 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:44:17.382698 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-bf3c78aa-1abe-4542-9780-02903715c296 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 15:44:17.384294 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-bf3c78aa-1abe-4542-9780-02903715c296 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:44:17.390740 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-bf3c78aa-1abe-4542-9780-02903715c296 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:44:17.391169 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-bf3c78aa-1abe-4542-9780-02903715c296 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:44:17.392006 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-bf3c78aa-1abe-4542-9780-02903715c296 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:44:17.392442 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-bf3c78aa-1abe-4542-9780-02903715c296 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:44:17.505580 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-6614866d-bb2a-4c7e-ab13-7672997f8015 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96b599f8890b4281a7e311cf37a039e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d7fcab5d3f465793d650f16c6ea8de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:44:17.512892 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-6614866d-bb2a-4c7e-ab13-7672997f8015 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/bced4f24-572a-4316-97e8-3ceedc61a621" status: 200 len: 1520 microversion: 2.1 time: 0.149127 Oct 27 15:44:17.513472 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 147/333] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:44:17 2021] GET /compute/v2.1/servers/bced4f24-572a-4316-97e8-3ceedc61a621 => generated 1520 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 15:44:17.534061 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-0269e985-9d5c-4f6a-8660-4887e00b1bfd tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:44:17.534811 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-0269e985-9d5c-4f6a-8660-4887e00b1bfd tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] [instance: 3d2e562b-a203-495d-b337-756545861f78] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:44:17.542015 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-0269e985-9d5c-4f6a-8660-4887e00b1bfd tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:44:17.542676 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-0269e985-9d5c-4f6a-8660-4887e00b1bfd tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:44:17.543543 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-0269e985-9d5c-4f6a-8660-4887e00b1bfd tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:44:17.544116 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-0269e985-9d5c-4f6a-8660-4887e00b1bfd tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:44:17.683385 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-0269e985-9d5c-4f6a-8660-4887e00b1bfd tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0abe23cb5f314bc883ef7958b0ed9b5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fc48df471f247809d82ddf926bfdc6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:44:17.690670 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-0269e985-9d5c-4f6a-8660-4887e00b1bfd tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] 10.222.0.64 "GET /compute/v2.1/servers/3d2e562b-a203-495d-b337-756545861f78" status: 200 len: 1318 microversion: 2.1 time: 0.160225 Oct 27 15:44:17.691240 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 148/334] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:44:17 2021] GET /compute/v2.1/servers/3d2e562b-a203-495d-b337-756545861f78 => generated 1318 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 15:44:18.530007 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-ef772e6f-ff48-4bba-b9a0-fe32baec0096 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:44:18.530666 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-ef772e6f-ff48-4bba-b9a0-fe32baec0096 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: bced4f24-572a-4316-97e8-3ceedc61a621] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:44:18.537491 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-ef772e6f-ff48-4bba-b9a0-fe32baec0096 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:44:18.537931 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-ef772e6f-ff48-4bba-b9a0-fe32baec0096 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:44:18.538693 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-ef772e6f-ff48-4bba-b9a0-fe32baec0096 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:44:18.539123 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-ef772e6f-ff48-4bba-b9a0-fe32baec0096 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:44:18.670041 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-ef772e6f-ff48-4bba-b9a0-fe32baec0096 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96b599f8890b4281a7e311cf37a039e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d7fcab5d3f465793d650f16c6ea8de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:44:18.677485 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-ef772e6f-ff48-4bba-b9a0-fe32baec0096 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/bced4f24-572a-4316-97e8-3ceedc61a621" status: 200 len: 1520 microversion: 2.1 time: 0.151134 Oct 27 15:44:18.678041 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 149/335] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:44:18 2021] GET /compute/v2.1/servers/bced4f24-572a-4316-97e8-3ceedc61a621 => generated 1520 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 15:44:18.706974 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-35be2c75-71cc-49b5-bd02-d9396bc5d405 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:44:18.708100 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-35be2c75-71cc-49b5-bd02-d9396bc5d405 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] [instance: 3d2e562b-a203-495d-b337-756545861f78] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:44:18.713795 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-35be2c75-71cc-49b5-bd02-d9396bc5d405 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:44:18.714225 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-35be2c75-71cc-49b5-bd02-d9396bc5d405 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:44:18.714973 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-35be2c75-71cc-49b5-bd02-d9396bc5d405 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:44:18.715397 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-35be2c75-71cc-49b5-bd02-d9396bc5d405 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:44:18.837281 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-35be2c75-71cc-49b5-bd02-d9396bc5d405 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0abe23cb5f314bc883ef7958b0ed9b5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fc48df471f247809d82ddf926bfdc6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:44:18.844387 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-35be2c75-71cc-49b5-bd02-d9396bc5d405 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] 10.222.0.64 "GET /compute/v2.1/servers/3d2e562b-a203-495d-b337-756545861f78" status: 200 len: 1318 microversion: 2.1 time: 0.140884 Oct 27 15:44:18.844944 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 150/336] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:44:18 2021] GET /compute/v2.1/servers/3d2e562b-a203-495d-b337-756545861f78 => generated 1318 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 15:44:19.437614 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [req-77ffc1ad-f07e-4ed6-827b-6160f460d31d req-7dd5145f-1419-4396-a0f6-2e90a570acb5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3d2e562b-a203-495d-b337-756545861f78", "name": "network-vif-plugged", "status": "completed", "tag": "a76fa086-d710-4480-89a0-e6f5c183bfcf"}]} {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 15:44:19.439203 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 27 15:44:19.439203 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: warnings.warn(msg) Oct 27 15:44:19.447465 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [req-77ffc1ad-f07e-4ed6-827b-6160f460d31d req-7dd5145f-1419-4396-a0f6-2e90a570acb5 service nova] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:44:19.447949 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [req-77ffc1ad-f07e-4ed6-827b-6160f460d31d req-7dd5145f-1419-4396-a0f6-2e90a570acb5 service nova] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:44:19.459712 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.compute.server_external_events [req-77ffc1ad-f07e-4ed6-827b-6160f460d31d req-7dd5145f-1419-4396-a0f6-2e90a570acb5 service nova] Creating event network-vif-plugged:a76fa086-d710-4480-89a0-e6f5c183bfcf for instance 3d2e562b-a203-495d-b337-756545861f78 on hv-cinder-80070 Oct 27 15:44:19.465432 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [req-77ffc1ad-f07e-4ed6-827b-6160f460d31d req-7dd5145f-1419-4396-a0f6-2e90a570acb5 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031147 Oct 27 15:44:19.466052 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 151/337] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Oct 27 15:44:19 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 15:44:19.695695 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-0a3333c8-a56d-4c05-8859-5d7906432ef9 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:44:19.696266 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-0a3333c8-a56d-4c05-8859-5d7906432ef9 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: bced4f24-572a-4316-97e8-3ceedc61a621] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:44:19.705596 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-0a3333c8-a56d-4c05-8859-5d7906432ef9 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:44:19.710408 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-0a3333c8-a56d-4c05-8859-5d7906432ef9 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:44:19.711327 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-0a3333c8-a56d-4c05-8859-5d7906432ef9 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:44:19.711918 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-0a3333c8-a56d-4c05-8859-5d7906432ef9 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:44:19.833707 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-0a3333c8-a56d-4c05-8859-5d7906432ef9 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96b599f8890b4281a7e311cf37a039e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d7fcab5d3f465793d650f16c6ea8de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:44:19.840887 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-0a3333c8-a56d-4c05-8859-5d7906432ef9 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/bced4f24-572a-4316-97e8-3ceedc61a621" status: 200 len: 1520 microversion: 2.1 time: 0.150448 Oct 27 15:44:19.841448 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 152/338] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:44:19 2021] GET /compute/v2.1/servers/bced4f24-572a-4316-97e8-3ceedc61a621 => generated 1520 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 15:44:19.861169 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-995e28ea-f66e-4089-8ba4-d8f61447a756 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:44:19.861801 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-995e28ea-f66e-4089-8ba4-d8f61447a756 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] [instance: 3d2e562b-a203-495d-b337-756545861f78] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:44:19.867794 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-995e28ea-f66e-4089-8ba4-d8f61447a756 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:44:19.868273 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-995e28ea-f66e-4089-8ba4-d8f61447a756 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:44:19.869035 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-995e28ea-f66e-4089-8ba4-d8f61447a756 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:44:19.869466 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-995e28ea-f66e-4089-8ba4-d8f61447a756 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:44:19.995241 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-995e28ea-f66e-4089-8ba4-d8f61447a756 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0abe23cb5f314bc883ef7958b0ed9b5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fc48df471f247809d82ddf926bfdc6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:44:20.002708 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-995e28ea-f66e-4089-8ba4-d8f61447a756 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] 10.222.0.64 "GET /compute/v2.1/servers/3d2e562b-a203-495d-b337-756545861f78" status: 200 len: 1318 microversion: 2.1 time: 0.144828 Oct 27 15:44:20.003254 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 153/339] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:44:19 2021] GET /compute/v2.1/servers/3d2e562b-a203-495d-b337-756545861f78 => generated 1318 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 15:44:20.351563 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-bf3c78aa-1abe-4542-9780-02903715c296 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "POST /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672/action" status: 200 len: 28453 microversion: 2.20 time: 2.973900 Oct 27 15:44:20.352750 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 187/340] 10.222.0.64 () {62 vars in 1318 bytes} [Wed Oct 27 15:44:17 2021] POST /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672/action => generated 28453 bytes in 2976 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 27 15:44:20.858309 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-5f0c5219-58dc-4265-904a-f6a2787fe42c tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:44:20.858932 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-5f0c5219-58dc-4265-904a-f6a2787fe42c tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: bced4f24-572a-4316-97e8-3ceedc61a621] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:44:20.865191 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-5f0c5219-58dc-4265-904a-f6a2787fe42c tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:44:20.865637 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-5f0c5219-58dc-4265-904a-f6a2787fe42c tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:44:20.866391 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-5f0c5219-58dc-4265-904a-f6a2787fe42c tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:44:20.866824 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-5f0c5219-58dc-4265-904a-f6a2787fe42c tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:44:20.997357 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-5f0c5219-58dc-4265-904a-f6a2787fe42c tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96b599f8890b4281a7e311cf37a039e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d7fcab5d3f465793d650f16c6ea8de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:44:21.005191 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-5f0c5219-58dc-4265-904a-f6a2787fe42c tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/bced4f24-572a-4316-97e8-3ceedc61a621" status: 200 len: 1520 microversion: 2.1 time: 0.150723 Oct 27 15:44:21.005754 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 154/341] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:44:20 2021] GET /compute/v2.1/servers/bced4f24-572a-4316-97e8-3ceedc61a621 => generated 1520 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 15:44:21.020296 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-ef28daf5-ff91-48e9-a190-7625b4882f2d tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:44:21.021099 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-ef28daf5-ff91-48e9-a190-7625b4882f2d tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] [instance: 3d2e562b-a203-495d-b337-756545861f78] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:44:21.028497 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-ef28daf5-ff91-48e9-a190-7625b4882f2d tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:44:21.029006 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-ef28daf5-ff91-48e9-a190-7625b4882f2d tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:44:21.029782 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-ef28daf5-ff91-48e9-a190-7625b4882f2d tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:44:21.030216 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-ef28daf5-ff91-48e9-a190-7625b4882f2d tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:44:21.154591 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-ef28daf5-ff91-48e9-a190-7625b4882f2d tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0abe23cb5f314bc883ef7958b0ed9b5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fc48df471f247809d82ddf926bfdc6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:44:21.163092 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-ef28daf5-ff91-48e9-a190-7625b4882f2d tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] 10.222.0.64 "GET /compute/v2.1/servers/3d2e562b-a203-495d-b337-756545861f78" status: 200 len: 1318 microversion: 2.1 time: 0.146860 Oct 27 15:44:21.163658 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 188/342] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:44:21 2021] GET /compute/v2.1/servers/3d2e562b-a203-495d-b337-756545861f78 => generated 1318 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 15:44:21.362683 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-7f10003a-d4fb-4ca2-a218-6b8f1a638094 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 15:44:21.364262 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-7f10003a-d4fb-4ca2-a218-6b8f1a638094 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:44:21.370094 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-7f10003a-d4fb-4ca2-a218-6b8f1a638094 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:44:21.370531 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-7f10003a-d4fb-4ca2-a218-6b8f1a638094 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:44:21.371295 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-7f10003a-d4fb-4ca2-a218-6b8f1a638094 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:44:21.371727 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-7f10003a-d4fb-4ca2-a218-6b8f1a638094 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:44:21.460425 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-7f10003a-d4fb-4ca2-a218-6b8f1a638094 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "POST /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672/action" status: 200 len: 28453 microversion: 2.20 time: 0.101204 Oct 27 15:44:21.464314 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 155/343] 10.222.0.64 () {62 vars in 1318 bytes} [Wed Oct 27 15:44:21 2021] POST /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672/action => generated 28453 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 27 15:44:22.025055 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-2efbfaa6-a687-45d7-97ae-5a46716e64e1 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:44:22.025055 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-2efbfaa6-a687-45d7-97ae-5a46716e64e1 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: bced4f24-572a-4316-97e8-3ceedc61a621] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:44:22.031724 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-2efbfaa6-a687-45d7-97ae-5a46716e64e1 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:44:22.032215 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-2efbfaa6-a687-45d7-97ae-5a46716e64e1 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:44:22.032986 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-2efbfaa6-a687-45d7-97ae-5a46716e64e1 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:44:22.033422 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-2efbfaa6-a687-45d7-97ae-5a46716e64e1 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:44:22.168767 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-2efbfaa6-a687-45d7-97ae-5a46716e64e1 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96b599f8890b4281a7e311cf37a039e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d7fcab5d3f465793d650f16c6ea8de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:44:22.176766 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-2efbfaa6-a687-45d7-97ae-5a46716e64e1 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/bced4f24-572a-4316-97e8-3ceedc61a621" status: 200 len: 1500 microversion: 2.1 time: 0.155795 Oct 27 15:44:22.177567 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 189/344] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:44:22 2021] GET /compute/v2.1/servers/bced4f24-572a-4316-97e8-3ceedc61a621 => generated 1500 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 15:44:22.180980 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-13a181d6-3f48-4b0b-b970-5ee3d37ffda1 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:44:22.181666 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-13a181d6-3f48-4b0b-b970-5ee3d37ffda1 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] [instance: 3d2e562b-a203-495d-b337-756545861f78] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:44:22.188466 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-13a181d6-3f48-4b0b-b970-5ee3d37ffda1 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:44:22.188907 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-13a181d6-3f48-4b0b-b970-5ee3d37ffda1 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:44:22.189666 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-13a181d6-3f48-4b0b-b970-5ee3d37ffda1 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:44:22.190097 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-13a181d6-3f48-4b0b-b970-5ee3d37ffda1 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:44:22.192336 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-90f96811-c923-4343-b913-ebfccca8d016 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:44:22.192936 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-90f96811-c923-4343-b913-ebfccca8d016 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: 62c89161-c119-48b2-839d-712db798ff96] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:44:22.198532 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-90f96811-c923-4343-b913-ebfccca8d016 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:44:22.198972 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-90f96811-c923-4343-b913-ebfccca8d016 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:44:22.199743 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-90f96811-c923-4343-b913-ebfccca8d016 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:44:22.200201 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-90f96811-c923-4343-b913-ebfccca8d016 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:44:22.316102 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-13a181d6-3f48-4b0b-b970-5ee3d37ffda1 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0abe23cb5f314bc883ef7958b0ed9b5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fc48df471f247809d82ddf926bfdc6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:44:22.322640 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-90f96811-c923-4343-b913-ebfccca8d016 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96b599f8890b4281a7e311cf37a039e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d7fcab5d3f465793d650f16c6ea8de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:44:22.324314 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-13a181d6-3f48-4b0b-b970-5ee3d37ffda1 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] 10.222.0.64 "GET /compute/v2.1/servers/3d2e562b-a203-495d-b337-756545861f78" status: 200 len: 1318 microversion: 2.1 time: 0.147881 Oct 27 15:44:22.324961 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 156/345] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:44:22 2021] GET /compute/v2.1/servers/3d2e562b-a203-495d-b337-756545861f78 => generated 1318 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 15:44:22.331197 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-90f96811-c923-4343-b913-ebfccca8d016 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96" status: 200 len: 1515 microversion: 2.1 time: 0.142507 Oct 27 15:44:22.331761 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 190/346] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:44:22 2021] GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96 => generated 1515 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 15:44:22.472870 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-88902efb-2d0d-48a8-ab89-d5fa4b1629cd tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 15:44:22.474383 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-88902efb-2d0d-48a8-ab89-d5fa4b1629cd tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:44:22.481467 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-88902efb-2d0d-48a8-ab89-d5fa4b1629cd tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:44:22.481908 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-88902efb-2d0d-48a8-ab89-d5fa4b1629cd tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:44:22.482870 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-88902efb-2d0d-48a8-ab89-d5fa4b1629cd tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:44:22.483292 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-88902efb-2d0d-48a8-ab89-d5fa4b1629cd tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:44:23.341468 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-d37ff2b6-8957-4665-97a1-637efa915292 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:44:23.341991 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-d37ff2b6-8957-4665-97a1-637efa915292 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] [instance: 3d2e562b-a203-495d-b337-756545861f78] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:44:23.349002 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-d37ff2b6-8957-4665-97a1-637efa915292 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:44:23.349699 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-d37ff2b6-8957-4665-97a1-637efa915292 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:44:23.350460 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-d37ff2b6-8957-4665-97a1-637efa915292 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:44:23.350890 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-d37ff2b6-8957-4665-97a1-637efa915292 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:44:23.473310 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-d37ff2b6-8957-4665-97a1-637efa915292 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0abe23cb5f314bc883ef7958b0ed9b5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fc48df471f247809d82ddf926bfdc6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:44:23.482452 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-d37ff2b6-8957-4665-97a1-637efa915292 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] 10.222.0.64 "GET /compute/v2.1/servers/3d2e562b-a203-495d-b337-756545861f78" status: 200 len: 1318 microversion: 2.1 time: 0.144635 Oct 27 15:44:23.483111 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 191/347] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:44:23 2021] GET /compute/v2.1/servers/3d2e562b-a203-495d-b337-756545861f78 => generated 1318 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 15:44:24.499496 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-5c250894-49a9-4b5e-be9f-d1fa3678e036 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:44:24.500230 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-5c250894-49a9-4b5e-be9f-d1fa3678e036 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] [instance: 3d2e562b-a203-495d-b337-756545861f78] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:44:24.507615 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-5c250894-49a9-4b5e-be9f-d1fa3678e036 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:44:24.508210 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-5c250894-49a9-4b5e-be9f-d1fa3678e036 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:44:24.508988 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-5c250894-49a9-4b5e-be9f-d1fa3678e036 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:44:24.509419 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-5c250894-49a9-4b5e-be9f-d1fa3678e036 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:44:24.629372 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-5c250894-49a9-4b5e-be9f-d1fa3678e036 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0abe23cb5f314bc883ef7958b0ed9b5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fc48df471f247809d82ddf926bfdc6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:44:24.637039 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-5c250894-49a9-4b5e-be9f-d1fa3678e036 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] 10.222.0.64 "GET /compute/v2.1/servers/3d2e562b-a203-495d-b337-756545861f78" status: 200 len: 1318 microversion: 2.1 time: 0.141229 Oct 27 15:44:24.637603 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 192/348] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:44:24 2021] GET /compute/v2.1/servers/3d2e562b-a203-495d-b337-756545861f78 => generated 1318 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 15:44:25.654302 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-73ed3f0c-9b2c-4c40-bf51-bf31046fb954 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:44:25.654924 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-73ed3f0c-9b2c-4c40-bf51-bf31046fb954 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] [instance: 3d2e562b-a203-495d-b337-756545861f78] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:44:25.661325 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-73ed3f0c-9b2c-4c40-bf51-bf31046fb954 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:44:25.661774 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-73ed3f0c-9b2c-4c40-bf51-bf31046fb954 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:44:25.662546 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-73ed3f0c-9b2c-4c40-bf51-bf31046fb954 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:44:25.662983 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-73ed3f0c-9b2c-4c40-bf51-bf31046fb954 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:44:25.786177 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-73ed3f0c-9b2c-4c40-bf51-bf31046fb954 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0abe23cb5f314bc883ef7958b0ed9b5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fc48df471f247809d82ddf926bfdc6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:44:25.793349 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-73ed3f0c-9b2c-4c40-bf51-bf31046fb954 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] 10.222.0.64 "GET /compute/v2.1/servers/3d2e562b-a203-495d-b337-756545861f78" status: 200 len: 1318 microversion: 2.1 time: 0.142654 Oct 27 15:44:25.793884 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 193/349] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:44:25 2021] GET /compute/v2.1/servers/3d2e562b-a203-495d-b337-756545861f78 => generated 1318 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 15:44:26.079756 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-88902efb-2d0d-48a8-ab89-d5fa4b1629cd tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "POST /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672/action" status: 200 len: 28707 microversion: 2.20 time: 3.611176 Oct 27 15:44:26.080469 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 157/350] 10.222.0.64 () {62 vars in 1318 bytes} [Wed Oct 27 15:44:22 2021] POST /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672/action => generated 28707 bytes in 3613 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 27 15:44:26.810217 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-71042dcc-96ee-4dad-a61e-95a91b96aca4 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:44:26.810825 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-71042dcc-96ee-4dad-a61e-95a91b96aca4 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] [instance: 3d2e562b-a203-495d-b337-756545861f78] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:44:26.817246 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-71042dcc-96ee-4dad-a61e-95a91b96aca4 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:44:26.817694 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-71042dcc-96ee-4dad-a61e-95a91b96aca4 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:44:26.818465 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-71042dcc-96ee-4dad-a61e-95a91b96aca4 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:44:26.818904 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-71042dcc-96ee-4dad-a61e-95a91b96aca4 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:44:26.937119 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-71042dcc-96ee-4dad-a61e-95a91b96aca4 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0abe23cb5f314bc883ef7958b0ed9b5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fc48df471f247809d82ddf926bfdc6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:44:26.944425 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-71042dcc-96ee-4dad-a61e-95a91b96aca4 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] 10.222.0.64 "GET /compute/v2.1/servers/3d2e562b-a203-495d-b337-756545861f78" status: 200 len: 1508 microversion: 2.1 time: 0.137865 Oct 27 15:44:26.944995 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 194/351] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:44:26 2021] GET /compute/v2.1/servers/3d2e562b-a203-495d-b337-756545861f78 => generated 1508 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 15:44:27.091271 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-740ab960-ab1b-4ca8-81bd-91b0adaa024d tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 15:44:27.092277 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-740ab960-ab1b-4ca8-81bd-91b0adaa024d tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:44:27.100224 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-740ab960-ab1b-4ca8-81bd-91b0adaa024d tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:44:27.100942 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-740ab960-ab1b-4ca8-81bd-91b0adaa024d tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:44:27.101821 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-740ab960-ab1b-4ca8-81bd-91b0adaa024d tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:44:27.102322 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-740ab960-ab1b-4ca8-81bd-91b0adaa024d tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:44:27.235110 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-740ab960-ab1b-4ca8-81bd-91b0adaa024d tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "POST /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672/action" status: 200 len: 28707 microversion: 2.20 time: 0.147660 Oct 27 15:44:27.235756 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 158/352] 10.222.0.64 () {62 vars in 1318 bytes} [Wed Oct 27 15:44:27 2021] POST /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672/action => generated 28707 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 27 15:44:27.873671 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-7d536896-a3b2-4ba1-993d-40f27f655ecf tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 15:44:27.874656 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-7d536896-a3b2-4ba1-993d-40f27f655ecf tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: 62c89161-c119-48b2-839d-712db798ff96] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:44:27.880898 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-7d536896-a3b2-4ba1-993d-40f27f655ecf tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:44:27.881334 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-7d536896-a3b2-4ba1-993d-40f27f655ecf tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:44:27.882098 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-7d536896-a3b2-4ba1-993d-40f27f655ecf tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:44:27.882528 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-7d536896-a3b2-4ba1-993d-40f27f655ecf tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:44:27.905181 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.objects.instance [None req-7d536896-a3b2-4ba1-993d-40f27f655ecf tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lazy-loading 'flavor' on Instance uuid 62c89161-c119-48b2-839d-712db798ff96 {{(pid=122224) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 27 15:44:28.013003 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-7d536896-a3b2-4ba1-993d-40f27f655ecf tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "POST /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/action" status: 200 len: 32 microversion: 2.1 time: 0.143379 Oct 27 15:44:28.013828 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 195/353] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Oct 27 15:44:27 2021] POST /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/action => generated 32 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 27 15:44:28.024967 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-0af59e67-6af6-4a91-8000-c58003ddf8f6 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:44:28.025779 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-0af59e67-6af6-4a91-8000-c58003ddf8f6 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: 62c89161-c119-48b2-839d-712db798ff96] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:44:28.032165 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-0af59e67-6af6-4a91-8000-c58003ddf8f6 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:44:28.032766 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-0af59e67-6af6-4a91-8000-c58003ddf8f6 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:44:28.033778 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-0af59e67-6af6-4a91-8000-c58003ddf8f6 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:44:28.034335 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-0af59e67-6af6-4a91-8000-c58003ddf8f6 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:44:28.196382 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-0af59e67-6af6-4a91-8000-c58003ddf8f6 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96b599f8890b4281a7e311cf37a039e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d7fcab5d3f465793d650f16c6ea8de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:44:28.203830 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-0af59e67-6af6-4a91-8000-c58003ddf8f6 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96" status: 200 len: 1521 microversion: 2.1 time: 0.184461 Oct 27 15:44:28.204426 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 159/354] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:44:28 2021] GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96 => generated 1521 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 15:44:28.249887 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-81aa0a39-acb2-4d7c-96ee-3ebf3df025ec tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 15:44:28.251343 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-81aa0a39-acb2-4d7c-96ee-3ebf3df025ec tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:44:28.259051 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-81aa0a39-acb2-4d7c-96ee-3ebf3df025ec tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:44:28.261396 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-81aa0a39-acb2-4d7c-96ee-3ebf3df025ec tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:44:28.268561 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-81aa0a39-acb2-4d7c-96ee-3ebf3df025ec tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:44:28.269149 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-81aa0a39-acb2-4d7c-96ee-3ebf3df025ec tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:44:28.279495 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-f7361684-7230-49ab-94f5-36b68a79e2c0 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "62d0c5e4-635b-4f32-baba-86329e3de735"}} {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 15:44:28.282525 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-f7361684-7230-49ab-94f5-36b68a79e2c0 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] [instance: 3d2e562b-a203-495d-b337-756545861f78] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:44:28.288793 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-f7361684-7230-49ab-94f5-36b68a79e2c0 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:44:28.289702 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-f7361684-7230-49ab-94f5-36b68a79e2c0 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:44:28.290445 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-f7361684-7230-49ab-94f5-36b68a79e2c0 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:44:28.291113 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-f7361684-7230-49ab-94f5-36b68a79e2c0 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:44:28.388531 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-81aa0a39-acb2-4d7c-96ee-3ebf3df025ec tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "POST /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672/action" status: 200 len: 28707 microversion: 2.20 time: 0.143487 Oct 27 15:44:28.389630 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 196/355] 10.222.0.64 () {62 vars in 1318 bytes} [Wed Oct 27 15:44:28 2021] POST /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672/action => generated 28707 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 27 15:44:28.932550 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-f7361684-7230-49ab-94f5-36b68a79e2c0 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] 10.222.0.64 "POST /compute/v2.1/servers/3d2e562b-a203-495d-b337-756545861f78/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.656486 Oct 27 15:44:28.933187 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 160/356] 10.222.0.64 () {60 vars in 1322 bytes} [Wed Oct 27 15:44:28 2021] POST /compute/v2.1/servers/3d2e562b-a203-495d-b337-756545861f78/os-volume_attachments => generated 194 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 15:44:29.222813 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-f55fd33f-df05-4df1-913b-118ba5ee692e tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:44:29.223507 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-f55fd33f-df05-4df1-913b-118ba5ee692e tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: 62c89161-c119-48b2-839d-712db798ff96] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:44:29.231496 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-f55fd33f-df05-4df1-913b-118ba5ee692e tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:44:29.231981 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-f55fd33f-df05-4df1-913b-118ba5ee692e tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:44:29.232748 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-f55fd33f-df05-4df1-913b-118ba5ee692e tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:44:29.233186 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-f55fd33f-df05-4df1-913b-118ba5ee692e tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:44:29.356334 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-f55fd33f-df05-4df1-913b-118ba5ee692e tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96b599f8890b4281a7e311cf37a039e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d7fcab5d3f465793d650f16c6ea8de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:44:29.364193 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-f55fd33f-df05-4df1-913b-118ba5ee692e tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96" status: 200 len: 1521 microversion: 2.1 time: 0.145378 Oct 27 15:44:29.364711 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 197/357] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:44:29 2021] GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96 => generated 1521 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 15:44:29.401296 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-19ab3264-0d31-4123-b52e-326a9a15c619 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 15:44:29.402458 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-19ab3264-0d31-4123-b52e-326a9a15c619 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:44:29.410626 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-19ab3264-0d31-4123-b52e-326a9a15c619 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:44:29.411073 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-19ab3264-0d31-4123-b52e-326a9a15c619 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:44:29.412526 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-19ab3264-0d31-4123-b52e-326a9a15c619 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:44:29.412969 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-19ab3264-0d31-4123-b52e-326a9a15c619 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:44:29.507977 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-19ab3264-0d31-4123-b52e-326a9a15c619 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "POST /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672/action" status: 200 len: 28707 microversion: 2.20 time: 0.111734 Oct 27 15:44:29.508535 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 161/358] 10.222.0.64 () {62 vars in 1318 bytes} [Wed Oct 27 15:44:29 2021] POST /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672/action => generated 28707 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 27 15:44:30.382566 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-5e1afa07-db0b-49a0-933a-44dc872fd574 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:44:30.383233 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-5e1afa07-db0b-49a0-933a-44dc872fd574 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: 62c89161-c119-48b2-839d-712db798ff96] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:44:30.389556 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-5e1afa07-db0b-49a0-933a-44dc872fd574 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:44:30.390000 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-5e1afa07-db0b-49a0-933a-44dc872fd574 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:44:30.390776 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-5e1afa07-db0b-49a0-933a-44dc872fd574 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:44:30.391208 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-5e1afa07-db0b-49a0-933a-44dc872fd574 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:44:30.520325 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-35bf4edd-6b84-407e-85fe-9f1f14d6553f tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 15:44:30.522101 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-35bf4edd-6b84-407e-85fe-9f1f14d6553f tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:44:30.529092 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-35bf4edd-6b84-407e-85fe-9f1f14d6553f tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:44:30.529556 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-35bf4edd-6b84-407e-85fe-9f1f14d6553f tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:44:30.530318 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-35bf4edd-6b84-407e-85fe-9f1f14d6553f tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:44:30.530740 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-35bf4edd-6b84-407e-85fe-9f1f14d6553f tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:44:30.583784 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-5e1afa07-db0b-49a0-933a-44dc872fd574 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96b599f8890b4281a7e311cf37a039e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d7fcab5d3f465793d650f16c6ea8de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:44:30.592040 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-5e1afa07-db0b-49a0-933a-44dc872fd574 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96" status: 200 len: 1521 microversion: 2.1 time: 0.214253 Oct 27 15:44:30.592627 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 198/359] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:44:30 2021] GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96 => generated 1521 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 15:44:30.654822 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-35bf4edd-6b84-407e-85fe-9f1f14d6553f tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "POST /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672/action" status: 200 len: 28707 microversion: 2.20 time: 0.138163 Oct 27 15:44:30.656621 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 162/360] 10.222.0.64 () {62 vars in 1318 bytes} [Wed Oct 27 15:44:30 2021] POST /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672/action => generated 28707 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 27 15:44:31.611834 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-b101c3b3-dc9f-41ed-8085-01381db22337 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:44:31.612523 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-b101c3b3-dc9f-41ed-8085-01381db22337 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: 62c89161-c119-48b2-839d-712db798ff96] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:44:31.619447 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-b101c3b3-dc9f-41ed-8085-01381db22337 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:44:31.620254 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-b101c3b3-dc9f-41ed-8085-01381db22337 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:44:31.621198 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-b101c3b3-dc9f-41ed-8085-01381db22337 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:44:31.621786 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-b101c3b3-dc9f-41ed-8085-01381db22337 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:44:31.669505 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-35b866d2-5809-420a-98ee-f8239223e87c tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 15:44:31.670438 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-35b866d2-5809-420a-98ee-f8239223e87c tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:44:31.677870 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-35b866d2-5809-420a-98ee-f8239223e87c tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:44:31.678695 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-35b866d2-5809-420a-98ee-f8239223e87c tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:44:31.679652 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-35b866d2-5809-420a-98ee-f8239223e87c tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:44:31.680254 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-35b866d2-5809-420a-98ee-f8239223e87c tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:44:31.764334 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-b101c3b3-dc9f-41ed-8085-01381db22337 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96b599f8890b4281a7e311cf37a039e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d7fcab5d3f465793d650f16c6ea8de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:44:31.779282 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-b101c3b3-dc9f-41ed-8085-01381db22337 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96" status: 200 len: 1521 microversion: 2.1 time: 0.171027 Oct 27 15:44:31.783966 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 199/361] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:44:31 2021] GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96 => generated 1521 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 15:44:32.854387 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-80818705-7a3f-43e0-afd4-99e400e4e3f7 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:44:32.855073 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-80818705-7a3f-43e0-afd4-99e400e4e3f7 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: 62c89161-c119-48b2-839d-712db798ff96] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:44:32.861546 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-80818705-7a3f-43e0-afd4-99e400e4e3f7 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:44:32.861990 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-80818705-7a3f-43e0-afd4-99e400e4e3f7 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:44:32.862758 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-80818705-7a3f-43e0-afd4-99e400e4e3f7 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:44:32.863187 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-80818705-7a3f-43e0-afd4-99e400e4e3f7 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:44:32.987620 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-80818705-7a3f-43e0-afd4-99e400e4e3f7 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96b599f8890b4281a7e311cf37a039e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d7fcab5d3f465793d650f16c6ea8de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:44:32.995801 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-80818705-7a3f-43e0-afd4-99e400e4e3f7 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96" status: 200 len: 1521 microversion: 2.1 time: 0.145076 Oct 27 15:44:32.996414 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 200/362] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:44:32 2021] GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96 => generated 1521 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 15:44:34.012922 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-2b58645a-afe3-4757-8381-3eda0695f8d7 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:44:34.013647 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-2b58645a-afe3-4757-8381-3eda0695f8d7 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: 62c89161-c119-48b2-839d-712db798ff96] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:44:34.019723 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-2b58645a-afe3-4757-8381-3eda0695f8d7 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:44:34.020195 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-2b58645a-afe3-4757-8381-3eda0695f8d7 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:44:34.022087 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-2b58645a-afe3-4757-8381-3eda0695f8d7 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:44:34.022087 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-2b58645a-afe3-4757-8381-3eda0695f8d7 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:44:34.149253 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-2b58645a-afe3-4757-8381-3eda0695f8d7 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96b599f8890b4281a7e311cf37a039e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d7fcab5d3f465793d650f16c6ea8de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:44:34.156563 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-2b58645a-afe3-4757-8381-3eda0695f8d7 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96" status: 200 len: 1521 microversion: 2.1 time: 0.147381 Oct 27 15:44:34.157574 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 201/363] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:44:34 2021] GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96 => generated 1521 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 15:44:34.161832 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-35b866d2-5809-420a-98ee-f8239223e87c tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "POST /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672/action" status: 200 len: 28707 microversion: 2.20 time: 2.496325 Oct 27 15:44:34.162693 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 163/364] 10.222.0.64 () {62 vars in 1318 bytes} [Wed Oct 27 15:44:31 2021] POST /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672/action => generated 28707 bytes in 2498 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 27 15:44:35.174299 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-8dd7e003-bf09-454d-827e-5f85e00b3f47 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:44:35.174916 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-8dd7e003-bf09-454d-827e-5f85e00b3f47 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: 62c89161-c119-48b2-839d-712db798ff96] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:44:35.177447 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-f4a13b8c-9472-4e18-9815-ee848b8c6134 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 15:44:35.179871 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-f4a13b8c-9472-4e18-9815-ee848b8c6134 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:44:35.187642 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-8dd7e003-bf09-454d-827e-5f85e00b3f47 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:44:35.188127 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-8dd7e003-bf09-454d-827e-5f85e00b3f47 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:44:35.188924 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-8dd7e003-bf09-454d-827e-5f85e00b3f47 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:44:35.189353 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-8dd7e003-bf09-454d-827e-5f85e00b3f47 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:44:35.189905 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-f4a13b8c-9472-4e18-9815-ee848b8c6134 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:44:35.190374 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-f4a13b8c-9472-4e18-9815-ee848b8c6134 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:44:35.191146 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-f4a13b8c-9472-4e18-9815-ee848b8c6134 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:44:35.191581 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-f4a13b8c-9472-4e18-9815-ee848b8c6134 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:44:35.304057 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-f4a13b8c-9472-4e18-9815-ee848b8c6134 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "POST /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672/action" status: 200 len: 28707 microversion: 2.20 time: 0.129535 Oct 27 15:44:35.304491 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 164/365] 10.222.0.64 () {62 vars in 1318 bytes} [Wed Oct 27 15:44:35 2021] POST /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672/action => generated 28707 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 27 15:44:35.346308 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-8dd7e003-bf09-454d-827e-5f85e00b3f47 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96b599f8890b4281a7e311cf37a039e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d7fcab5d3f465793d650f16c6ea8de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:44:35.355043 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-8dd7e003-bf09-454d-827e-5f85e00b3f47 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96" status: 200 len: 1521 microversion: 2.1 time: 0.184305 Oct 27 15:44:35.356359 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 202/366] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:44:35 2021] GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96 => generated 1521 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 15:44:36.316984 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-917999bf-dad4-412d-b2bd-ba4fd202dc15 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 15:44:36.318085 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-917999bf-dad4-412d-b2bd-ba4fd202dc15 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:44:36.338404 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-917999bf-dad4-412d-b2bd-ba4fd202dc15 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:44:36.340920 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-917999bf-dad4-412d-b2bd-ba4fd202dc15 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:44:36.341782 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-917999bf-dad4-412d-b2bd-ba4fd202dc15 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:44:36.342243 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-917999bf-dad4-412d-b2bd-ba4fd202dc15 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:44:36.391257 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-35f5763d-3937-4efb-84cf-9f4c06802267 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:44:36.391905 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-35f5763d-3937-4efb-84cf-9f4c06802267 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: 62c89161-c119-48b2-839d-712db798ff96] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:44:36.400373 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-35f5763d-3937-4efb-84cf-9f4c06802267 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:44:36.401190 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-35f5763d-3937-4efb-84cf-9f4c06802267 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:44:36.402134 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-35f5763d-3937-4efb-84cf-9f4c06802267 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:44:36.402818 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-35f5763d-3937-4efb-84cf-9f4c06802267 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:44:36.436193 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-917999bf-dad4-412d-b2bd-ba4fd202dc15 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "POST /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672/action" status: 200 len: 28707 microversion: 2.20 time: 0.123465 Oct 27 15:44:36.436830 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 165/367] 10.222.0.64 () {62 vars in 1318 bytes} [Wed Oct 27 15:44:36 2021] POST /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672/action => generated 28707 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 27 15:44:36.605262 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-dd68539f-724c-431f-949a-b50f2d864cb8 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "62d0c5e4-635b-4f32-baba-86329e3de735"}} {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 15:44:36.606846 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-dd68539f-724c-431f-949a-b50f2d864cb8 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] [instance: 3d2e562b-a203-495d-b337-756545861f78] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:44:36.612207 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-35f5763d-3937-4efb-84cf-9f4c06802267 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96b599f8890b4281a7e311cf37a039e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d7fcab5d3f465793d650f16c6ea8de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:44:36.619870 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-dd68539f-724c-431f-949a-b50f2d864cb8 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:44:36.623907 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-35f5763d-3937-4efb-84cf-9f4c06802267 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96" status: 200 len: 1521 microversion: 2.1 time: 0.249208 Oct 27 15:44:36.624668 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-dd68539f-724c-431f-949a-b50f2d864cb8 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:44:36.625772 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-dd68539f-724c-431f-949a-b50f2d864cb8 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:44:36.626058 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 203/368] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:44:36 2021] GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96 => generated 1521 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 15:44:36.627951 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-dd68539f-724c-431f-949a-b50f2d864cb8 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:44:36.761151 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.wsgi [None req-dd68539f-724c-431f-949a-b50f2d864cb8 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] HTTP exception thrown: Invalid volume: volume 62d0c5e4-635b-4f32-baba-86329e3de735 is already attached to instances: 3d2e562b-a203-495d-b337-756545861f78 Oct 27 15:44:36.762660 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-dd68539f-724c-431f-949a-b50f2d864cb8 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Returning 400 to user: Invalid volume: volume 62d0c5e4-635b-4f32-baba-86329e3de735 is already attached to instances: 3d2e562b-a203-495d-b337-756545861f78 {{(pid=122225) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 27 15:44:36.763724 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-dd68539f-724c-431f-949a-b50f2d864cb8 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] 10.222.0.64 "POST /compute/v2.1/servers/3d2e562b-a203-495d-b337-756545861f78/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.163712 Oct 27 15:44:36.764504 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 166/369] 10.222.0.64 () {60 vars in 1322 bytes} [Wed Oct 27 15:44:36 2021] POST /compute/v2.1/servers/3d2e562b-a203-495d-b337-756545861f78/os-volume_attachments => generated 174 bytes in 166 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 27 15:44:36.854645 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-a8674635-9fb8-4bc6-8a5f-4695ee566c9e tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:44:36.855167 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-a8674635-9fb8-4bc6-8a5f-4695ee566c9e tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] [instance: 3d2e562b-a203-495d-b337-756545861f78] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:44:36.860831 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-a8674635-9fb8-4bc6-8a5f-4695ee566c9e tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:44:36.861264 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-a8674635-9fb8-4bc6-8a5f-4695ee566c9e tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:44:36.862027 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-a8674635-9fb8-4bc6-8a5f-4695ee566c9e tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:44:36.862450 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-a8674635-9fb8-4bc6-8a5f-4695ee566c9e tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:44:37.009386 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.objects.instance [None req-a8674635-9fb8-4bc6-8a5f-4695ee566c9e tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lazy-loading 'services' on Instance uuid 3d2e562b-a203-495d-b337-756545861f78 {{(pid=122224) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 27 15:44:37.136848 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-a8674635-9fb8-4bc6-8a5f-4695ee566c9e tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] 10.222.0.64 "DELETE /compute/v2.1/servers/3d2e562b-a203-495d-b337-756545861f78/os-volume_attachments/62d0c5e4-635b-4f32-baba-86329e3de735" status: 202 len: 0 microversion: 2.1 time: 0.287368 Oct 27 15:44:37.137826 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 204/370] 10.222.0.64 () {58 vars in 1415 bytes} [Wed Oct 27 15:44:36 2021] DELETE /compute/v2.1/servers/3d2e562b-a203-495d-b337-756545861f78/os-volume_attachments/62d0c5e4-635b-4f32-baba-86329e3de735 => generated 0 bytes in 289 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 27 15:44:37.145997 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-819fdda4-b64e-4a55-8da6-f3de26569324 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:44:37.147674 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-819fdda4-b64e-4a55-8da6-f3de26569324 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] [instance: 3d2e562b-a203-495d-b337-756545861f78] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:44:37.156929 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-819fdda4-b64e-4a55-8da6-f3de26569324 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:44:37.157489 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-819fdda4-b64e-4a55-8da6-f3de26569324 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:44:37.158466 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-819fdda4-b64e-4a55-8da6-f3de26569324 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:44:37.158942 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-819fdda4-b64e-4a55-8da6-f3de26569324 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:44:37.192276 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-819fdda4-b64e-4a55-8da6-f3de26569324 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] 10.222.0.64 "GET /compute/v2.1/servers/3d2e562b-a203-495d-b337-756545861f78/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050065 Oct 27 15:44:37.192860 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 167/371] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Oct 27 15:44:37 2021] GET /compute/v2.1/servers/3d2e562b-a203-495d-b337-756545861f78/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 15:44:37.456896 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-65bad433-1641-456a-b25a-80fbaf8966e9 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 15:44:37.458424 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-65bad433-1641-456a-b25a-80fbaf8966e9 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:44:37.469055 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-65bad433-1641-456a-b25a-80fbaf8966e9 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:44:37.469907 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-65bad433-1641-456a-b25a-80fbaf8966e9 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:44:37.471158 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-65bad433-1641-456a-b25a-80fbaf8966e9 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:44:37.471817 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-65bad433-1641-456a-b25a-80fbaf8966e9 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:44:37.584524 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-65bad433-1641-456a-b25a-80fbaf8966e9 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "POST /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672/action" status: 200 len: 28707 microversion: 2.20 time: 0.137635 Oct 27 15:44:37.586736 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 205/372] 10.222.0.64 () {62 vars in 1318 bytes} [Wed Oct 27 15:44:37 2021] POST /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672/action => generated 28707 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 27 15:44:37.641380 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-553bbf58-ee66-458a-b124-d87c5ba46560 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:44:37.642648 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-553bbf58-ee66-458a-b124-d87c5ba46560 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: 62c89161-c119-48b2-839d-712db798ff96] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:44:37.649883 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-553bbf58-ee66-458a-b124-d87c5ba46560 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:44:37.650325 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-553bbf58-ee66-458a-b124-d87c5ba46560 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:44:37.651081 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-553bbf58-ee66-458a-b124-d87c5ba46560 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:44:37.651507 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-553bbf58-ee66-458a-b124-d87c5ba46560 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:44:37.789210 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-553bbf58-ee66-458a-b124-d87c5ba46560 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96b599f8890b4281a7e311cf37a039e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d7fcab5d3f465793d650f16c6ea8de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:44:37.797624 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-553bbf58-ee66-458a-b124-d87c5ba46560 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96" status: 200 len: 1521 microversion: 2.1 time: 0.159908 Oct 27 15:44:37.798192 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 168/373] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:44:37 2021] GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96 => generated 1521 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 15:44:38.205291 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-db038947-2990-4948-a200-44463b447740 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:44:38.206579 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-db038947-2990-4948-a200-44463b447740 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] [instance: 3d2e562b-a203-495d-b337-756545861f78] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:44:38.218530 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-db038947-2990-4948-a200-44463b447740 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:44:38.219388 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-db038947-2990-4948-a200-44463b447740 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:44:38.220376 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-db038947-2990-4948-a200-44463b447740 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:44:38.220804 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-db038947-2990-4948-a200-44463b447740 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:44:38.257786 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-db038947-2990-4948-a200-44463b447740 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] 10.222.0.64 "GET /compute/v2.1/servers/3d2e562b-a203-495d-b337-756545861f78/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057198 Oct 27 15:44:38.258420 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 206/374] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Oct 27 15:44:38 2021] GET /compute/v2.1/servers/3d2e562b-a203-495d-b337-756545861f78/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 15:44:38.598648 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-045de6cd-466a-4803-b2f2-6712622764bb tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 15:44:38.600945 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-045de6cd-466a-4803-b2f2-6712622764bb tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:44:38.607365 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-045de6cd-466a-4803-b2f2-6712622764bb tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:44:38.607954 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-045de6cd-466a-4803-b2f2-6712622764bb tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:44:38.608814 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-045de6cd-466a-4803-b2f2-6712622764bb tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:44:38.609320 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-045de6cd-466a-4803-b2f2-6712622764bb tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:44:38.697005 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-045de6cd-466a-4803-b2f2-6712622764bb tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "POST /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672/action" status: 200 len: 28707 microversion: 2.20 time: 0.101898 Oct 27 15:44:38.697700 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 169/375] 10.222.0.64 () {62 vars in 1318 bytes} [Wed Oct 27 15:44:38 2021] POST /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672/action => generated 28707 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 27 15:44:38.823578 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-a7818d61-3d7d-45d8-b671-f9625ad8f389 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:44:38.826261 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-a7818d61-3d7d-45d8-b671-f9625ad8f389 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: 62c89161-c119-48b2-839d-712db798ff96] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:44:38.833620 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-a7818d61-3d7d-45d8-b671-f9625ad8f389 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:44:38.834566 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-a7818d61-3d7d-45d8-b671-f9625ad8f389 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:44:38.835343 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-a7818d61-3d7d-45d8-b671-f9625ad8f389 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:44:38.836082 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-a7818d61-3d7d-45d8-b671-f9625ad8f389 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:44:39.036261 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-a7818d61-3d7d-45d8-b671-f9625ad8f389 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96b599f8890b4281a7e311cf37a039e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d7fcab5d3f465793d650f16c6ea8de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:44:39.048499 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-a7818d61-3d7d-45d8-b671-f9625ad8f389 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96" status: 200 len: 1521 microversion: 2.1 time: 0.234552 Oct 27 15:44:39.049617 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 207/376] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:44:38 2021] GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96 => generated 1521 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 15:44:39.270730 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-864e2a33-a500-40e2-8fd0-ee43ab424dd1 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:44:39.272755 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-864e2a33-a500-40e2-8fd0-ee43ab424dd1 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] [instance: 3d2e562b-a203-495d-b337-756545861f78] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:44:39.285137 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-864e2a33-a500-40e2-8fd0-ee43ab424dd1 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:44:39.286120 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-864e2a33-a500-40e2-8fd0-ee43ab424dd1 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:44:39.287582 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-864e2a33-a500-40e2-8fd0-ee43ab424dd1 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:44:39.288069 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-864e2a33-a500-40e2-8fd0-ee43ab424dd1 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:44:39.332013 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-864e2a33-a500-40e2-8fd0-ee43ab424dd1 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] 10.222.0.64 "GET /compute/v2.1/servers/3d2e562b-a203-495d-b337-756545861f78/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.065712 Oct 27 15:44:39.333212 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 170/377] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Oct 27 15:44:39 2021] GET /compute/v2.1/servers/3d2e562b-a203-495d-b337-756545861f78/os-volume_attachments => generated 25 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 27 15:44:39.482582 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-143c983f-7a10-40c3-b5ae-3ff693772d2c tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1907461800", "imageRef": "b585ffbc-6a36-48c9-81b3-e26f9bd0fcba", "flavorRef": "452", "networks": [{"uuid": "d9775d1d-2e09-490f-b5c0-23cc640635a9"}]}} {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 15:44:39.535998 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.network.neutron [None req-143c983f-7a10-40c3-b5ae-3ff693772d2c tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] validate_networks() for [('d9775d1d-2e09-490f-b5c0-23cc640635a9', None, None, None, None, None)] {{(pid=122224) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Oct 27 15:44:39.709431 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-d2293009-3495-437b-9bad-905a602f1e54 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 15:44:39.711417 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-d2293009-3495-437b-9bad-905a602f1e54 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:44:39.722325 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-d2293009-3495-437b-9bad-905a602f1e54 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:44:39.722767 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-d2293009-3495-437b-9bad-905a602f1e54 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:44:39.723584 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-d2293009-3495-437b-9bad-905a602f1e54 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:44:39.729782 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-d2293009-3495-437b-9bad-905a602f1e54 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:44:39.857406 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-d2293009-3495-437b-9bad-905a602f1e54 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "POST /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672/action" status: 200 len: 28707 microversion: 2.20 time: 0.152075 Oct 27 15:44:39.859683 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 171/378] 10.222.0.64 () {62 vars in 1318 bytes} [Wed Oct 27 15:44:39 2021] POST /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672/action => generated 28707 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 27 15:44:40.066698 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-167fe448-29b7-4feb-b38b-c3a8d3d7874b tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:44:40.067624 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-167fe448-29b7-4feb-b38b-c3a8d3d7874b tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: 62c89161-c119-48b2-839d-712db798ff96] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:44:40.076028 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-167fe448-29b7-4feb-b38b-c3a8d3d7874b tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:44:40.076760 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-167fe448-29b7-4feb-b38b-c3a8d3d7874b tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:44:40.077752 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-167fe448-29b7-4feb-b38b-c3a8d3d7874b tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:44:40.078539 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-167fe448-29b7-4feb-b38b-c3a8d3d7874b tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:44:40.245753 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.virt.hardware [None req-143c983f-7a10-40c3-b5ae-3ff693772d2c tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Flavor limits 0:0:0 {{(pid=122224) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 15:44:40.246939 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.virt.hardware [None req-143c983f-7a10-40c3-b5ae-3ff693772d2c tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Image limits 0:0:0 {{(pid=122224) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 15:44:40.247743 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.virt.hardware [None req-143c983f-7a10-40c3-b5ae-3ff693772d2c tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Flavor pref 0:0:0 {{(pid=122224) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 15:44:40.248342 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.virt.hardware [None req-143c983f-7a10-40c3-b5ae-3ff693772d2c tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Image pref 0:0:0 {{(pid=122224) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 15:44:40.248916 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.virt.hardware [None req-143c983f-7a10-40c3-b5ae-3ff693772d2c tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122224) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 15:44:40.263166 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-143c983f-7a10-40c3-b5ae-3ff693772d2c tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:44:40.263933 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-143c983f-7a10-40c3-b5ae-3ff693772d2c tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:44:40.265146 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-143c983f-7a10-40c3-b5ae-3ff693772d2c tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:44:40.266333 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-143c983f-7a10-40c3-b5ae-3ff693772d2c tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:44:40.311958 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.quota [None req-143c983f-7a10-40c3-b5ae-3ff693772d2c tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Getting quotas for project 4fc48df471f247809d82ddf926bfdc6c. Resources: {'ram', 'instances', 'cores'} {{(pid=122224) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 27 15:44:40.318303 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.quota [None req-143c983f-7a10-40c3-b5ae-3ff693772d2c tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Getting quotas for user 0abe23cb5f314bc883ef7958b0ed9b5f and project 4fc48df471f247809d82ddf926bfdc6c. Resources: {'ram', 'instances', 'cores'} {{(pid=122224) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 27 15:44:40.323722 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-167fe448-29b7-4feb-b38b-c3a8d3d7874b tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96b599f8890b4281a7e311cf37a039e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d7fcab5d3f465793d650f16c6ea8de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:44:40.332321 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-167fe448-29b7-4feb-b38b-c3a8d3d7874b tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96" status: 200 len: 1521 microversion: 2.1 time: 0.269815 Oct 27 15:44:40.334454 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 172/379] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:44:40 2021] GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96 => generated 1521 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 15:44:40.335749 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-143c983f-7a10-40c3-b5ae-3ff693772d2c tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Going to run 1 instances... {{(pid=122224) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Oct 27 15:44:40.338503 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-143c983f-7a10-40c3-b5ae-3ff693772d2c tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] [instance: f7374bb8-d28b-47a6-a8bd-7ba19de8bd6d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b585ffbc-6a36-48c9-81b3-e26f9bd0fcba',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122224) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Oct 27 15:44:40.409723 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-143c983f-7a10-40c3-b5ae-3ff693772d2c tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.930662 Oct 27 15:44:40.411585 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 208/380] 10.222.0.64 () {60 vars in 1146 bytes} [Wed Oct 27 15:44:39 2021] POST /compute/v2.1/servers => generated 380 bytes in 933 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 15:44:40.422838 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-38e60406-6d36-4d7c-8970-3894ad759dc7 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:44:40.423598 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-38e60406-6d36-4d7c-8970-3894ad759dc7 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] [instance: f7374bb8-d28b-47a6-a8bd-7ba19de8bd6d] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:44:40.517591 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-38e60406-6d36-4d7c-8970-3894ad759dc7 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0abe23cb5f314bc883ef7958b0ed9b5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fc48df471f247809d82ddf926bfdc6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:44:40.526619 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-38e60406-6d36-4d7c-8970-3894ad759dc7 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] 10.222.0.64 "GET /compute/v2.1/servers/f7374bb8-d28b-47a6-a8bd-7ba19de8bd6d" status: 200 len: 1218 microversion: 2.1 time: 0.107868 Oct 27 15:44:40.529132 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 173/381] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:44:40 2021] GET /compute/v2.1/servers/f7374bb8-d28b-47a6-a8bd-7ba19de8bd6d => generated 1218 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 15:44:40.869893 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-91a429ec-aadf-40f6-a3c7-fd6f6f50be64 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 15:44:40.872297 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-91a429ec-aadf-40f6-a3c7-fd6f6f50be64 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:44:40.879001 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-91a429ec-aadf-40f6-a3c7-fd6f6f50be64 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:44:40.879448 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-91a429ec-aadf-40f6-a3c7-fd6f6f50be64 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:44:40.880264 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-91a429ec-aadf-40f6-a3c7-fd6f6f50be64 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:44:40.881232 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-91a429ec-aadf-40f6-a3c7-fd6f6f50be64 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:44:41.007082 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-91a429ec-aadf-40f6-a3c7-fd6f6f50be64 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "POST /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672/action" status: 200 len: 28844 microversion: 2.20 time: 0.141078 Oct 27 15:44:41.007733 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 209/382] 10.222.0.64 () {62 vars in 1318 bytes} [Wed Oct 27 15:44:40 2021] POST /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672/action => generated 28844 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 27 15:44:41.352690 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-f7a82f9f-2c3e-44d6-969d-840d55f7ca87 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:44:41.353297 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-f7a82f9f-2c3e-44d6-969d-840d55f7ca87 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: 62c89161-c119-48b2-839d-712db798ff96] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:44:41.360824 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-f7a82f9f-2c3e-44d6-969d-840d55f7ca87 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:44:41.361356 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-f7a82f9f-2c3e-44d6-969d-840d55f7ca87 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:44:41.362127 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-f7a82f9f-2c3e-44d6-969d-840d55f7ca87 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:44:41.362552 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-f7a82f9f-2c3e-44d6-969d-840d55f7ca87 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:44:41.540809 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-f7a82f9f-2c3e-44d6-969d-840d55f7ca87 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96b599f8890b4281a7e311cf37a039e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d7fcab5d3f465793d650f16c6ea8de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:44:41.550814 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-74aeecb4-a0cc-4ee6-994c-86e921ba0f10 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:44:41.552182 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-74aeecb4-a0cc-4ee6-994c-86e921ba0f10 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] [instance: f7374bb8-d28b-47a6-a8bd-7ba19de8bd6d] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:44:41.557370 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-f7a82f9f-2c3e-44d6-969d-840d55f7ca87 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96" status: 200 len: 1521 microversion: 2.1 time: 0.209548 Oct 27 15:44:41.558619 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 174/383] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:44:41 2021] GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96 => generated 1521 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 15:44:41.566083 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-74aeecb4-a0cc-4ee6-994c-86e921ba0f10 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:44:41.566733 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-74aeecb4-a0cc-4ee6-994c-86e921ba0f10 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:44:41.567816 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-74aeecb4-a0cc-4ee6-994c-86e921ba0f10 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:44:41.570739 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-74aeecb4-a0cc-4ee6-994c-86e921ba0f10 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:44:41.660290 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-74aeecb4-a0cc-4ee6-994c-86e921ba0f10 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0abe23cb5f314bc883ef7958b0ed9b5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fc48df471f247809d82ddf926bfdc6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:44:41.675365 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-74aeecb4-a0cc-4ee6-994c-86e921ba0f10 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] 10.222.0.64 "GET /compute/v2.1/servers/f7374bb8-d28b-47a6-a8bd-7ba19de8bd6d" status: 200 len: 1270 microversion: 2.1 time: 0.132057 Oct 27 15:44:41.678706 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 210/384] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:44:41 2021] GET /compute/v2.1/servers/f7374bb8-d28b-47a6-a8bd-7ba19de8bd6d => generated 1270 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 15:44:42.020772 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-a1ad1e70-047d-4355-b17d-eb9bdc1cd2fe tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 15:44:42.022098 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-a1ad1e70-047d-4355-b17d-eb9bdc1cd2fe tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:44:42.034362 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-a1ad1e70-047d-4355-b17d-eb9bdc1cd2fe tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:44:42.040002 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-a1ad1e70-047d-4355-b17d-eb9bdc1cd2fe tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:44:42.045869 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-a1ad1e70-047d-4355-b17d-eb9bdc1cd2fe tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:44:42.047731 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-a1ad1e70-047d-4355-b17d-eb9bdc1cd2fe tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:44:42.317710 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-a1ad1e70-047d-4355-b17d-eb9bdc1cd2fe tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "POST /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672/action" status: 200 len: 29450 microversion: 2.20 time: 0.301921 Oct 27 15:44:42.319125 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 175/385] 10.222.0.64 () {62 vars in 1318 bytes} [Wed Oct 27 15:44:42 2021] POST /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672/action => generated 29450 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 27 15:44:42.577448 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-6b837d41-91d1-448f-8186-606f454ea3ba tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:44:42.578262 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-6b837d41-91d1-448f-8186-606f454ea3ba tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: 62c89161-c119-48b2-839d-712db798ff96] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:44:42.608190 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-6b837d41-91d1-448f-8186-606f454ea3ba tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:44:42.609422 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-6b837d41-91d1-448f-8186-606f454ea3ba tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:44:42.611134 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-6b837d41-91d1-448f-8186-606f454ea3ba tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:44:42.612710 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-6b837d41-91d1-448f-8186-606f454ea3ba tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:44:42.696115 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-0d798689-317f-4e72-808b-0eee76e895c9 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:44:42.697582 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-0d798689-317f-4e72-808b-0eee76e895c9 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] [instance: f7374bb8-d28b-47a6-a8bd-7ba19de8bd6d] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:44:42.707553 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-0d798689-317f-4e72-808b-0eee76e895c9 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:44:42.708416 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-0d798689-317f-4e72-808b-0eee76e895c9 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:44:42.710484 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-0d798689-317f-4e72-808b-0eee76e895c9 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:44:42.711567 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-0d798689-317f-4e72-808b-0eee76e895c9 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:44:42.796201 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-0d798689-317f-4e72-808b-0eee76e895c9 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0abe23cb5f314bc883ef7958b0ed9b5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fc48df471f247809d82ddf926bfdc6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:44:42.804571 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-0d798689-317f-4e72-808b-0eee76e895c9 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] 10.222.0.64 "GET /compute/v2.1/servers/f7374bb8-d28b-47a6-a8bd-7ba19de8bd6d" status: 200 len: 1276 microversion: 2.1 time: 0.113556 Oct 27 15:44:42.814467 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 176/386] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:44:42 2021] GET /compute/v2.1/servers/f7374bb8-d28b-47a6-a8bd-7ba19de8bd6d => generated 1276 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 15:44:42.895071 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-6b837d41-91d1-448f-8186-606f454ea3ba tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96b599f8890b4281a7e311cf37a039e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d7fcab5d3f465793d650f16c6ea8de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:44:42.924896 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-6b837d41-91d1-448f-8186-606f454ea3ba tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96" status: 200 len: 1521 microversion: 2.1 time: 0.338432 Oct 27 15:44:42.927967 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 211/387] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:44:42 2021] GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96 => generated 1521 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 15:44:43.330377 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-ae1f8ac7-dcd0-46a5-8905-89896e8b007a tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 15:44:43.332069 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-ae1f8ac7-dcd0-46a5-8905-89896e8b007a tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:44:43.342027 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-ae1f8ac7-dcd0-46a5-8905-89896e8b007a tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:44:43.342473 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-ae1f8ac7-dcd0-46a5-8905-89896e8b007a tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:44:43.350689 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-ae1f8ac7-dcd0-46a5-8905-89896e8b007a tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:44:43.351724 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-ae1f8ac7-dcd0-46a5-8905-89896e8b007a tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:44:43.527301 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-ae1f8ac7-dcd0-46a5-8905-89896e8b007a tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "POST /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672/action" status: 200 len: 30676 microversion: 2.20 time: 0.200952 Oct 27 15:44:43.528140 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 177/388] 10.222.0.64 () {62 vars in 1318 bytes} [Wed Oct 27 15:44:43 2021] POST /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672/action => generated 30676 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 27 15:44:43.822213 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-9e1f3ded-7942-4fc5-a96f-d323e3ce0b28 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:44:43.823770 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-9e1f3ded-7942-4fc5-a96f-d323e3ce0b28 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] [instance: f7374bb8-d28b-47a6-a8bd-7ba19de8bd6d] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:44:43.836152 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-9e1f3ded-7942-4fc5-a96f-d323e3ce0b28 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:44:43.838099 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-9e1f3ded-7942-4fc5-a96f-d323e3ce0b28 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:44:43.839101 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-9e1f3ded-7942-4fc5-a96f-d323e3ce0b28 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:44:43.840616 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-9e1f3ded-7942-4fc5-a96f-d323e3ce0b28 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:44:43.942802 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-9efb4017-5235-46b3-9270-951e60e15aec tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:44:43.945106 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-9efb4017-5235-46b3-9270-951e60e15aec tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: 62c89161-c119-48b2-839d-712db798ff96] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:44:43.955955 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-9efb4017-5235-46b3-9270-951e60e15aec tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:44:43.957811 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-9efb4017-5235-46b3-9270-951e60e15aec tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:44:43.960106 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-9efb4017-5235-46b3-9270-951e60e15aec tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:44:43.960761 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-9efb4017-5235-46b3-9270-951e60e15aec tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:44:44.390284 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-9efb4017-5235-46b3-9270-951e60e15aec tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96b599f8890b4281a7e311cf37a039e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d7fcab5d3f465793d650f16c6ea8de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:44:44.399888 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-9efb4017-5235-46b3-9270-951e60e15aec tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96" status: 200 len: 1521 microversion: 2.1 time: 0.460740 Oct 27 15:44:44.401600 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 178/389] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:44:43 2021] GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96 => generated 1521 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 15:44:44.430495 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-9e1f3ded-7942-4fc5-a96f-d323e3ce0b28 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0abe23cb5f314bc883ef7958b0ed9b5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fc48df471f247809d82ddf926bfdc6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:44:44.443745 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-9e1f3ded-7942-4fc5-a96f-d323e3ce0b28 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] 10.222.0.64 "GET /compute/v2.1/servers/f7374bb8-d28b-47a6-a8bd-7ba19de8bd6d" status: 200 len: 1318 microversion: 2.1 time: 0.625363 Oct 27 15:44:44.446629 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 212/390] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:44:43 2021] GET /compute/v2.1/servers/f7374bb8-d28b-47a6-a8bd-7ba19de8bd6d => generated 1318 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 15:44:44.540927 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-a27d888c-a55c-4bd5-8ced-8e3425744d22 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 15:44:44.542091 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-a27d888c-a55c-4bd5-8ced-8e3425744d22 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:44:44.555416 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-a27d888c-a55c-4bd5-8ced-8e3425744d22 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:44:44.556298 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-a27d888c-a55c-4bd5-8ced-8e3425744d22 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:44:44.557302 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-a27d888c-a55c-4bd5-8ced-8e3425744d22 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:44:44.557923 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-a27d888c-a55c-4bd5-8ced-8e3425744d22 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:44:44.697347 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-a27d888c-a55c-4bd5-8ced-8e3425744d22 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "POST /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672/action" status: 200 len: 31169 microversion: 2.20 time: 0.161460 Oct 27 15:44:44.698397 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 179/391] 10.222.0.64 () {62 vars in 1318 bytes} [Wed Oct 27 15:44:44 2021] POST /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672/action => generated 31169 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 27 15:44:44.797204 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [req-502209c1-29d7-47c3-b442-1a78edd6c420 req-afb44add-d6eb-4902-b69d-e10e7951190b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f7374bb8-d28b-47a6-a8bd-7ba19de8bd6d", "tag": "2292b913-d7bf-4e33-a1c0-57f3f447f964"}]} {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 15:44:44.801668 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 27 15:44:44.801668 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: warnings.warn(msg) Oct 27 15:44:44.820802 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [req-502209c1-29d7-47c3-b442-1a78edd6c420 req-afb44add-d6eb-4902-b69d-e10e7951190b service nova] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:44:44.824329 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [req-502209c1-29d7-47c3-b442-1a78edd6c420 req-afb44add-d6eb-4902-b69d-e10e7951190b service nova] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:44:44.870607 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.compute.server_external_events [req-502209c1-29d7-47c3-b442-1a78edd6c420 req-afb44add-d6eb-4902-b69d-e10e7951190b service nova] Creating event network-changed:2292b913-d7bf-4e33-a1c0-57f3f447f964 for instance f7374bb8-d28b-47a6-a8bd-7ba19de8bd6d on hv-cinder-80070 Oct 27 15:44:44.884487 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [req-502209c1-29d7-47c3-b442-1a78edd6c420 req-afb44add-d6eb-4902-b69d-e10e7951190b service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096762 Oct 27 15:44:44.885705 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 213/392] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Oct 27 15:44:44 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 15:44:45.420349 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-341c8aba-2e07-4e2e-9eb3-a3b5ea18b17b tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:44:45.421034 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-341c8aba-2e07-4e2e-9eb3-a3b5ea18b17b tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: 62c89161-c119-48b2-839d-712db798ff96] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:44:45.430714 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-341c8aba-2e07-4e2e-9eb3-a3b5ea18b17b tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:44:45.431156 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-341c8aba-2e07-4e2e-9eb3-a3b5ea18b17b tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:44:45.431958 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-341c8aba-2e07-4e2e-9eb3-a3b5ea18b17b tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:44:45.432387 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-341c8aba-2e07-4e2e-9eb3-a3b5ea18b17b tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:44:45.463527 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-89236268-2cb0-4891-8fb7-13a672f2bd59 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:44:45.464252 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-89236268-2cb0-4891-8fb7-13a672f2bd59 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] [instance: f7374bb8-d28b-47a6-a8bd-7ba19de8bd6d] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:44:45.473868 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-89236268-2cb0-4891-8fb7-13a672f2bd59 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:44:45.475337 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-89236268-2cb0-4891-8fb7-13a672f2bd59 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:44:45.476456 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-89236268-2cb0-4891-8fb7-13a672f2bd59 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:44:45.477037 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-89236268-2cb0-4891-8fb7-13a672f2bd59 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:44:45.697840 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-341c8aba-2e07-4e2e-9eb3-a3b5ea18b17b tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96b599f8890b4281a7e311cf37a039e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d7fcab5d3f465793d650f16c6ea8de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:44:45.707812 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-341c8aba-2e07-4e2e-9eb3-a3b5ea18b17b tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96" status: 200 len: 1521 microversion: 2.1 time: 0.292348 Oct 27 15:44:45.709560 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 180/393] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:44:45 2021] GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96 => generated 1521 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 15:44:45.721820 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-5253246f-3345-443c-8360-17a2c0e18cc0 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 15:44:45.723115 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-5253246f-3345-443c-8360-17a2c0e18cc0 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:44:45.733891 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-5253246f-3345-443c-8360-17a2c0e18cc0 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:44:45.735512 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-5253246f-3345-443c-8360-17a2c0e18cc0 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:44:45.736759 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-5253246f-3345-443c-8360-17a2c0e18cc0 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:44:45.737549 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-5253246f-3345-443c-8360-17a2c0e18cc0 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:44:45.753813 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-89236268-2cb0-4891-8fb7-13a672f2bd59 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0abe23cb5f314bc883ef7958b0ed9b5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fc48df471f247809d82ddf926bfdc6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:44:45.765204 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-89236268-2cb0-4891-8fb7-13a672f2bd59 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] 10.222.0.64 "GET /compute/v2.1/servers/f7374bb8-d28b-47a6-a8bd-7ba19de8bd6d" status: 200 len: 1318 microversion: 2.1 time: 0.305490 Oct 27 15:44:45.767423 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 214/394] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:44:45 2021] GET /compute/v2.1/servers/f7374bb8-d28b-47a6-a8bd-7ba19de8bd6d => generated 1318 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 15:44:45.970217 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-5253246f-3345-443c-8360-17a2c0e18cc0 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "POST /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672/action" status: 200 len: 31687 microversion: 2.20 time: 0.253382 Oct 27 15:44:45.972170 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 181/395] 10.222.0.64 () {62 vars in 1318 bytes} [Wed Oct 27 15:44:45 2021] POST /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672/action => generated 31687 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 27 15:44:46.734995 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-8eb41fca-e8d2-44f8-8344-26beff7e1a5c tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:44:46.735608 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-8eb41fca-e8d2-44f8-8344-26beff7e1a5c tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: 62c89161-c119-48b2-839d-712db798ff96] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:44:46.743183 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-8eb41fca-e8d2-44f8-8344-26beff7e1a5c tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:44:46.744758 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-8eb41fca-e8d2-44f8-8344-26beff7e1a5c tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:44:46.745866 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-8eb41fca-e8d2-44f8-8344-26beff7e1a5c tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:44:46.746613 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-8eb41fca-e8d2-44f8-8344-26beff7e1a5c tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:44:46.785301 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-740d210f-2541-40a2-aee0-0c14e65f9b40 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:44:46.786185 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-740d210f-2541-40a2-aee0-0c14e65f9b40 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] [instance: f7374bb8-d28b-47a6-a8bd-7ba19de8bd6d] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:44:46.794169 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-740d210f-2541-40a2-aee0-0c14e65f9b40 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:44:46.795164 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-740d210f-2541-40a2-aee0-0c14e65f9b40 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:44:46.797767 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-740d210f-2541-40a2-aee0-0c14e65f9b40 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:44:46.798326 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-740d210f-2541-40a2-aee0-0c14e65f9b40 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:44:46.914043 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-8eb41fca-e8d2-44f8-8344-26beff7e1a5c tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96b599f8890b4281a7e311cf37a039e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d7fcab5d3f465793d650f16c6ea8de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:44:46.924436 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-8eb41fca-e8d2-44f8-8344-26beff7e1a5c tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96" status: 200 len: 1521 microversion: 2.1 time: 0.202082 Oct 27 15:44:46.925175 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 215/396] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:44:46 2021] GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96 => generated 1521 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 15:44:46.987543 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-5a7aa6b5-40d9-4d6d-ad81-98abbbbf0b20 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 15:44:46.989119 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-5a7aa6b5-40d9-4d6d-ad81-98abbbbf0b20 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:44:46.997133 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-740d210f-2541-40a2-aee0-0c14e65f9b40 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0abe23cb5f314bc883ef7958b0ed9b5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fc48df471f247809d82ddf926bfdc6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:44:47.000019 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-5a7aa6b5-40d9-4d6d-ad81-98abbbbf0b20 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:44:47.001038 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-5a7aa6b5-40d9-4d6d-ad81-98abbbbf0b20 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:44:47.001976 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-5a7aa6b5-40d9-4d6d-ad81-98abbbbf0b20 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:44:47.002706 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-5a7aa6b5-40d9-4d6d-ad81-98abbbbf0b20 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:44:47.008055 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-740d210f-2541-40a2-aee0-0c14e65f9b40 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] 10.222.0.64 "GET /compute/v2.1/servers/f7374bb8-d28b-47a6-a8bd-7ba19de8bd6d" status: 200 len: 1318 microversion: 2.1 time: 0.227523 Oct 27 15:44:47.008919 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 182/397] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:44:46 2021] GET /compute/v2.1/servers/f7374bb8-d28b-47a6-a8bd-7ba19de8bd6d => generated 1318 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 15:44:47.167821 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-5a7aa6b5-40d9-4d6d-ad81-98abbbbf0b20 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "POST /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672/action" status: 200 len: 32113 microversion: 2.20 time: 0.186816 Oct 27 15:44:47.168849 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 216/398] 10.222.0.64 () {62 vars in 1318 bytes} [Wed Oct 27 15:44:46 2021] POST /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672/action => generated 32113 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 27 15:44:47.941660 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-d22d8051-0b5f-4c2e-b1f6-0853fa77c76f tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:44:47.942397 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-d22d8051-0b5f-4c2e-b1f6-0853fa77c76f tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: 62c89161-c119-48b2-839d-712db798ff96] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:44:47.950100 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-d22d8051-0b5f-4c2e-b1f6-0853fa77c76f tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:44:47.950564 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-d22d8051-0b5f-4c2e-b1f6-0853fa77c76f tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:44:47.951560 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-d22d8051-0b5f-4c2e-b1f6-0853fa77c76f tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:44:47.952322 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-d22d8051-0b5f-4c2e-b1f6-0853fa77c76f tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:44:48.026149 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-97d59231-e597-4da0-a04c-98a2b422680e tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:44:48.026883 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-97d59231-e597-4da0-a04c-98a2b422680e tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] [instance: f7374bb8-d28b-47a6-a8bd-7ba19de8bd6d] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:44:48.047937 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-97d59231-e597-4da0-a04c-98a2b422680e tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:44:48.056469 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-97d59231-e597-4da0-a04c-98a2b422680e tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:44:48.062490 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-97d59231-e597-4da0-a04c-98a2b422680e tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:44:48.063077 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-97d59231-e597-4da0-a04c-98a2b422680e tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:44:48.141774 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-d22d8051-0b5f-4c2e-b1f6-0853fa77c76f tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96b599f8890b4281a7e311cf37a039e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d7fcab5d3f465793d650f16c6ea8de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:44:48.151726 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-d22d8051-0b5f-4c2e-b1f6-0853fa77c76f tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96" status: 200 len: 1521 microversion: 2.1 time: 0.213649 Oct 27 15:44:48.160742 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 183/399] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:44:47 2021] GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96 => generated 1521 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 15:44:48.185726 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-27ce0f45-6de4-455a-85b0-77b48b0a8fd2 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 15:44:48.187548 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-27ce0f45-6de4-455a-85b0-77b48b0a8fd2 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:44:48.196130 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-27ce0f45-6de4-455a-85b0-77b48b0a8fd2 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:44:48.196779 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-27ce0f45-6de4-455a-85b0-77b48b0a8fd2 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:44:48.197760 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-27ce0f45-6de4-455a-85b0-77b48b0a8fd2 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:44:48.198345 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-27ce0f45-6de4-455a-85b0-77b48b0a8fd2 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:44:48.263559 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-97d59231-e597-4da0-a04c-98a2b422680e tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0abe23cb5f314bc883ef7958b0ed9b5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fc48df471f247809d82ddf926bfdc6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:44:48.272229 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-97d59231-e597-4da0-a04c-98a2b422680e tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] 10.222.0.64 "GET /compute/v2.1/servers/f7374bb8-d28b-47a6-a8bd-7ba19de8bd6d" status: 200 len: 1318 microversion: 2.1 time: 0.250520 Oct 27 15:44:48.273040 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 217/400] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:44:48 2021] GET /compute/v2.1/servers/f7374bb8-d28b-47a6-a8bd-7ba19de8bd6d => generated 1318 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 15:44:48.320098 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-27ce0f45-6de4-455a-85b0-77b48b0a8fd2 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "POST /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672/action" status: 200 len: 32729 microversion: 2.20 time: 0.142255 Oct 27 15:44:48.321311 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 184/401] 10.222.0.64 () {62 vars in 1318 bytes} [Wed Oct 27 15:44:48 2021] POST /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672/action => generated 32729 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 27 15:44:49.177193 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-3010cf86-6d35-4032-9f16-e0574dbf7c3b tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:44:49.177973 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-3010cf86-6d35-4032-9f16-e0574dbf7c3b tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: 62c89161-c119-48b2-839d-712db798ff96] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:44:49.184410 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-3010cf86-6d35-4032-9f16-e0574dbf7c3b tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:44:49.185125 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-3010cf86-6d35-4032-9f16-e0574dbf7c3b tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:44:49.186108 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-3010cf86-6d35-4032-9f16-e0574dbf7c3b tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:44:49.186729 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-3010cf86-6d35-4032-9f16-e0574dbf7c3b tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:44:49.211463 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-51156e1d-4e19-4dc3-a03b-10a90ee0bc55 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1619557322", "imageRef": "b585ffbc-6a36-48c9-81b3-e26f9bd0fcba", "flavorRef": "452", "networks": [{"uuid": "4288875b-e618-420b-929c-d1092831a759"}]}} {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 15:44:49.322142 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-3010cf86-6d35-4032-9f16-e0574dbf7c3b tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96b599f8890b4281a7e311cf37a039e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d7fcab5d3f465793d650f16c6ea8de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:44:49.334660 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-3010cf86-6d35-4032-9f16-e0574dbf7c3b tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96" status: 200 len: 1521 microversion: 2.1 time: 0.160433 Oct 27 15:44:49.335303 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 218/402] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:44:49 2021] GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96 => generated 1521 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 15:44:49.340265 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-7ade8b37-faa7-4d19-93ac-7d019a7f95d4 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:44:49.341130 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-7ade8b37-faa7-4d19-93ac-7d019a7f95d4 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] [instance: f7374bb8-d28b-47a6-a8bd-7ba19de8bd6d] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:44:49.347486 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-7ade8b37-faa7-4d19-93ac-7d019a7f95d4 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:44:49.348403 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-7ade8b37-faa7-4d19-93ac-7d019a7f95d4 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:44:49.350112 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-7ade8b37-faa7-4d19-93ac-7d019a7f95d4 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:44:49.350545 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-7ade8b37-faa7-4d19-93ac-7d019a7f95d4 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:44:49.493562 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-7ade8b37-faa7-4d19-93ac-7d019a7f95d4 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0abe23cb5f314bc883ef7958b0ed9b5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fc48df471f247809d82ddf926bfdc6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:44:49.501288 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-7ade8b37-faa7-4d19-93ac-7d019a7f95d4 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] 10.222.0.64 "GET /compute/v2.1/servers/f7374bb8-d28b-47a6-a8bd-7ba19de8bd6d" status: 200 len: 1318 microversion: 2.1 time: 0.164630 Oct 27 15:44:49.512302 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 219/403] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:44:49 2021] GET /compute/v2.1/servers/f7374bb8-d28b-47a6-a8bd-7ba19de8bd6d => generated 1318 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 15:44:49.517233 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-2bffd323-94ea-429d-b730-12d0493046a2 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 15:44:49.518148 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-2bffd323-94ea-429d-b730-12d0493046a2 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:44:49.524827 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-2bffd323-94ea-429d-b730-12d0493046a2 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:44:49.525283 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-2bffd323-94ea-429d-b730-12d0493046a2 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:44:49.526060 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-2bffd323-94ea-429d-b730-12d0493046a2 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:44:49.526500 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-2bffd323-94ea-429d-b730-12d0493046a2 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:44:49.650896 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-2bffd323-94ea-429d-b730-12d0493046a2 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "POST /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672/action" status: 200 len: 33249 microversion: 2.20 time: 0.137214 Oct 27 15:44:49.651932 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 220/404] 10.222.0.64 () {62 vars in 1318 bytes} [Wed Oct 27 15:44:49 2021] POST /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672/action => generated 33249 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 27 15:44:50.353820 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-0e94e9a3-a3c0-4913-9e09-5e95c71fb12b tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:44:50.355403 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-0e94e9a3-a3c0-4913-9e09-5e95c71fb12b tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: 62c89161-c119-48b2-839d-712db798ff96] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:44:50.363293 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-0e94e9a3-a3c0-4913-9e09-5e95c71fb12b tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:44:50.363974 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-0e94e9a3-a3c0-4913-9e09-5e95c71fb12b tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:44:50.364829 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-0e94e9a3-a3c0-4913-9e09-5e95c71fb12b tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:44:50.366175 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-0e94e9a3-a3c0-4913-9e09-5e95c71fb12b tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:44:50.538533 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-0e94e9a3-a3c0-4913-9e09-5e95c71fb12b tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96b599f8890b4281a7e311cf37a039e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d7fcab5d3f465793d650f16c6ea8de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:44:50.547055 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-0e94e9a3-a3c0-4913-9e09-5e95c71fb12b tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96" status: 200 len: 1521 microversion: 2.1 time: 0.199126 Oct 27 15:44:50.548441 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 221/405] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:44:50 2021] GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96 => generated 1521 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 15:44:50.554142 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-86634637-07cf-49b0-8347-d3e3ee36fea4 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:44:50.554998 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-86634637-07cf-49b0-8347-d3e3ee36fea4 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] [instance: f7374bb8-d28b-47a6-a8bd-7ba19de8bd6d] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:44:50.561952 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-86634637-07cf-49b0-8347-d3e3ee36fea4 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:44:50.562571 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-86634637-07cf-49b0-8347-d3e3ee36fea4 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:44:50.563645 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-86634637-07cf-49b0-8347-d3e3ee36fea4 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:44:50.564113 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-86634637-07cf-49b0-8347-d3e3ee36fea4 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:44:50.705663 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-86634637-07cf-49b0-8347-d3e3ee36fea4 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0abe23cb5f314bc883ef7958b0ed9b5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fc48df471f247809d82ddf926bfdc6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:44:50.716862 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-86634637-07cf-49b0-8347-d3e3ee36fea4 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] 10.222.0.64 "GET /compute/v2.1/servers/f7374bb8-d28b-47a6-a8bd-7ba19de8bd6d" status: 200 len: 1318 microversion: 2.1 time: 0.167181 Oct 27 15:44:50.717648 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 222/406] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:44:50 2021] GET /compute/v2.1/servers/f7374bb8-d28b-47a6-a8bd-7ba19de8bd6d => generated 1318 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 15:44:50.724682 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-7ac525d9-ef93-4482-9f92-28406a00453d tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 15:44:50.726039 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-7ac525d9-ef93-4482-9f92-28406a00453d tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:44:50.732127 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-7ac525d9-ef93-4482-9f92-28406a00453d tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:44:50.732779 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-7ac525d9-ef93-4482-9f92-28406a00453d tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:44:50.733767 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-7ac525d9-ef93-4482-9f92-28406a00453d tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:44:50.734248 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-7ac525d9-ef93-4482-9f92-28406a00453d tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:44:50.851499 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-7ac525d9-ef93-4482-9f92-28406a00453d tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "POST /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672/action" status: 200 len: 33643 microversion: 2.20 time: 0.132338 Oct 27 15:44:50.852283 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 223/407] 10.222.0.64 () {62 vars in 1318 bytes} [Wed Oct 27 15:44:50 2021] POST /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672/action => generated 33643 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 27 15:44:51.565092 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-217f2743-a4e2-4686-94a4-504f9672722f tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:44:51.565789 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-217f2743-a4e2-4686-94a4-504f9672722f tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: 62c89161-c119-48b2-839d-712db798ff96] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:44:51.573511 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-217f2743-a4e2-4686-94a4-504f9672722f tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:44:51.573966 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-217f2743-a4e2-4686-94a4-504f9672722f tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:44:51.574750 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-217f2743-a4e2-4686-94a4-504f9672722f tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:44:51.575204 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-217f2743-a4e2-4686-94a4-504f9672722f tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:44:51.705843 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-217f2743-a4e2-4686-94a4-504f9672722f tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96b599f8890b4281a7e311cf37a039e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d7fcab5d3f465793d650f16c6ea8de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:44:51.714732 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-217f2743-a4e2-4686-94a4-504f9672722f tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96" status: 200 len: 1521 microversion: 2.1 time: 0.153566 Oct 27 15:44:51.715326 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 224/408] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:44:51 2021] GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96 => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 15:44:51.734783 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-f2ec481a-a03d-4472-9c65-6b560b76f045 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:44:51.735431 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-f2ec481a-a03d-4472-9c65-6b560b76f045 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] [instance: f7374bb8-d28b-47a6-a8bd-7ba19de8bd6d] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:44:51.742669 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-f2ec481a-a03d-4472-9c65-6b560b76f045 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:44:51.743371 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-f2ec481a-a03d-4472-9c65-6b560b76f045 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:44:51.744185 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-f2ec481a-a03d-4472-9c65-6b560b76f045 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:44:51.744813 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-f2ec481a-a03d-4472-9c65-6b560b76f045 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:44:51.968068 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-f2ec481a-a03d-4472-9c65-6b560b76f045 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0abe23cb5f314bc883ef7958b0ed9b5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fc48df471f247809d82ddf926bfdc6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:44:51.985214 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-f2ec481a-a03d-4472-9c65-6b560b76f045 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] 10.222.0.64 "GET /compute/v2.1/servers/f7374bb8-d28b-47a6-a8bd-7ba19de8bd6d" status: 200 len: 1318 microversion: 2.1 time: 0.255014 Oct 27 15:44:51.986408 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 225/409] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:44:51 2021] GET /compute/v2.1/servers/f7374bb8-d28b-47a6-a8bd-7ba19de8bd6d => generated 1318 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 15:44:52.000054 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-10ea1621-636c-4d84-a17b-3d43e08fa864 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 15:44:52.001334 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-10ea1621-636c-4d84-a17b-3d43e08fa864 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:44:52.010001 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-10ea1621-636c-4d84-a17b-3d43e08fa864 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:44:52.010458 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-10ea1621-636c-4d84-a17b-3d43e08fa864 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:44:52.011261 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-10ea1621-636c-4d84-a17b-3d43e08fa864 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:44:52.011712 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-10ea1621-636c-4d84-a17b-3d43e08fa864 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:44:52.112902 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-10ea1621-636c-4d84-a17b-3d43e08fa864 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "POST /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672/action" status: 200 len: 33974 microversion: 2.20 time: 0.124630 Oct 27 15:44:52.114101 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 226/410] 10.222.0.64 () {62 vars in 1318 bytes} [Wed Oct 27 15:44:51 2021] POST /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672/action => generated 33974 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 27 15:44:52.707077 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [req-bc7865b7-4432-4bdc-a96a-d6b0f3ebd728 req-57f66b8d-c912-43ec-bf5d-976ebe59eaa6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f7374bb8-d28b-47a6-a8bd-7ba19de8bd6d", "name": "network-vif-plugged", "status": "completed", "tag": "2292b913-d7bf-4e33-a1c0-57f3f447f964"}]} {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 15:44:52.708664 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 27 15:44:52.708664 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: warnings.warn(msg) Oct 27 15:44:52.717575 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [req-bc7865b7-4432-4bdc-a96a-d6b0f3ebd728 req-57f66b8d-c912-43ec-bf5d-976ebe59eaa6 service nova] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:44:52.717575 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [req-bc7865b7-4432-4bdc-a96a-d6b0f3ebd728 req-57f66b8d-c912-43ec-bf5d-976ebe59eaa6 service nova] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:44:52.731967 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.compute.server_external_events [req-bc7865b7-4432-4bdc-a96a-d6b0f3ebd728 req-57f66b8d-c912-43ec-bf5d-976ebe59eaa6 service nova] Creating event network-vif-plugged:2292b913-d7bf-4e33-a1c0-57f3f447f964 for instance f7374bb8-d28b-47a6-a8bd-7ba19de8bd6d on hv-cinder-80070 Oct 27 15:44:52.736857 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [req-bc7865b7-4432-4bdc-a96a-d6b0f3ebd728 req-57f66b8d-c912-43ec-bf5d-976ebe59eaa6 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033653 Oct 27 15:44:52.737593 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 227/411] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Oct 27 15:44:52 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 15:44:52.743961 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-5df6388e-e7f9-47df-b49a-50e12efdf8b5 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:44:52.744656 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-5df6388e-e7f9-47df-b49a-50e12efdf8b5 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: 62c89161-c119-48b2-839d-712db798ff96] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:44:52.750526 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-5df6388e-e7f9-47df-b49a-50e12efdf8b5 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:44:52.751631 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-5df6388e-e7f9-47df-b49a-50e12efdf8b5 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:44:52.752439 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-5df6388e-e7f9-47df-b49a-50e12efdf8b5 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:44:52.752874 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-5df6388e-e7f9-47df-b49a-50e12efdf8b5 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:44:52.923785 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-5df6388e-e7f9-47df-b49a-50e12efdf8b5 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96b599f8890b4281a7e311cf37a039e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d7fcab5d3f465793d650f16c6ea8de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:44:52.936520 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-5df6388e-e7f9-47df-b49a-50e12efdf8b5 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96" status: 200 len: 1521 microversion: 2.1 time: 0.197206 Oct 27 15:44:52.937995 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 228/412] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:44:52 2021] GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96 => generated 1521 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 15:44:53.002962 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-4849ccf0-866a-4f72-821c-fa1713c8f865 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:44:53.003701 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-4849ccf0-866a-4f72-821c-fa1713c8f865 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] [instance: f7374bb8-d28b-47a6-a8bd-7ba19de8bd6d] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:44:53.010327 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-4849ccf0-866a-4f72-821c-fa1713c8f865 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:44:53.011027 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-4849ccf0-866a-4f72-821c-fa1713c8f865 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:44:53.012012 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-4849ccf0-866a-4f72-821c-fa1713c8f865 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:44:53.012616 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-4849ccf0-866a-4f72-821c-fa1713c8f865 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:44:53.150055 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-4849ccf0-866a-4f72-821c-fa1713c8f865 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0abe23cb5f314bc883ef7958b0ed9b5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fc48df471f247809d82ddf926bfdc6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:44:53.158362 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-4849ccf0-866a-4f72-821c-fa1713c8f865 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] 10.222.0.64 "GET /compute/v2.1/servers/f7374bb8-d28b-47a6-a8bd-7ba19de8bd6d" status: 200 len: 1318 microversion: 2.1 time: 0.159517 Oct 27 15:44:53.158947 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 229/413] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:44:52 2021] GET /compute/v2.1/servers/f7374bb8-d28b-47a6-a8bd-7ba19de8bd6d => generated 1318 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 15:44:53.165039 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-86a421a7-123a-4001-af72-ffd974d87426 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 15:44:53.166133 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-86a421a7-123a-4001-af72-ffd974d87426 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:44:53.172533 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-86a421a7-123a-4001-af72-ffd974d87426 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:44:53.172978 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-86a421a7-123a-4001-af72-ffd974d87426 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:44:53.173746 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-86a421a7-123a-4001-af72-ffd974d87426 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:44:53.174176 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-86a421a7-123a-4001-af72-ffd974d87426 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:44:57.261922 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-86a421a7-123a-4001-af72-ffd974d87426 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "POST /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672/action" status: 200 len: 36038 microversion: 2.20 time: 4.101165 Oct 27 15:44:57.266638 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 230/414] 10.222.0.64 () {62 vars in 1318 bytes} [Wed Oct 27 15:44:53 2021] POST /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672/action => generated 36038 bytes in 4105 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 27 15:44:57.273572 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-58504c9f-ffb8-41eb-b819-62e604db756c tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:44:57.274740 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-58504c9f-ffb8-41eb-b819-62e604db756c tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: 62c89161-c119-48b2-839d-712db798ff96] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:44:57.284029 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-58504c9f-ffb8-41eb-b819-62e604db756c tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:44:57.284470 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-58504c9f-ffb8-41eb-b819-62e604db756c tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:44:57.285235 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-58504c9f-ffb8-41eb-b819-62e604db756c tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:44:57.285664 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-58504c9f-ffb8-41eb-b819-62e604db756c tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:44:57.417752 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-58504c9f-ffb8-41eb-b819-62e604db756c tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96b599f8890b4281a7e311cf37a039e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d7fcab5d3f465793d650f16c6ea8de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:44:57.425729 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-58504c9f-ffb8-41eb-b819-62e604db756c tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96" status: 200 len: 1521 microversion: 2.1 time: 0.159518 Oct 27 15:44:57.426313 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 231/415] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:44:57 2021] GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96 => generated 1521 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 15:44:57.430909 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-3b30514d-43ae-46c3-91f4-ccae95d21e0a tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:44:57.431505 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-3b30514d-43ae-46c3-91f4-ccae95d21e0a tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] [instance: f7374bb8-d28b-47a6-a8bd-7ba19de8bd6d] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:44:57.438815 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-3b30514d-43ae-46c3-91f4-ccae95d21e0a tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:44:57.439444 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-3b30514d-43ae-46c3-91f4-ccae95d21e0a tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:44:57.440483 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-3b30514d-43ae-46c3-91f4-ccae95d21e0a tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:44:57.441022 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-3b30514d-43ae-46c3-91f4-ccae95d21e0a tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:44:57.570385 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-3b30514d-43ae-46c3-91f4-ccae95d21e0a tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0abe23cb5f314bc883ef7958b0ed9b5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fc48df471f247809d82ddf926bfdc6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:44:57.578172 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-3b30514d-43ae-46c3-91f4-ccae95d21e0a tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] 10.222.0.64 "GET /compute/v2.1/servers/f7374bb8-d28b-47a6-a8bd-7ba19de8bd6d" status: 200 len: 1318 microversion: 2.1 time: 0.150471 Oct 27 15:44:57.578872 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 232/416] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:44:57 2021] GET /compute/v2.1/servers/f7374bb8-d28b-47a6-a8bd-7ba19de8bd6d => generated 1318 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 15:44:58.274336 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-632dd2e1-9f9e-48d3-aab6-32f463fe2cc5 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 15:44:58.275371 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-632dd2e1-9f9e-48d3-aab6-32f463fe2cc5 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:44:58.281712 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-632dd2e1-9f9e-48d3-aab6-32f463fe2cc5 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:44:58.282165 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-632dd2e1-9f9e-48d3-aab6-32f463fe2cc5 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:44:58.282936 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-632dd2e1-9f9e-48d3-aab6-32f463fe2cc5 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:44:58.283370 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-632dd2e1-9f9e-48d3-aab6-32f463fe2cc5 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:44:58.396355 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-632dd2e1-9f9e-48d3-aab6-32f463fe2cc5 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "POST /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672/action" status: 200 len: 36509 microversion: 2.20 time: 0.124949 Oct 27 15:44:58.396955 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 233/417] 10.222.0.64 () {62 vars in 1318 bytes} [Wed Oct 27 15:44:58 2021] POST /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672/action => generated 36509 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 27 15:44:58.444072 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-1e467c9c-8241-4288-a3b2-c3c2e49d0e44 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:44:58.444881 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-1e467c9c-8241-4288-a3b2-c3c2e49d0e44 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: 62c89161-c119-48b2-839d-712db798ff96] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:44:58.452115 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-1e467c9c-8241-4288-a3b2-c3c2e49d0e44 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:44:58.452550 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-1e467c9c-8241-4288-a3b2-c3c2e49d0e44 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:44:58.453314 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-1e467c9c-8241-4288-a3b2-c3c2e49d0e44 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:44:58.453761 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-1e467c9c-8241-4288-a3b2-c3c2e49d0e44 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:44:58.588109 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-1e467c9c-8241-4288-a3b2-c3c2e49d0e44 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96b599f8890b4281a7e311cf37a039e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d7fcab5d3f465793d650f16c6ea8de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:44:58.596618 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-1e467c9c-8241-4288-a3b2-c3c2e49d0e44 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96" status: 200 len: 1521 microversion: 2.1 time: 0.157791 Oct 27 15:44:58.597481 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 234/418] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:44:58 2021] GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96 => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 15:44:58.602725 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-6fd7df45-ac4d-4175-8630-97dad874ba95 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:44:58.603728 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-6fd7df45-ac4d-4175-8630-97dad874ba95 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] [instance: f7374bb8-d28b-47a6-a8bd-7ba19de8bd6d] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:44:58.611632 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-6fd7df45-ac4d-4175-8630-97dad874ba95 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:44:58.612121 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-6fd7df45-ac4d-4175-8630-97dad874ba95 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:44:58.612899 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-6fd7df45-ac4d-4175-8630-97dad874ba95 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:44:58.613328 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-6fd7df45-ac4d-4175-8630-97dad874ba95 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:44:58.747047 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-6fd7df45-ac4d-4175-8630-97dad874ba95 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0abe23cb5f314bc883ef7958b0ed9b5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fc48df471f247809d82ddf926bfdc6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:44:58.755106 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-6fd7df45-ac4d-4175-8630-97dad874ba95 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] 10.222.0.64 "GET /compute/v2.1/servers/f7374bb8-d28b-47a6-a8bd-7ba19de8bd6d" status: 200 len: 1318 microversion: 2.1 time: 0.156286 Oct 27 15:44:58.755893 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 235/419] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:44:58 2021] GET /compute/v2.1/servers/f7374bb8-d28b-47a6-a8bd-7ba19de8bd6d => generated 1318 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 15:44:59.408452 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-48f203de-35da-458a-bc21-96e6b202e6ca tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 15:44:59.409425 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-48f203de-35da-458a-bc21-96e6b202e6ca tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:44:59.416959 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-48f203de-35da-458a-bc21-96e6b202e6ca tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:44:59.417472 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-48f203de-35da-458a-bc21-96e6b202e6ca tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:44:59.418508 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-48f203de-35da-458a-bc21-96e6b202e6ca tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:44:59.419013 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-48f203de-35da-458a-bc21-96e6b202e6ca tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:45:02.596547 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-48f203de-35da-458a-bc21-96e6b202e6ca tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "POST /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672/action" status: 200 len: 38156 microversion: 2.20 time: 3.191782 Oct 27 15:45:02.597216 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 236/420] 10.222.0.64 () {62 vars in 1318 bytes} [Wed Oct 27 15:44:59 2021] POST /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672/action => generated 38156 bytes in 3193 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 27 15:45:02.603475 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-29f7e1e3-243f-43d6-9fdf-003f84369b63 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:45:02.604193 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-29f7e1e3-243f-43d6-9fdf-003f84369b63 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: 62c89161-c119-48b2-839d-712db798ff96] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:45:02.611285 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-29f7e1e3-243f-43d6-9fdf-003f84369b63 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:45:02.611733 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-29f7e1e3-243f-43d6-9fdf-003f84369b63 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:45:02.612546 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-29f7e1e3-243f-43d6-9fdf-003f84369b63 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:45:02.612979 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-29f7e1e3-243f-43d6-9fdf-003f84369b63 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:45:02.752720 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-29f7e1e3-243f-43d6-9fdf-003f84369b63 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96b599f8890b4281a7e311cf37a039e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d7fcab5d3f465793d650f16c6ea8de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:45:02.763824 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-29f7e1e3-243f-43d6-9fdf-003f84369b63 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96" status: 200 len: 1521 microversion: 2.1 time: 0.165354 Oct 27 15:45:02.764686 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 237/421] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:45:02 2021] GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96 => generated 1521 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 15:45:02.774478 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-dd11ed50-c654-45b0-bee7-795cea7a839c tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:45:02.775299 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-dd11ed50-c654-45b0-bee7-795cea7a839c tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] [instance: f7374bb8-d28b-47a6-a8bd-7ba19de8bd6d] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:45:02.782426 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-dd11ed50-c654-45b0-bee7-795cea7a839c tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:45:02.782897 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-dd11ed50-c654-45b0-bee7-795cea7a839c tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:45:02.783668 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-dd11ed50-c654-45b0-bee7-795cea7a839c tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:45:02.784120 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-dd11ed50-c654-45b0-bee7-795cea7a839c tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:45:02.918667 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-dd11ed50-c654-45b0-bee7-795cea7a839c tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0abe23cb5f314bc883ef7958b0ed9b5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fc48df471f247809d82ddf926bfdc6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:45:02.928519 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-dd11ed50-c654-45b0-bee7-795cea7a839c tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] 10.222.0.64 "GET /compute/v2.1/servers/f7374bb8-d28b-47a6-a8bd-7ba19de8bd6d" status: 200 len: 1507 microversion: 2.1 time: 0.162231 Oct 27 15:45:02.939784 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 238/422] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:45:02 2021] GET /compute/v2.1/servers/f7374bb8-d28b-47a6-a8bd-7ba19de8bd6d => generated 1507 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 15:45:03.609724 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-b48ef4c1-887a-4171-a45e-604af8841407 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 15:45:03.611538 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-b48ef4c1-887a-4171-a45e-604af8841407 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:45:03.618830 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-b48ef4c1-887a-4171-a45e-604af8841407 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:45:03.619285 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-b48ef4c1-887a-4171-a45e-604af8841407 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:45:03.620234 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-b48ef4c1-887a-4171-a45e-604af8841407 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:45:03.620672 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-b48ef4c1-887a-4171-a45e-604af8841407 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:45:03.709339 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-b48ef4c1-887a-4171-a45e-604af8841407 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "POST /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672/action" status: 200 len: 38156 microversion: 2.20 time: 0.102624 Oct 27 15:45:03.710064 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 239/423] 10.222.0.64 () {62 vars in 1318 bytes} [Wed Oct 27 15:45:03 2021] POST /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672/action => generated 38156 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 27 15:45:03.787004 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-e38fd293-3bb5-40a0-b400-b47eeeda86aa tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:45:03.788069 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-e38fd293-3bb5-40a0-b400-b47eeeda86aa tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: 62c89161-c119-48b2-839d-712db798ff96] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:45:03.796816 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-e38fd293-3bb5-40a0-b400-b47eeeda86aa tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:45:03.797406 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-e38fd293-3bb5-40a0-b400-b47eeeda86aa tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:45:03.798275 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-e38fd293-3bb5-40a0-b400-b47eeeda86aa tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:45:03.798721 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-e38fd293-3bb5-40a0-b400-b47eeeda86aa tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:45:04.013637 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-e38fd293-3bb5-40a0-b400-b47eeeda86aa tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96b599f8890b4281a7e311cf37a039e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d7fcab5d3f465793d650f16c6ea8de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:45:04.030062 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-e38fd293-3bb5-40a0-b400-b47eeeda86aa tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96" status: 200 len: 1521 microversion: 2.1 time: 0.247111 Oct 27 15:45:04.031890 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 240/424] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:45:03 2021] GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96 => generated 1521 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 15:45:04.295834 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-d2cc4d9c-f6bd-434c-9805-b789241c770f tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "fc84545b-8b2f-4c24-8262-c2707a11bd28"}} {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 15:45:04.297240 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-d2cc4d9c-f6bd-434c-9805-b789241c770f tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] [instance: f7374bb8-d28b-47a6-a8bd-7ba19de8bd6d] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:45:04.305764 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-d2cc4d9c-f6bd-434c-9805-b789241c770f tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:45:04.306617 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-d2cc4d9c-f6bd-434c-9805-b789241c770f tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:45:04.307667 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-d2cc4d9c-f6bd-434c-9805-b789241c770f tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:45:04.308375 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-d2cc4d9c-f6bd-434c-9805-b789241c770f tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:45:05.575870 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.network.neutron [None req-51156e1d-4e19-4dc3-a03b-10a90ee0bc55 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] validate_networks() for [('4288875b-e618-420b-929c-d1092831a759', None, None, None, None, None)] {{(pid=122225) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Oct 27 15:45:05.921240 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.virt.hardware [None req-51156e1d-4e19-4dc3-a03b-10a90ee0bc55 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Flavor limits 0:0:0 {{(pid=122225) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 15:45:05.921678 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.virt.hardware [None req-51156e1d-4e19-4dc3-a03b-10a90ee0bc55 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Image limits 0:0:0 {{(pid=122225) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 15:45:05.922139 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.virt.hardware [None req-51156e1d-4e19-4dc3-a03b-10a90ee0bc55 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Flavor pref 0:0:0 {{(pid=122225) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 15:45:05.922573 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.virt.hardware [None req-51156e1d-4e19-4dc3-a03b-10a90ee0bc55 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Image pref 0:0:0 {{(pid=122225) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 15:45:05.923110 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.virt.hardware [None req-51156e1d-4e19-4dc3-a03b-10a90ee0bc55 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122225) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 15:45:05.935896 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-51156e1d-4e19-4dc3-a03b-10a90ee0bc55 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:45:05.936267 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-51156e1d-4e19-4dc3-a03b-10a90ee0bc55 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:45:05.937062 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-51156e1d-4e19-4dc3-a03b-10a90ee0bc55 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:45:05.937492 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-51156e1d-4e19-4dc3-a03b-10a90ee0bc55 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:45:05.953790 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.quota [None req-51156e1d-4e19-4dc3-a03b-10a90ee0bc55 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Getting quotas for project f73f3238988e4e1293ad782712a1da53. Resources: {'ram', 'instances', 'cores'} {{(pid=122225) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 27 15:45:05.957717 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.quota [None req-51156e1d-4e19-4dc3-a03b-10a90ee0bc55 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Getting quotas for user 6b6be4749041442787482b6e06b6c40f and project f73f3238988e4e1293ad782712a1da53. Resources: {'ram', 'instances', 'cores'} {{(pid=122225) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 27 15:45:05.968501 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-51156e1d-4e19-4dc3-a03b-10a90ee0bc55 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Going to run 1 instances... {{(pid=122225) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Oct 27 15:45:05.970885 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-51156e1d-4e19-4dc3-a03b-10a90ee0bc55 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] [instance: 013da7c4-ac69-4554-827b-d68e9bac0e54] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b585ffbc-6a36-48c9-81b3-e26f9bd0fcba',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122225) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Oct 27 15:45:06.017609 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-51156e1d-4e19-4dc3-a03b-10a90ee0bc55 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 16.810819 Oct 27 15:45:06.018254 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 185/425] 10.222.0.64 () {60 vars in 1146 bytes} [Wed Oct 27 15:44:49 2021] POST /compute/v2.1/servers => generated 380 bytes in 16812 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 27 15:45:06.024662 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-d617f56e-031f-404e-a6af-b9274d936867 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 15:45:06.025660 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-d617f56e-031f-404e-a6af-b9274d936867 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:45:06.031814 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-d617f56e-031f-404e-a6af-b9274d936867 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:45:06.032315 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-d617f56e-031f-404e-a6af-b9274d936867 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:45:06.033088 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-d617f56e-031f-404e-a6af-b9274d936867 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:45:06.033513 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-d617f56e-031f-404e-a6af-b9274d936867 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:45:07.477549 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-d617f56e-031f-404e-a6af-b9274d936867 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "POST /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672/action" status: 200 len: 38296 microversion: 2.20 time: 1.457977 Oct 27 15:45:07.478720 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 186/426] 10.222.0.64 () {62 vars in 1318 bytes} [Wed Oct 27 15:45:06 2021] POST /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672/action => generated 38296 bytes in 1460 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 27 15:45:07.488510 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-48ceae20-d04c-4b45-80ed-502f90dc1e29 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:45:07.489714 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-48ceae20-d04c-4b45-80ed-502f90dc1e29 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: 62c89161-c119-48b2-839d-712db798ff96] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:45:07.503414 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-48ceae20-d04c-4b45-80ed-502f90dc1e29 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:45:07.504020 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-48ceae20-d04c-4b45-80ed-502f90dc1e29 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:45:07.505592 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-48ceae20-d04c-4b45-80ed-502f90dc1e29 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:45:07.505924 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-48ceae20-d04c-4b45-80ed-502f90dc1e29 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:45:07.558302 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-d2cc4d9c-f6bd-434c-9805-b789241c770f tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] 10.222.0.64 "POST /compute/v2.1/servers/f7374bb8-d28b-47a6-a8bd-7ba19de8bd6d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 3.268484 Oct 27 15:45:07.558920 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 241/427] 10.222.0.64 () {60 vars in 1322 bytes} [Wed Oct 27 15:45:04 2021] POST /compute/v2.1/servers/f7374bb8-d28b-47a6-a8bd-7ba19de8bd6d/os-volume_attachments => generated 194 bytes in 3270 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 15:45:07.587694 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-da9cb3ef-2796-48c5-9e65-ae8e3c23f559 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:45:07.589053 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-da9cb3ef-2796-48c5-9e65-ae8e3c23f559 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] [instance: 013da7c4-ac69-4554-827b-d68e9bac0e54] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:45:07.596582 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-da9cb3ef-2796-48c5-9e65-ae8e3c23f559 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:45:07.597017 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-da9cb3ef-2796-48c5-9e65-ae8e3c23f559 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:45:07.598086 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-da9cb3ef-2796-48c5-9e65-ae8e3c23f559 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:45:07.599215 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-da9cb3ef-2796-48c5-9e65-ae8e3c23f559 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:45:07.703124 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-48ceae20-d04c-4b45-80ed-502f90dc1e29 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96b599f8890b4281a7e311cf37a039e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d7fcab5d3f465793d650f16c6ea8de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:45:07.706479 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-da9cb3ef-2796-48c5-9e65-ae8e3c23f559 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6be4749041442787482b6e06b6c40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73f3238988e4e1293ad782712a1da53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:45:07.711919 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-48ceae20-d04c-4b45-80ed-502f90dc1e29 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96" status: 200 len: 1521 microversion: 2.1 time: 0.231633 Oct 27 15:45:07.712429 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 187/428] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:45:07 2021] GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96 => generated 1521 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 15:45:07.717541 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-8196522e-c554-4a57-8208-2bf8fd849b54 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:45:07.718469 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-8196522e-c554-4a57-8208-2bf8fd849b54 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:45:07.722624 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-da9cb3ef-2796-48c5-9e65-ae8e3c23f559 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] 10.222.0.64 "GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54" status: 200 len: 1215 microversion: 2.1 time: 0.157473 Oct 27 15:45:07.723421 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 242/429] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:45:07 2021] GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54 => generated 1215 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 15:45:07.725283 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-8196522e-c554-4a57-8208-2bf8fd849b54 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:45:07.726022 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-8196522e-c554-4a57-8208-2bf8fd849b54 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:45:07.726834 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-8196522e-c554-4a57-8208-2bf8fd849b54 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:45:07.727270 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-8196522e-c554-4a57-8208-2bf8fd849b54 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:45:07.752335 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-8196522e-c554-4a57-8208-2bf8fd849b54 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672/ips" status: 200 len: 152 microversion: 2.20 time: 0.038620 Oct 27 15:45:07.752924 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 188/430] 10.222.0.64 () {60 vars in 1288 bytes} [Wed Oct 27 15:45:07 2021] GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672/ips => generated 152 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 15:45:08.728663 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-0a79d60c-d1c6-4a46-a12a-9332f51b0d85 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:45:08.729630 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-0a79d60c-d1c6-4a46-a12a-9332f51b0d85 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: 62c89161-c119-48b2-839d-712db798ff96] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:45:08.735545 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-0a79d60c-d1c6-4a46-a12a-9332f51b0d85 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:45:08.739515 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-0a79d60c-d1c6-4a46-a12a-9332f51b0d85 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:45:08.740379 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-0a79d60c-d1c6-4a46-a12a-9332f51b0d85 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:45:08.741848 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-0a79d60c-d1c6-4a46-a12a-9332f51b0d85 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:45:08.741976 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-ea303091-a8e5-40d5-8d28-c95b776ee869 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:45:08.742696 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-ea303091-a8e5-40d5-8d28-c95b776ee869 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] [instance: 013da7c4-ac69-4554-827b-d68e9bac0e54] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:45:08.751145 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-ea303091-a8e5-40d5-8d28-c95b776ee869 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:45:08.759428 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-ea303091-a8e5-40d5-8d28-c95b776ee869 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:45:08.766863 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-ea303091-a8e5-40d5-8d28-c95b776ee869 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:45:08.767525 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-ea303091-a8e5-40d5-8d28-c95b776ee869 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:45:08.850140 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-ea303091-a8e5-40d5-8d28-c95b776ee869 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6be4749041442787482b6e06b6c40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73f3238988e4e1293ad782712a1da53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:45:08.866226 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-ea303091-a8e5-40d5-8d28-c95b776ee869 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] 10.222.0.64 "GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54" status: 200 len: 1277 microversion: 2.1 time: 0.128307 Oct 27 15:45:08.867175 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 189/431] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:45:08 2021] GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54 => generated 1277 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 15:45:08.966216 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-0a79d60c-d1c6-4a46-a12a-9332f51b0d85 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96b599f8890b4281a7e311cf37a039e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d7fcab5d3f465793d650f16c6ea8de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:45:08.976271 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-0a79d60c-d1c6-4a46-a12a-9332f51b0d85 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96" status: 200 len: 1521 microversion: 2.1 time: 0.251009 Oct 27 15:45:08.978069 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 243/432] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:45:08 2021] GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96 => generated 1521 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 15:45:09.884600 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-09ef8738-d020-44d2-81b0-7b92c06fede9 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:45:09.885752 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-09ef8738-d020-44d2-81b0-7b92c06fede9 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] [instance: 013da7c4-ac69-4554-827b-d68e9bac0e54] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:45:09.896452 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-09ef8738-d020-44d2-81b0-7b92c06fede9 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:45:09.896962 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-09ef8738-d020-44d2-81b0-7b92c06fede9 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:45:09.897876 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-09ef8738-d020-44d2-81b0-7b92c06fede9 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:45:09.898553 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-09ef8738-d020-44d2-81b0-7b92c06fede9 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:45:09.996360 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-a6b97eff-5a9a-41f7-a64a-2d26d6bbfad7 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:45:09.997906 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-a6b97eff-5a9a-41f7-a64a-2d26d6bbfad7 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: 62c89161-c119-48b2-839d-712db798ff96] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:45:10.005373 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-a6b97eff-5a9a-41f7-a64a-2d26d6bbfad7 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:45:10.006270 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-a6b97eff-5a9a-41f7-a64a-2d26d6bbfad7 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:45:10.007329 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-a6b97eff-5a9a-41f7-a64a-2d26d6bbfad7 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:45:10.008048 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-a6b97eff-5a9a-41f7-a64a-2d26d6bbfad7 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:45:10.118842 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-09ef8738-d020-44d2-81b0-7b92c06fede9 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6be4749041442787482b6e06b6c40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73f3238988e4e1293ad782712a1da53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:45:10.126774 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-09ef8738-d020-44d2-81b0-7b92c06fede9 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] 10.222.0.64 "GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54" status: 200 len: 1319 microversion: 2.1 time: 0.247422 Oct 27 15:45:10.127385 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 190/433] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:45:09 2021] GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54 => generated 1319 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 15:45:10.252775 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [req-60d1b6d3-f944-4c0f-95d7-334d4dd3c220 req-aa6f4726-0b7d-4099-8476-a9561ec6bd02 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "013da7c4-ac69-4554-827b-d68e9bac0e54", "tag": "5acb6d4d-bbe8-4d7d-b997-03494dc5e0d3"}]} {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 15:45:10.254369 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 27 15:45:10.254369 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: warnings.warn(msg) Oct 27 15:45:10.262013 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [req-60d1b6d3-f944-4c0f-95d7-334d4dd3c220 req-aa6f4726-0b7d-4099-8476-a9561ec6bd02 service nova] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:45:10.262446 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [req-60d1b6d3-f944-4c0f-95d7-334d4dd3c220 req-aa6f4726-0b7d-4099-8476-a9561ec6bd02 service nova] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:45:10.275387 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.compute.server_external_events [req-60d1b6d3-f944-4c0f-95d7-334d4dd3c220 req-aa6f4726-0b7d-4099-8476-a9561ec6bd02 service nova] Creating event network-changed:5acb6d4d-bbe8-4d7d-b997-03494dc5e0d3 for instance 013da7c4-ac69-4554-827b-d68e9bac0e54 on hv-cinder-80070 Oct 27 15:45:10.280878 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [req-60d1b6d3-f944-4c0f-95d7-334d4dd3c220 req-aa6f4726-0b7d-4099-8476-a9561ec6bd02 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031399 Oct 27 15:45:10.281225 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 191/434] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Oct 27 15:45:10 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 15:45:10.338555 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-a6b97eff-5a9a-41f7-a64a-2d26d6bbfad7 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96b599f8890b4281a7e311cf37a039e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d7fcab5d3f465793d650f16c6ea8de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:45:10.349411 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-a6b97eff-5a9a-41f7-a64a-2d26d6bbfad7 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96" status: 200 len: 1521 microversion: 2.1 time: 0.357650 Oct 27 15:45:10.353895 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 244/435] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:45:09 2021] GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96 => generated 1521 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 15:45:10.635509 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-104c388f-830c-41d0-86bf-f1b9fcacc53f tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 15:45:10.636089 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-104c388f-830c-41d0-86bf-f1b9fcacc53f tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:45:10.642636 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-104c388f-830c-41d0-86bf-f1b9fcacc53f tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:45:10.643075 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-104c388f-830c-41d0-86bf-f1b9fcacc53f tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:45:10.643864 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-104c388f-830c-41d0-86bf-f1b9fcacc53f tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:45:10.644301 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-104c388f-830c-41d0-86bf-f1b9fcacc53f tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:45:10.670543 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.objects.instance [None req-104c388f-830c-41d0-86bf-f1b9fcacc53f tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lazy-loading 'flavor' on Instance uuid a115c672-012e-4e45-b5c9-4427e7b66672 {{(pid=122225) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 27 15:45:10.970411 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-104c388f-830c-41d0-86bf-f1b9fcacc53f tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "POST /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672/action" status: 202 len: 0 microversion: 2.20 time: 0.340123 Oct 27 15:45:10.971182 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 192/436] 10.222.0.64 () {62 vars in 1318 bytes} [Wed Oct 27 15:45:10 2021] POST /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672/action => generated 0 bytes in 342 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 27 15:45:10.981934 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-f85a7552-f7eb-44cb-8f0e-39aad98eb1c9 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:45:10.983250 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-f85a7552-f7eb-44cb-8f0e-39aad98eb1c9 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:45:10.991128 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-f85a7552-f7eb-44cb-8f0e-39aad98eb1c9 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:45:10.992319 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-f85a7552-f7eb-44cb-8f0e-39aad98eb1c9 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:45:10.993755 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-f85a7552-f7eb-44cb-8f0e-39aad98eb1c9 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:45:10.994332 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-f85a7552-f7eb-44cb-8f0e-39aad98eb1c9 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:45:11.144755 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-30900a51-d2fa-4e95-a893-ee5fdab4c21b tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:45:11.146448 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-30900a51-d2fa-4e95-a893-ee5fdab4c21b tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] [instance: 013da7c4-ac69-4554-827b-d68e9bac0e54] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:45:11.152998 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-30900a51-d2fa-4e95-a893-ee5fdab4c21b tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:45:11.153552 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-30900a51-d2fa-4e95-a893-ee5fdab4c21b tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:45:11.154336 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-30900a51-d2fa-4e95-a893-ee5fdab4c21b tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:45:11.154769 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-30900a51-d2fa-4e95-a893-ee5fdab4c21b tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:45:11.215419 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-f85a7552-f7eb-44cb-8f0e-39aad98eb1c9 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:45:11.223398 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-f85a7552-f7eb-44cb-8f0e-39aad98eb1c9 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:45:11.225447 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-f85a7552-f7eb-44cb-8f0e-39aad98eb1c9 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:45:11.226608 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-f85a7552-f7eb-44cb-8f0e-39aad98eb1c9 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672" status: 200 len: 1725 microversion: 2.20 time: 0.250270 Oct 27 15:45:11.227169 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 245/437] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Oct 27 15:45:10 2021] GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672 => generated 1725 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 15:45:11.371826 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-c8c8a7e2-fe8f-4f9f-8968-bda8504167e2 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:45:11.372942 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-c8c8a7e2-fe8f-4f9f-8968-bda8504167e2 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: 62c89161-c119-48b2-839d-712db798ff96] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:45:11.384071 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-c8c8a7e2-fe8f-4f9f-8968-bda8504167e2 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:45:11.384783 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-c8c8a7e2-fe8f-4f9f-8968-bda8504167e2 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:45:11.385696 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-c8c8a7e2-fe8f-4f9f-8968-bda8504167e2 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:45:11.386279 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-c8c8a7e2-fe8f-4f9f-8968-bda8504167e2 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:45:11.397135 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-30900a51-d2fa-4e95-a893-ee5fdab4c21b tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6be4749041442787482b6e06b6c40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73f3238988e4e1293ad782712a1da53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:45:11.418553 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-30900a51-d2fa-4e95-a893-ee5fdab4c21b tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] 10.222.0.64 "GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54" status: 200 len: 1319 microversion: 2.1 time: 0.278077 Oct 27 15:45:11.424480 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 193/438] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:45:11 2021] GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54 => generated 1319 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 15:45:11.617168 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-c8c8a7e2-fe8f-4f9f-8968-bda8504167e2 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96b599f8890b4281a7e311cf37a039e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d7fcab5d3f465793d650f16c6ea8de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:45:11.626181 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-c8c8a7e2-fe8f-4f9f-8968-bda8504167e2 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96" status: 200 len: 1521 microversion: 2.1 time: 0.258732 Oct 27 15:45:11.626898 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 246/439] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:45:11 2021] GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96 => generated 1521 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 15:45:12.245809 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-9a93e112-774e-4d6c-91bc-3e16d8527e68 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:45:12.246397 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-9a93e112-774e-4d6c-91bc-3e16d8527e68 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:45:12.252765 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-9a93e112-774e-4d6c-91bc-3e16d8527e68 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:45:12.253211 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-9a93e112-774e-4d6c-91bc-3e16d8527e68 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:45:12.253972 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-9a93e112-774e-4d6c-91bc-3e16d8527e68 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:45:12.254405 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-9a93e112-774e-4d6c-91bc-3e16d8527e68 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:45:12.380024 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-9a93e112-774e-4d6c-91bc-3e16d8527e68 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:45:12.387758 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-9a93e112-774e-4d6c-91bc-3e16d8527e68 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:45:12.389282 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-9a93e112-774e-4d6c-91bc-3e16d8527e68 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:45:12.390428 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-9a93e112-774e-4d6c-91bc-3e16d8527e68 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672" status: 200 len: 1725 microversion: 2.20 time: 0.148366 Oct 27 15:45:12.390977 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 194/440] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Oct 27 15:45:12 2021] GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672 => generated 1725 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 15:45:12.438225 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-faa14528-76fa-4b4a-8707-3e7fa78dcf32 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:45:12.438833 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-faa14528-76fa-4b4a-8707-3e7fa78dcf32 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] [instance: 013da7c4-ac69-4554-827b-d68e9bac0e54] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:45:12.445700 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-faa14528-76fa-4b4a-8707-3e7fa78dcf32 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:45:12.446184 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-faa14528-76fa-4b4a-8707-3e7fa78dcf32 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:45:12.446963 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-faa14528-76fa-4b4a-8707-3e7fa78dcf32 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:45:12.447396 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-faa14528-76fa-4b4a-8707-3e7fa78dcf32 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:45:12.566700 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-faa14528-76fa-4b4a-8707-3e7fa78dcf32 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6be4749041442787482b6e06b6c40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73f3238988e4e1293ad782712a1da53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:45:12.574635 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-faa14528-76fa-4b4a-8707-3e7fa78dcf32 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] 10.222.0.64 "GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54" status: 200 len: 1319 microversion: 2.1 time: 0.140970 Oct 27 15:45:12.575198 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 247/441] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:45:12 2021] GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54 => generated 1319 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 15:45:12.644393 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-e6d3bc4e-36ba-4d3f-8208-288167ef122e tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:45:12.645058 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-e6d3bc4e-36ba-4d3f-8208-288167ef122e tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: 62c89161-c119-48b2-839d-712db798ff96] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:45:12.652711 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-e6d3bc4e-36ba-4d3f-8208-288167ef122e tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:45:12.653180 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-e6d3bc4e-36ba-4d3f-8208-288167ef122e tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:45:12.654019 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-e6d3bc4e-36ba-4d3f-8208-288167ef122e tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:45:12.654585 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-e6d3bc4e-36ba-4d3f-8208-288167ef122e tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:45:12.791441 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-e6d3bc4e-36ba-4d3f-8208-288167ef122e tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96b599f8890b4281a7e311cf37a039e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d7fcab5d3f465793d650f16c6ea8de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:45:12.798673 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-e6d3bc4e-36ba-4d3f-8208-288167ef122e tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96" status: 200 len: 1501 microversion: 2.1 time: 0.158932 Oct 27 15:45:12.799232 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 195/442] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:45:12 2021] GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96 => generated 1501 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 15:45:12.815814 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-22743c10-faf8-4d24-a34c-8476a92a72e7 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7d6380c3-fbe3-4b59-9059-b2e8d6169b4d"}} {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 15:45:12.817048 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-22743c10-faf8-4d24-a34c-8476a92a72e7 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: 62c89161-c119-48b2-839d-712db798ff96] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:45:12.823705 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-22743c10-faf8-4d24-a34c-8476a92a72e7 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:45:12.824334 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-22743c10-faf8-4d24-a34c-8476a92a72e7 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:45:12.825376 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-22743c10-faf8-4d24-a34c-8476a92a72e7 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:45:12.825939 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-22743c10-faf8-4d24-a34c-8476a92a72e7 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:45:12.850416 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.wsgi [None req-22743c10-faf8-4d24-a34c-8476a92a72e7 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] HTTP exception thrown: Cannot 'attach_volume' instance 62c89161-c119-48b2-839d-712db798ff96 while it is in vm_state rescued Oct 27 15:45:12.851016 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-22743c10-faf8-4d24-a34c-8476a92a72e7 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Returning 409 to user: Cannot 'attach_volume' instance 62c89161-c119-48b2-839d-712db798ff96 while it is in vm_state rescued {{(pid=122224) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 27 15:45:12.851840 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-22743c10-faf8-4d24-a34c-8476a92a72e7 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "POST /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.040356 Oct 27 15:45:12.852404 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 248/443] 10.222.0.64 () {60 vars in 1322 bytes} [Wed Oct 27 15:45:12 2021] POST /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments => generated 152 bytes in 41 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 27 15:45:12.860781 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-c9a45391-d5f3-4c15-893c-96ba2c681d1b tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 15:45:12.861331 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-c9a45391-d5f3-4c15-893c-96ba2c681d1b tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: 62c89161-c119-48b2-839d-712db798ff96] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:45:12.867297 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-c9a45391-d5f3-4c15-893c-96ba2c681d1b tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:45:12.867744 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-c9a45391-d5f3-4c15-893c-96ba2c681d1b tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:45:12.868670 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-c9a45391-d5f3-4c15-893c-96ba2c681d1b tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:45:12.869104 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-c9a45391-d5f3-4c15-893c-96ba2c681d1b tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:45:12.936479 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-c9a45391-d5f3-4c15-893c-96ba2c681d1b tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "POST /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/action" status: 202 len: 0 microversion: 2.1 time: 0.079172 Oct 27 15:45:12.940177 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 196/444] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Oct 27 15:45:12 2021] POST /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/action => generated 0 bytes in 81 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 27 15:45:12.945303 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-2d39993c-328b-4c98-b557-9f493c94ba29 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:45:12.945920 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-2d39993c-328b-4c98-b557-9f493c94ba29 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: 62c89161-c119-48b2-839d-712db798ff96] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:45:12.952298 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-2d39993c-328b-4c98-b557-9f493c94ba29 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:45:12.952749 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-2d39993c-328b-4c98-b557-9f493c94ba29 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:45:12.953527 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-2d39993c-328b-4c98-b557-9f493c94ba29 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:45:12.953962 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-2d39993c-328b-4c98-b557-9f493c94ba29 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:45:13.154498 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-2d39993c-328b-4c98-b557-9f493c94ba29 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96b599f8890b4281a7e311cf37a039e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d7fcab5d3f465793d650f16c6ea8de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:45:13.162263 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-2d39993c-328b-4c98-b557-9f493c94ba29 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96" status: 200 len: 1509 microversion: 2.1 time: 0.220715 Oct 27 15:45:13.162923 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 249/445] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:45:12 2021] GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96 => generated 1509 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 15:45:13.410082 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-8d157e98-8b63-44fb-ba14-6f0479a02594 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:45:13.410931 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-8d157e98-8b63-44fb-ba14-6f0479a02594 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:45:13.417083 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-8d157e98-8b63-44fb-ba14-6f0479a02594 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:45:13.417532 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-8d157e98-8b63-44fb-ba14-6f0479a02594 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:45:13.418304 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-8d157e98-8b63-44fb-ba14-6f0479a02594 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:45:13.418737 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-8d157e98-8b63-44fb-ba14-6f0479a02594 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:45:13.542068 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-8d157e98-8b63-44fb-ba14-6f0479a02594 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:45:13.549759 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-8d157e98-8b63-44fb-ba14-6f0479a02594 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:45:13.551259 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-8d157e98-8b63-44fb-ba14-6f0479a02594 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:45:13.553677 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-8d157e98-8b63-44fb-ba14-6f0479a02594 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672" status: 200 len: 1725 microversion: 2.20 time: 0.148212 Oct 27 15:45:13.554241 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 197/446] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Oct 27 15:45:13 2021] GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672 => generated 1725 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 15:45:13.592275 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-c38cec95-b252-4d2d-b766-80710e98422f tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:45:13.592888 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-c38cec95-b252-4d2d-b766-80710e98422f tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] [instance: 013da7c4-ac69-4554-827b-d68e9bac0e54] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:45:13.600044 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-c38cec95-b252-4d2d-b766-80710e98422f tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:45:13.600600 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-c38cec95-b252-4d2d-b766-80710e98422f tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:45:13.601384 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-c38cec95-b252-4d2d-b766-80710e98422f tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:45:13.601815 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-c38cec95-b252-4d2d-b766-80710e98422f tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:45:13.729777 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-c38cec95-b252-4d2d-b766-80710e98422f tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6be4749041442787482b6e06b6c40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73f3238988e4e1293ad782712a1da53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:45:13.736915 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-c38cec95-b252-4d2d-b766-80710e98422f tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] 10.222.0.64 "GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54" status: 200 len: 1319 microversion: 2.1 time: 0.148446 Oct 27 15:45:13.737472 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 250/447] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:45:13 2021] GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54 => generated 1319 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 15:45:14.179413 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-f3c6165e-0943-4e48-9c14-76f0205d4b11 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:45:14.180155 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-f3c6165e-0943-4e48-9c14-76f0205d4b11 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: 62c89161-c119-48b2-839d-712db798ff96] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:45:14.186239 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-f3c6165e-0943-4e48-9c14-76f0205d4b11 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:45:14.186683 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-f3c6165e-0943-4e48-9c14-76f0205d4b11 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:45:14.187467 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-f3c6165e-0943-4e48-9c14-76f0205d4b11 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:45:14.187929 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-f3c6165e-0943-4e48-9c14-76f0205d4b11 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:45:14.396489 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-f3c6165e-0943-4e48-9c14-76f0205d4b11 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96b599f8890b4281a7e311cf37a039e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d7fcab5d3f465793d650f16c6ea8de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:45:14.404219 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-f3c6165e-0943-4e48-9c14-76f0205d4b11 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96" status: 200 len: 1509 microversion: 2.1 time: 0.228474 Oct 27 15:45:14.404945 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 198/448] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:45:14 2021] GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96 => generated 1509 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 15:45:14.573553 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-c122af0e-a39c-4dd4-b130-e4787863a25e tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:45:14.574335 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-c122af0e-a39c-4dd4-b130-e4787863a25e tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:45:14.580618 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-c122af0e-a39c-4dd4-b130-e4787863a25e tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:45:14.581159 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-c122af0e-a39c-4dd4-b130-e4787863a25e tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:45:14.582068 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-c122af0e-a39c-4dd4-b130-e4787863a25e tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:45:14.583250 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-c122af0e-a39c-4dd4-b130-e4787863a25e tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:45:14.759771 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-86f20efa-74ae-4aae-8111-4750537a8cfc tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:45:14.761198 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-86f20efa-74ae-4aae-8111-4750537a8cfc tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] [instance: 013da7c4-ac69-4554-827b-d68e9bac0e54] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:45:14.769415 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-c122af0e-a39c-4dd4-b130-e4787863a25e tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:45:14.781598 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-c122af0e-a39c-4dd4-b130-e4787863a25e tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:45:14.783373 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-c122af0e-a39c-4dd4-b130-e4787863a25e tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:45:14.784979 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-c122af0e-a39c-4dd4-b130-e4787863a25e tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672" status: 200 len: 1725 microversion: 2.20 time: 0.215812 Oct 27 15:45:14.786185 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-86f20efa-74ae-4aae-8111-4750537a8cfc tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:45:14.786679 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 251/449] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Oct 27 15:45:14 2021] GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672 => generated 1725 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 15:45:14.787323 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-86f20efa-74ae-4aae-8111-4750537a8cfc tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:45:14.789861 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-86f20efa-74ae-4aae-8111-4750537a8cfc tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:45:14.791050 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-86f20efa-74ae-4aae-8111-4750537a8cfc tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:45:14.949127 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-86f20efa-74ae-4aae-8111-4750537a8cfc tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6be4749041442787482b6e06b6c40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73f3238988e4e1293ad782712a1da53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:45:14.956583 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-86f20efa-74ae-4aae-8111-4750537a8cfc tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] 10.222.0.64 "GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54" status: 200 len: 1319 microversion: 2.1 time: 0.205868 Oct 27 15:45:14.957148 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 199/450] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:45:14 2021] GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54 => generated 1319 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 15:45:15.424037 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-2fe68dd7-5fed-4a0f-9562-db11462b1696 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:45:15.424799 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-2fe68dd7-5fed-4a0f-9562-db11462b1696 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: 62c89161-c119-48b2-839d-712db798ff96] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:45:15.431425 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-2fe68dd7-5fed-4a0f-9562-db11462b1696 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:45:15.432083 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-2fe68dd7-5fed-4a0f-9562-db11462b1696 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:45:15.432932 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-2fe68dd7-5fed-4a0f-9562-db11462b1696 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:45:15.433568 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-2fe68dd7-5fed-4a0f-9562-db11462b1696 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:45:15.608963 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-2fe68dd7-5fed-4a0f-9562-db11462b1696 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96b599f8890b4281a7e311cf37a039e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d7fcab5d3f465793d650f16c6ea8de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:45:15.617385 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-2fe68dd7-5fed-4a0f-9562-db11462b1696 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96" status: 200 len: 1509 microversion: 2.1 time: 0.198964 Oct 27 15:45:15.618012 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 252/451] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:45:15 2021] GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96 => generated 1509 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 15:45:15.816061 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-89fb47b5-0a86-4a3d-8b1d-c905583494a0 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:45:15.816667 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-89fb47b5-0a86-4a3d-8b1d-c905583494a0 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:45:15.823811 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-89fb47b5-0a86-4a3d-8b1d-c905583494a0 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:45:15.824296 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-89fb47b5-0a86-4a3d-8b1d-c905583494a0 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:45:15.825078 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-89fb47b5-0a86-4a3d-8b1d-c905583494a0 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:45:15.825513 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-89fb47b5-0a86-4a3d-8b1d-c905583494a0 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:45:15.976073 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-6d1dc30c-6b50-49a7-9801-52a18dbc146e tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:45:15.977676 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-6d1dc30c-6b50-49a7-9801-52a18dbc146e tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] [instance: 013da7c4-ac69-4554-827b-d68e9bac0e54] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:45:15.990214 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-6d1dc30c-6b50-49a7-9801-52a18dbc146e tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:45:15.991201 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-6d1dc30c-6b50-49a7-9801-52a18dbc146e tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:45:15.992661 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-6d1dc30c-6b50-49a7-9801-52a18dbc146e tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:45:15.993805 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-6d1dc30c-6b50-49a7-9801-52a18dbc146e tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:45:16.046826 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-89fb47b5-0a86-4a3d-8b1d-c905583494a0 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:45:16.059420 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-89fb47b5-0a86-4a3d-8b1d-c905583494a0 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:45:16.061731 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-89fb47b5-0a86-4a3d-8b1d-c905583494a0 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:45:16.063385 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-89fb47b5-0a86-4a3d-8b1d-c905583494a0 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672" status: 200 len: 1725 microversion: 2.20 time: 0.250881 Oct 27 15:45:16.076250 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 200/452] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Oct 27 15:45:15 2021] GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672 => generated 1725 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 15:45:16.157471 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-6d1dc30c-6b50-49a7-9801-52a18dbc146e tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6be4749041442787482b6e06b6c40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73f3238988e4e1293ad782712a1da53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:45:16.178919 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-6d1dc30c-6b50-49a7-9801-52a18dbc146e tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] 10.222.0.64 "GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54" status: 200 len: 1319 microversion: 2.1 time: 0.208679 Oct 27 15:45:16.179685 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 253/453] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:45:15 2021] GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54 => generated 1319 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 15:45:16.297798 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-56a78840-5b5f-4a71-9486-f1d862e5a178 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:45:16.298287 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-56a78840-5b5f-4a71-9486-f1d862e5a178 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] [instance: f7374bb8-d28b-47a6-a8bd-7ba19de8bd6d] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:45:16.306134 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-56a78840-5b5f-4a71-9486-f1d862e5a178 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:45:16.306814 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-56a78840-5b5f-4a71-9486-f1d862e5a178 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:45:16.307589 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-56a78840-5b5f-4a71-9486-f1d862e5a178 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:45:16.308052 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-56a78840-5b5f-4a71-9486-f1d862e5a178 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:45:16.406210 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.objects.instance [None req-56a78840-5b5f-4a71-9486-f1d862e5a178 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lazy-loading 'services' on Instance uuid f7374bb8-d28b-47a6-a8bd-7ba19de8bd6d {{(pid=122225) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 27 15:45:16.491371 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-56a78840-5b5f-4a71-9486-f1d862e5a178 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] 10.222.0.64 "DELETE /compute/v2.1/servers/f7374bb8-d28b-47a6-a8bd-7ba19de8bd6d/os-volume_attachments/fc84545b-8b2f-4c24-8262-c2707a11bd28" status: 202 len: 0 microversion: 2.1 time: 0.197475 Oct 27 15:45:16.492161 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 201/454] 10.222.0.64 () {58 vars in 1415 bytes} [Wed Oct 27 15:45:16 2021] DELETE /compute/v2.1/servers/f7374bb8-d28b-47a6-a8bd-7ba19de8bd6d/os-volume_attachments/fc84545b-8b2f-4c24-8262-c2707a11bd28 => generated 0 bytes in 199 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 15:45:16.503727 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-2adcd457-a289-4724-bbe4-ab01761ca74b tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:45:16.517098 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-2adcd457-a289-4724-bbe4-ab01761ca74b tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] [instance: f7374bb8-d28b-47a6-a8bd-7ba19de8bd6d] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:45:16.526525 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-2adcd457-a289-4724-bbe4-ab01761ca74b tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:45:16.527909 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-2adcd457-a289-4724-bbe4-ab01761ca74b tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:45:16.528789 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-2adcd457-a289-4724-bbe4-ab01761ca74b tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:45:16.529314 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-2adcd457-a289-4724-bbe4-ab01761ca74b tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:45:16.575180 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-2adcd457-a289-4724-bbe4-ab01761ca74b tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] 10.222.0.64 "GET /compute/v2.1/servers/f7374bb8-d28b-47a6-a8bd-7ba19de8bd6d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.076909 Oct 27 15:45:16.578306 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 254/455] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Oct 27 15:45:16 2021] GET /compute/v2.1/servers/f7374bb8-d28b-47a6-a8bd-7ba19de8bd6d/os-volume_attachments => generated 197 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 15:45:16.639594 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-dd82f466-6fb9-4aa9-bef4-0b5cf13e2636 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:45:16.640862 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-dd82f466-6fb9-4aa9-bef4-0b5cf13e2636 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: 62c89161-c119-48b2-839d-712db798ff96] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:45:16.652127 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-dd82f466-6fb9-4aa9-bef4-0b5cf13e2636 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:45:16.652840 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-dd82f466-6fb9-4aa9-bef4-0b5cf13e2636 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:45:16.654372 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-dd82f466-6fb9-4aa9-bef4-0b5cf13e2636 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:45:16.655106 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-dd82f466-6fb9-4aa9-bef4-0b5cf13e2636 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:45:16.912571 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-dd82f466-6fb9-4aa9-bef4-0b5cf13e2636 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96b599f8890b4281a7e311cf37a039e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d7fcab5d3f465793d650f16c6ea8de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:45:16.920083 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-dd82f466-6fb9-4aa9-bef4-0b5cf13e2636 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96" status: 200 len: 1509 microversion: 2.1 time: 0.287766 Oct 27 15:45:16.920659 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 202/456] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:45:16 2021] GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96 => generated 1509 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 15:45:17.085834 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-b259dd3b-c1d9-48f9-80c2-78d134288d19 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:45:17.087195 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-b259dd3b-c1d9-48f9-80c2-78d134288d19 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:45:17.095211 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-b259dd3b-c1d9-48f9-80c2-78d134288d19 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:45:17.095653 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-b259dd3b-c1d9-48f9-80c2-78d134288d19 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:45:17.096502 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-b259dd3b-c1d9-48f9-80c2-78d134288d19 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:45:17.096888 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-b259dd3b-c1d9-48f9-80c2-78d134288d19 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:45:17.198491 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-ec1fda52-7824-4cd2-a43a-3d5ec96e3b87 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:45:17.199343 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-ec1fda52-7824-4cd2-a43a-3d5ec96e3b87 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] [instance: 013da7c4-ac69-4554-827b-d68e9bac0e54] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:45:17.206045 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-ec1fda52-7824-4cd2-a43a-3d5ec96e3b87 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:45:17.206490 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-ec1fda52-7824-4cd2-a43a-3d5ec96e3b87 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:45:17.207274 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-ec1fda52-7824-4cd2-a43a-3d5ec96e3b87 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:45:17.208521 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-ec1fda52-7824-4cd2-a43a-3d5ec96e3b87 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:45:17.342650 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-b259dd3b-c1d9-48f9-80c2-78d134288d19 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:45:17.354598 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-b259dd3b-c1d9-48f9-80c2-78d134288d19 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:45:17.356302 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-b259dd3b-c1d9-48f9-80c2-78d134288d19 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:45:17.357523 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-b259dd3b-c1d9-48f9-80c2-78d134288d19 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672" status: 200 len: 1725 microversion: 2.20 time: 0.278177 Oct 27 15:45:17.358810 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 255/457] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Oct 27 15:45:17 2021] GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672 => generated 1725 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 15:45:17.404125 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-ec1fda52-7824-4cd2-a43a-3d5ec96e3b87 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6be4749041442787482b6e06b6c40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73f3238988e4e1293ad782712a1da53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:45:17.412993 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-ec1fda52-7824-4cd2-a43a-3d5ec96e3b87 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] 10.222.0.64 "GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54" status: 200 len: 1319 microversion: 2.1 time: 0.219593 Oct 27 15:45:17.414454 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 203/458] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:45:17 2021] GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54 => generated 1319 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 15:45:17.588162 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-c3fe5caa-5e9a-41e2-bbce-7807c7243bac tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:45:17.589161 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-c3fe5caa-5e9a-41e2-bbce-7807c7243bac tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] [instance: f7374bb8-d28b-47a6-a8bd-7ba19de8bd6d] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:45:17.595059 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-c3fe5caa-5e9a-41e2-bbce-7807c7243bac tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:45:17.595507 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-c3fe5caa-5e9a-41e2-bbce-7807c7243bac tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:45:17.596313 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-c3fe5caa-5e9a-41e2-bbce-7807c7243bac tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:45:17.596747 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-c3fe5caa-5e9a-41e2-bbce-7807c7243bac tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:45:17.634295 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-c3fe5caa-5e9a-41e2-bbce-7807c7243bac tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] 10.222.0.64 "GET /compute/v2.1/servers/f7374bb8-d28b-47a6-a8bd-7ba19de8bd6d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051112 Oct 27 15:45:17.634966 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 256/459] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Oct 27 15:45:17 2021] GET /compute/v2.1/servers/f7374bb8-d28b-47a6-a8bd-7ba19de8bd6d/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 15:45:17.940755 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-080d4a5d-6466-40c9-9f6d-3ed5d0bc10f7 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:45:17.941374 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-080d4a5d-6466-40c9-9f6d-3ed5d0bc10f7 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: 62c89161-c119-48b2-839d-712db798ff96] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:45:17.949221 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-080d4a5d-6466-40c9-9f6d-3ed5d0bc10f7 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:45:17.949957 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-080d4a5d-6466-40c9-9f6d-3ed5d0bc10f7 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:45:17.950907 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-080d4a5d-6466-40c9-9f6d-3ed5d0bc10f7 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:45:17.951496 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-080d4a5d-6466-40c9-9f6d-3ed5d0bc10f7 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:45:18.092074 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-080d4a5d-6466-40c9-9f6d-3ed5d0bc10f7 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96b599f8890b4281a7e311cf37a039e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d7fcab5d3f465793d650f16c6ea8de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:45:18.101856 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-080d4a5d-6466-40c9-9f6d-3ed5d0bc10f7 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96" status: 200 len: 1515 microversion: 2.1 time: 0.164713 Oct 27 15:45:18.104142 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 204/460] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:45:17 2021] GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96 => generated 1515 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 15:45:18.379738 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-702af0ce-509d-42bc-b68a-30943ae6eb4e tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:45:18.380364 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-702af0ce-509d-42bc-b68a-30943ae6eb4e tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:45:18.393275 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-702af0ce-509d-42bc-b68a-30943ae6eb4e tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:45:18.398129 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-702af0ce-509d-42bc-b68a-30943ae6eb4e tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:45:18.401194 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-702af0ce-509d-42bc-b68a-30943ae6eb4e tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:45:18.401896 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-702af0ce-509d-42bc-b68a-30943ae6eb4e tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:45:18.433241 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-0326e633-f9eb-4186-82c1-4a746550a7e7 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:45:18.433765 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-0326e633-f9eb-4186-82c1-4a746550a7e7 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] [instance: 013da7c4-ac69-4554-827b-d68e9bac0e54] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:45:18.452431 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-0326e633-f9eb-4186-82c1-4a746550a7e7 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:45:18.453079 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-0326e633-f9eb-4186-82c1-4a746550a7e7 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:45:18.454146 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-0326e633-f9eb-4186-82c1-4a746550a7e7 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:45:18.457001 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-0326e633-f9eb-4186-82c1-4a746550a7e7 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:45:18.668766 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-702af0ce-509d-42bc-b68a-30943ae6eb4e tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:45:18.682505 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-702af0ce-509d-42bc-b68a-30943ae6eb4e tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:45:18.685310 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-702af0ce-509d-42bc-b68a-30943ae6eb4e tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:45:18.688383 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-702af0ce-509d-42bc-b68a-30943ae6eb4e tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672" status: 200 len: 1725 microversion: 2.20 time: 0.311457 Oct 27 15:45:18.703515 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 257/461] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Oct 27 15:45:18 2021] GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672 => generated 1725 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 15:45:18.720586 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-b0424a27-79b0-4b21-a273-b8922bb45d10 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:45:18.722376 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-b0424a27-79b0-4b21-a273-b8922bb45d10 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] [instance: f7374bb8-d28b-47a6-a8bd-7ba19de8bd6d] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:45:18.732586 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-b0424a27-79b0-4b21-a273-b8922bb45d10 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:45:18.734270 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-b0424a27-79b0-4b21-a273-b8922bb45d10 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:45:18.736831 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-b0424a27-79b0-4b21-a273-b8922bb45d10 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:45:18.737635 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-b0424a27-79b0-4b21-a273-b8922bb45d10 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:45:18.787800 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-0326e633-f9eb-4186-82c1-4a746550a7e7 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6be4749041442787482b6e06b6c40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73f3238988e4e1293ad782712a1da53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:45:18.800013 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-b0424a27-79b0-4b21-a273-b8922bb45d10 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] 10.222.0.64 "GET /compute/v2.1/servers/f7374bb8-d28b-47a6-a8bd-7ba19de8bd6d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.093574 Oct 27 15:45:18.807421 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 258/462] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Oct 27 15:45:18 2021] GET /compute/v2.1/servers/f7374bb8-d28b-47a6-a8bd-7ba19de8bd6d/os-volume_attachments => generated 25 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 27 15:45:18.808846 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-0326e633-f9eb-4186-82c1-4a746550a7e7 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] 10.222.0.64 "GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54" status: 200 len: 1319 microversion: 2.1 time: 0.378606 Oct 27 15:45:18.809637 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 205/463] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:45:18 2021] GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54 => generated 1319 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 15:45:19.029962 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [req-81ace504-53ee-4181-bacb-ac9a0f961ef1 req-db718529-1007-4966-8976-4f1bc37065ad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "013da7c4-ac69-4554-827b-d68e9bac0e54", "name": "network-vif-plugged", "status": "completed", "tag": "5acb6d4d-bbe8-4d7d-b997-03494dc5e0d3"}]} {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 15:45:19.031706 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 27 15:45:19.031706 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: warnings.warn(msg) Oct 27 15:45:19.039763 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [req-81ace504-53ee-4181-bacb-ac9a0f961ef1 req-db718529-1007-4966-8976-4f1bc37065ad service nova] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:45:19.040365 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [req-81ace504-53ee-4181-bacb-ac9a0f961ef1 req-db718529-1007-4966-8976-4f1bc37065ad service nova] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:45:19.062027 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.compute.server_external_events [req-81ace504-53ee-4181-bacb-ac9a0f961ef1 req-db718529-1007-4966-8976-4f1bc37065ad service nova] Creating event network-vif-plugged:5acb6d4d-bbe8-4d7d-b997-03494dc5e0d3 for instance 013da7c4-ac69-4554-827b-d68e9bac0e54 on hv-cinder-80070 Oct 27 15:45:19.069568 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [req-81ace504-53ee-4181-bacb-ac9a0f961ef1 req-db718529-1007-4966-8976-4f1bc37065ad service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045121 Oct 27 15:45:19.070919 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 259/464] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Oct 27 15:45:19 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 15:45:19.575584 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-7c903dc6-398c-4f09-8bf7-a0bca911eb39 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:45:19.576260 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-7c903dc6-398c-4f09-8bf7-a0bca911eb39 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: 62c89161-c119-48b2-839d-712db798ff96] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:45:19.583925 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-7c903dc6-398c-4f09-8bf7-a0bca911eb39 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:45:19.584403 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-7c903dc6-398c-4f09-8bf7-a0bca911eb39 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:45:19.585182 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-7c903dc6-398c-4f09-8bf7-a0bca911eb39 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:45:19.586767 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-7c903dc6-398c-4f09-8bf7-a0bca911eb39 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:45:19.709805 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-073d848c-2536-4db8-94f7-320d91f5c8a4 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:45:19.710510 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-073d848c-2536-4db8-94f7-320d91f5c8a4 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:45:19.724050 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-073d848c-2536-4db8-94f7-320d91f5c8a4 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:45:19.725054 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-073d848c-2536-4db8-94f7-320d91f5c8a4 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:45:19.725945 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-073d848c-2536-4db8-94f7-320d91f5c8a4 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:45:19.726393 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-073d848c-2536-4db8-94f7-320d91f5c8a4 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:45:19.793230 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-7c903dc6-398c-4f09-8bf7-a0bca911eb39 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96b599f8890b4281a7e311cf37a039e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d7fcab5d3f465793d650f16c6ea8de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:45:19.806731 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-7c903dc6-398c-4f09-8bf7-a0bca911eb39 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96" status: 200 len: 1515 microversion: 2.1 time: 0.239357 Oct 27 15:45:19.807840 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 206/465] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:45:19 2021] GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96 => generated 1515 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 15:45:19.826380 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-967f0a3b-c6c6-4076-96d3-7354b40d951b tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1a159978-aec1-4494-8cf3-0edd45b0ae39"}} {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 15:45:19.827536 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-967f0a3b-c6c6-4076-96d3-7354b40d951b tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: 62c89161-c119-48b2-839d-712db798ff96] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:45:19.836893 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-967f0a3b-c6c6-4076-96d3-7354b40d951b tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:45:19.837712 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-967f0a3b-c6c6-4076-96d3-7354b40d951b tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:45:19.838767 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-967f0a3b-c6c6-4076-96d3-7354b40d951b tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:45:19.839416 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-967f0a3b-c6c6-4076-96d3-7354b40d951b tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:45:19.933784 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-073d848c-2536-4db8-94f7-320d91f5c8a4 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:45:19.945096 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-073d848c-2536-4db8-94f7-320d91f5c8a4 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:45:19.946726 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-073d848c-2536-4db8-94f7-320d91f5c8a4 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:45:19.948234 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-073d848c-2536-4db8-94f7-320d91f5c8a4 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672" status: 200 len: 1725 microversion: 2.20 time: 0.243015 Oct 27 15:45:19.949274 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 260/466] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Oct 27 15:45:19 2021] GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672 => generated 1725 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 15:45:19.954060 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-ed46aecd-10f1-460d-b45c-085da6b2f928 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:45:19.954939 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-ed46aecd-10f1-460d-b45c-085da6b2f928 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] [instance: 013da7c4-ac69-4554-827b-d68e9bac0e54] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:45:19.961917 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-ed46aecd-10f1-460d-b45c-085da6b2f928 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:45:19.962795 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-ed46aecd-10f1-460d-b45c-085da6b2f928 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:45:19.963843 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-ed46aecd-10f1-460d-b45c-085da6b2f928 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:45:19.964469 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-ed46aecd-10f1-460d-b45c-085da6b2f928 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:45:20.192338 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-ed46aecd-10f1-460d-b45c-085da6b2f928 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6be4749041442787482b6e06b6c40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73f3238988e4e1293ad782712a1da53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:45:20.201394 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-ed46aecd-10f1-460d-b45c-085da6b2f928 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] 10.222.0.64 "GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54" status: 200 len: 1319 microversion: 2.1 time: 0.250652 Oct 27 15:45:20.204757 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 261/467] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:45:19 2021] GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54 => generated 1319 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 15:45:20.215308 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-b31d237c-9716-4c47-a3ca-0e1d2c096b33 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:45:20.216467 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-b31d237c-9716-4c47-a3ca-0e1d2c096b33 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] [instance: f7374bb8-d28b-47a6-a8bd-7ba19de8bd6d] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:45:20.225954 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-b31d237c-9716-4c47-a3ca-0e1d2c096b33 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:45:20.226971 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-b31d237c-9716-4c47-a3ca-0e1d2c096b33 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:45:20.229099 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-b31d237c-9716-4c47-a3ca-0e1d2c096b33 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:45:20.229552 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-b31d237c-9716-4c47-a3ca-0e1d2c096b33 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:45:20.263304 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-b31d237c-9716-4c47-a3ca-0e1d2c096b33 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] [instance: f7374bb8-d28b-47a6-a8bd-7ba19de8bd6d] Going to try to terminate instance {{(pid=122224) delete /opt/stack/nova/nova/compute/api.py:2612}} Oct 27 15:45:20.297360 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-967f0a3b-c6c6-4076-96d3-7354b40d951b tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "POST /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.475381 Oct 27 15:45:20.299614 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 207/468] 10.222.0.64 () {60 vars in 1322 bytes} [Wed Oct 27 15:45:19 2021] POST /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments => generated 194 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 15:45:20.459895 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-b31d237c-9716-4c47-a3ca-0e1d2c096b33 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] 10.222.0.64 "DELETE /compute/v2.1/servers/f7374bb8-d28b-47a6-a8bd-7ba19de8bd6d" status: 204 len: 0 microversion: 2.1 time: 0.252330 Oct 27 15:45:20.460853 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 262/469] 10.222.0.64 () {58 vars in 1238 bytes} [Wed Oct 27 15:45:20 2021] DELETE /compute/v2.1/servers/f7374bb8-d28b-47a6-a8bd-7ba19de8bd6d => generated 0 bytes in 254 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 15:45:20.486024 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-0ae7be53-2066-4b63-8155-2a0288161b4e tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:45:20.486024 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-0ae7be53-2066-4b63-8155-2a0288161b4e tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] [instance: f7374bb8-d28b-47a6-a8bd-7ba19de8bd6d] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:45:20.503430 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-0ae7be53-2066-4b63-8155-2a0288161b4e tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:45:20.504842 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-0ae7be53-2066-4b63-8155-2a0288161b4e tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:45:20.506033 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-0ae7be53-2066-4b63-8155-2a0288161b4e tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:45:20.507556 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-0ae7be53-2066-4b63-8155-2a0288161b4e tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:45:20.782536 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-0ae7be53-2066-4b63-8155-2a0288161b4e tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0abe23cb5f314bc883ef7958b0ed9b5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fc48df471f247809d82ddf926bfdc6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:45:20.791262 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-0ae7be53-2066-4b63-8155-2a0288161b4e tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] 10.222.0.64 "GET /compute/v2.1/servers/f7374bb8-d28b-47a6-a8bd-7ba19de8bd6d" status: 200 len: 1513 microversion: 2.1 time: 0.324920 Oct 27 15:45:20.801705 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 208/470] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:45:20 2021] GET /compute/v2.1/servers/f7374bb8-d28b-47a6-a8bd-7ba19de8bd6d => generated 1513 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 15:45:20.967383 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-e250bf72-6fa9-4fa0-9a6c-9882e3af021b tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:45:20.968450 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-e250bf72-6fa9-4fa0-9a6c-9882e3af021b tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:45:20.975502 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-e250bf72-6fa9-4fa0-9a6c-9882e3af021b tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:45:20.975973 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-e250bf72-6fa9-4fa0-9a6c-9882e3af021b tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:45:20.976763 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-e250bf72-6fa9-4fa0-9a6c-9882e3af021b tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:45:20.977199 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-e250bf72-6fa9-4fa0-9a6c-9882e3af021b tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:45:21.154864 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-e250bf72-6fa9-4fa0-9a6c-9882e3af021b tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:45:21.165491 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-e250bf72-6fa9-4fa0-9a6c-9882e3af021b tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:45:21.168155 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-e250bf72-6fa9-4fa0-9a6c-9882e3af021b tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:45:21.169668 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-e250bf72-6fa9-4fa0-9a6c-9882e3af021b tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672" status: 200 len: 1725 microversion: 2.20 time: 0.206615 Oct 27 15:45:21.171904 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 263/471] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Oct 27 15:45:20 2021] GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672 => generated 1725 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 15:45:21.220565 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-876d0075-7aa0-4981-ab97-a715de4568c3 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:45:21.221062 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-876d0075-7aa0-4981-ab97-a715de4568c3 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] [instance: 013da7c4-ac69-4554-827b-d68e9bac0e54] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:45:21.235725 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-876d0075-7aa0-4981-ab97-a715de4568c3 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:45:21.237733 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-876d0075-7aa0-4981-ab97-a715de4568c3 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:45:21.239131 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-876d0075-7aa0-4981-ab97-a715de4568c3 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:45:21.240760 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-876d0075-7aa0-4981-ab97-a715de4568c3 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:45:21.471912 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-876d0075-7aa0-4981-ab97-a715de4568c3 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6be4749041442787482b6e06b6c40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73f3238988e4e1293ad782712a1da53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:45:21.480091 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-876d0075-7aa0-4981-ab97-a715de4568c3 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] 10.222.0.64 "GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54" status: 200 len: 1319 microversion: 2.1 time: 0.263190 Oct 27 15:45:21.481240 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 209/472] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:45:21 2021] GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54 => generated 1319 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 15:45:21.808903 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-800a9554-107e-4da9-a39a-c5b93f3aafe3 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:45:21.809512 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-800a9554-107e-4da9-a39a-c5b93f3aafe3 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] [instance: f7374bb8-d28b-47a6-a8bd-7ba19de8bd6d] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:45:21.816103 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-800a9554-107e-4da9-a39a-c5b93f3aafe3 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:45:21.817435 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-800a9554-107e-4da9-a39a-c5b93f3aafe3 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:45:21.818468 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-800a9554-107e-4da9-a39a-c5b93f3aafe3 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:45:21.818974 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-800a9554-107e-4da9-a39a-c5b93f3aafe3 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:45:21.961921 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-800a9554-107e-4da9-a39a-c5b93f3aafe3 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0abe23cb5f314bc883ef7958b0ed9b5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fc48df471f247809d82ddf926bfdc6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:45:21.969695 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-800a9554-107e-4da9-a39a-c5b93f3aafe3 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] 10.222.0.64 "GET /compute/v2.1/servers/f7374bb8-d28b-47a6-a8bd-7ba19de8bd6d" status: 200 len: 1513 microversion: 2.1 time: 0.164363 Oct 27 15:45:21.970221 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 264/473] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:45:21 2021] GET /compute/v2.1/servers/f7374bb8-d28b-47a6-a8bd-7ba19de8bd6d => generated 1513 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 15:45:22.190430 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-94b6ca3e-e6bd-45bf-a6ca-2e32d710407f tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:45:22.191031 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-94b6ca3e-e6bd-45bf-a6ca-2e32d710407f tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:45:22.199213 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-94b6ca3e-e6bd-45bf-a6ca-2e32d710407f tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:45:22.200032 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-94b6ca3e-e6bd-45bf-a6ca-2e32d710407f tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:45:22.201434 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-94b6ca3e-e6bd-45bf-a6ca-2e32d710407f tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:45:22.202093 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-94b6ca3e-e6bd-45bf-a6ca-2e32d710407f tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:45:22.455385 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-94b6ca3e-e6bd-45bf-a6ca-2e32d710407f tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:45:22.467386 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-94b6ca3e-e6bd-45bf-a6ca-2e32d710407f tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:45:22.471675 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-94b6ca3e-e6bd-45bf-a6ca-2e32d710407f tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:45:22.474980 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-94b6ca3e-e6bd-45bf-a6ca-2e32d710407f tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672" status: 200 len: 1725 microversion: 2.20 time: 0.288230 Oct 27 15:45:22.476044 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 210/474] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Oct 27 15:45:22 2021] GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672 => generated 1725 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 15:45:22.497708 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-f3fc7f40-a64c-42fd-9587-5c0313372cfb tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:45:22.498311 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-f3fc7f40-a64c-42fd-9587-5c0313372cfb tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] [instance: 013da7c4-ac69-4554-827b-d68e9bac0e54] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:45:22.509320 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-f3fc7f40-a64c-42fd-9587-5c0313372cfb tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:45:22.509763 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-f3fc7f40-a64c-42fd-9587-5c0313372cfb tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:45:22.510541 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-f3fc7f40-a64c-42fd-9587-5c0313372cfb tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:45:22.510970 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-f3fc7f40-a64c-42fd-9587-5c0313372cfb tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:45:22.764252 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-f3fc7f40-a64c-42fd-9587-5c0313372cfb tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6be4749041442787482b6e06b6c40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73f3238988e4e1293ad782712a1da53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:45:22.774505 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-f3fc7f40-a64c-42fd-9587-5c0313372cfb tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] 10.222.0.64 "GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54" status: 200 len: 1508 microversion: 2.1 time: 0.280286 Oct 27 15:45:22.775141 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 265/475] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:45:22 2021] GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54 => generated 1508 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 15:45:22.988000 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-37e3b167-fd00-42e7-a057-d770b4e4299a tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:45:22.989693 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-37e3b167-fd00-42e7-a057-d770b4e4299a tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] [instance: f7374bb8-d28b-47a6-a8bd-7ba19de8bd6d] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:45:22.998572 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-37e3b167-fd00-42e7-a057-d770b4e4299a tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:45:22.999017 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-37e3b167-fd00-42e7-a057-d770b4e4299a tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:45:22.999804 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-37e3b167-fd00-42e7-a057-d770b4e4299a tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:45:23.003934 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-37e3b167-fd00-42e7-a057-d770b4e4299a tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:45:23.382995 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-37e3b167-fd00-42e7-a057-d770b4e4299a tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0abe23cb5f314bc883ef7958b0ed9b5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fc48df471f247809d82ddf926bfdc6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:45:23.401167 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-37e3b167-fd00-42e7-a057-d770b4e4299a tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] 10.222.0.64 "GET /compute/v2.1/servers/f7374bb8-d28b-47a6-a8bd-7ba19de8bd6d" status: 200 len: 1513 microversion: 2.1 time: 0.417883 Oct 27 15:45:23.402412 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 211/476] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:45:22 2021] GET /compute/v2.1/servers/f7374bb8-d28b-47a6-a8bd-7ba19de8bd6d => generated 1513 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 15:45:23.494942 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-378628b2-1664-4401-a524-f24321dad690 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:45:23.495684 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-378628b2-1664-4401-a524-f24321dad690 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:45:23.506378 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-378628b2-1664-4401-a524-f24321dad690 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:45:23.506857 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-378628b2-1664-4401-a524-f24321dad690 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:45:23.508118 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-378628b2-1664-4401-a524-f24321dad690 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:45:23.508677 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-378628b2-1664-4401-a524-f24321dad690 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:45:23.684984 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-378628b2-1664-4401-a524-f24321dad690 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:45:23.697284 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-378628b2-1664-4401-a524-f24321dad690 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:45:23.699871 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-378628b2-1664-4401-a524-f24321dad690 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:45:23.702030 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-378628b2-1664-4401-a524-f24321dad690 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672" status: 200 len: 1725 microversion: 2.20 time: 0.211436 Oct 27 15:45:23.703166 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 266/477] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Oct 27 15:45:23 2021] GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672 => generated 1725 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 15:45:24.420252 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-b603d3be-cde7-483e-a22d-dd618252c4eb tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:45:24.421906 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-b603d3be-cde7-483e-a22d-dd618252c4eb tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] [instance: f7374bb8-d28b-47a6-a8bd-7ba19de8bd6d] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:45:24.429081 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-b603d3be-cde7-483e-a22d-dd618252c4eb tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:45:24.429676 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-b603d3be-cde7-483e-a22d-dd618252c4eb tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:45:24.430766 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-b603d3be-cde7-483e-a22d-dd618252c4eb tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:45:24.431366 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-b603d3be-cde7-483e-a22d-dd618252c4eb tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:45:24.513306 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [req-6c1ffef4-8aa9-4504-b37b-6971fa9f7c60 req-c04d3319-118b-40e3-b246-d00e83d95772 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f7374bb8-d28b-47a6-a8bd-7ba19de8bd6d", "name": "network-vif-deleted", "tag": "2292b913-d7bf-4e33-a1c0-57f3f447f964"}]} {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 15:45:24.515180 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 27 15:45:24.515180 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: warnings.warn(msg) Oct 27 15:45:24.531213 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [req-6c1ffef4-8aa9-4504-b37b-6971fa9f7c60 req-c04d3319-118b-40e3-b246-d00e83d95772 service nova] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:45:24.532031 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [req-6c1ffef4-8aa9-4504-b37b-6971fa9f7c60 req-c04d3319-118b-40e3-b246-d00e83d95772 service nova] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:45:24.558034 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.compute.server_external_events [req-6c1ffef4-8aa9-4504-b37b-6971fa9f7c60 req-c04d3319-118b-40e3-b246-d00e83d95772 service nova] Creating event network-vif-deleted:2292b913-d7bf-4e33-a1c0-57f3f447f964 for instance f7374bb8-d28b-47a6-a8bd-7ba19de8bd6d on hv-cinder-80070 Oct 27 15:45:24.563080 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [req-6c1ffef4-8aa9-4504-b37b-6971fa9f7c60 req-c04d3319-118b-40e3-b246-d00e83d95772 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054207 Oct 27 15:45:24.563689 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 267/478] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Oct 27 15:45:24 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 15:45:24.574749 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-b603d3be-cde7-483e-a22d-dd618252c4eb tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0abe23cb5f314bc883ef7958b0ed9b5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fc48df471f247809d82ddf926bfdc6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:45:24.583066 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-b603d3be-cde7-483e-a22d-dd618252c4eb tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] 10.222.0.64 "GET /compute/v2.1/servers/f7374bb8-d28b-47a6-a8bd-7ba19de8bd6d" status: 200 len: 1471 microversion: 2.1 time: 0.166291 Oct 27 15:45:24.584295 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 212/479] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:45:24 2021] GET /compute/v2.1/servers/f7374bb8-d28b-47a6-a8bd-7ba19de8bd6d => generated 1471 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 15:45:24.728312 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-8a8b6c43-f617-4695-91d2-f3d4e5481ce9 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:45:24.729710 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-8a8b6c43-f617-4695-91d2-f3d4e5481ce9 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:45:24.742257 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-8a8b6c43-f617-4695-91d2-f3d4e5481ce9 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:45:24.744871 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-8a8b6c43-f617-4695-91d2-f3d4e5481ce9 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:45:24.746841 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-8a8b6c43-f617-4695-91d2-f3d4e5481ce9 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:45:24.750408 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-8a8b6c43-f617-4695-91d2-f3d4e5481ce9 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:45:24.946838 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-8a8b6c43-f617-4695-91d2-f3d4e5481ce9 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:45:24.955753 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-8a8b6c43-f617-4695-91d2-f3d4e5481ce9 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:45:24.957863 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-8a8b6c43-f617-4695-91d2-f3d4e5481ce9 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:45:24.959357 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-8a8b6c43-f617-4695-91d2-f3d4e5481ce9 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672" status: 200 len: 1725 microversion: 2.20 time: 0.240768 Oct 27 15:45:24.960116 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 268/480] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Oct 27 15:45:24 2021] GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672 => generated 1725 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 15:45:25.605099 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-c93de90c-d34d-4379-959c-1fc1c7a25164 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:45:25.606289 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-c93de90c-d34d-4379-959c-1fc1c7a25164 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] [instance: f7374bb8-d28b-47a6-a8bd-7ba19de8bd6d] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:45:25.620789 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-c93de90c-d34d-4379-959c-1fc1c7a25164 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:45:25.623712 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-c93de90c-d34d-4379-959c-1fc1c7a25164 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:45:25.629971 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-c93de90c-d34d-4379-959c-1fc1c7a25164 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:45:25.631442 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-c93de90c-d34d-4379-959c-1fc1c7a25164 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:45:25.712236 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-c93de90c-d34d-4379-959c-1fc1c7a25164 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:45:25.713241 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-c93de90c-d34d-4379-959c-1fc1c7a25164 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:45:25.713709 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.objects.instance [None req-c93de90c-d34d-4379-959c-1fc1c7a25164 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lazy-loading 'fault' on Instance uuid f7374bb8-d28b-47a6-a8bd-7ba19de8bd6d {{(pid=122225) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 27 15:45:25.783183 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-c93de90c-d34d-4379-959c-1fc1c7a25164 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0abe23cb5f314bc883ef7958b0ed9b5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fc48df471f247809d82ddf926bfdc6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:45:25.788859 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-c93de90c-d34d-4379-959c-1fc1c7a25164 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] 10.222.0.64 "GET /compute/v2.1/servers/f7374bb8-d28b-47a6-a8bd-7ba19de8bd6d" status: 200 len: 1308 microversion: 2.1 time: 0.192464 Oct 27 15:45:25.790107 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 213/481] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:45:25 2021] GET /compute/v2.1/servers/f7374bb8-d28b-47a6-a8bd-7ba19de8bd6d => generated 1308 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 15:45:25.979100 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-ed99adf2-a9d6-4354-a126-2c87cf7e13a1 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:45:25.980568 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-ed99adf2-a9d6-4354-a126-2c87cf7e13a1 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:45:25.992959 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-ed99adf2-a9d6-4354-a126-2c87cf7e13a1 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:45:25.993421 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-ed99adf2-a9d6-4354-a126-2c87cf7e13a1 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:45:25.994237 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-ed99adf2-a9d6-4354-a126-2c87cf7e13a1 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:45:25.994680 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-ed99adf2-a9d6-4354-a126-2c87cf7e13a1 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:45:26.210603 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-ed99adf2-a9d6-4354-a126-2c87cf7e13a1 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:45:26.222662 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-ed99adf2-a9d6-4354-a126-2c87cf7e13a1 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:45:26.239436 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-ed99adf2-a9d6-4354-a126-2c87cf7e13a1 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:45:26.240448 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-ed99adf2-a9d6-4354-a126-2c87cf7e13a1 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672" status: 200 len: 1725 microversion: 2.20 time: 0.265208 Oct 27 15:45:26.241036 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 269/482] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Oct 27 15:45:25 2021] GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672 => generated 1725 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 15:45:26.808024 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-b63820c6-5e8b-4401-a673-5581405903e0 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:45:26.809786 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-b63820c6-5e8b-4401-a673-5581405903e0 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] [instance: f7374bb8-d28b-47a6-a8bd-7ba19de8bd6d] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:45:26.822439 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-b63820c6-5e8b-4401-a673-5581405903e0 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:45:26.823178 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-b63820c6-5e8b-4401-a673-5581405903e0 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:45:26.825083 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-b63820c6-5e8b-4401-a673-5581405903e0 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:45:26.825520 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-b63820c6-5e8b-4401-a673-5581405903e0 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:45:26.904476 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-b63820c6-5e8b-4401-a673-5581405903e0 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:45:26.906440 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-b63820c6-5e8b-4401-a673-5581405903e0 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:45:26.907532 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.objects.instance [None req-b63820c6-5e8b-4401-a673-5581405903e0 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lazy-loading 'fault' on Instance uuid f7374bb8-d28b-47a6-a8bd-7ba19de8bd6d {{(pid=122225) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 27 15:45:26.980778 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-b63820c6-5e8b-4401-a673-5581405903e0 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0abe23cb5f314bc883ef7958b0ed9b5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fc48df471f247809d82ddf926bfdc6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:45:26.999390 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-b63820c6-5e8b-4401-a673-5581405903e0 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] 10.222.0.64 "GET /compute/v2.1/servers/f7374bb8-d28b-47a6-a8bd-7ba19de8bd6d" status: 200 len: 1308 microversion: 2.1 time: 0.196126 Oct 27 15:45:27.006823 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 214/483] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:45:26 2021] GET /compute/v2.1/servers/f7374bb8-d28b-47a6-a8bd-7ba19de8bd6d => generated 1308 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 15:45:27.262269 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-cc7663e7-2f34-43ba-8a7f-1be39fd268fe tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:45:27.263435 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-cc7663e7-2f34-43ba-8a7f-1be39fd268fe tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:45:27.274321 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-cc7663e7-2f34-43ba-8a7f-1be39fd268fe tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:45:27.276035 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-cc7663e7-2f34-43ba-8a7f-1be39fd268fe tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:45:27.277752 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-cc7663e7-2f34-43ba-8a7f-1be39fd268fe tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:45:27.278660 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-cc7663e7-2f34-43ba-8a7f-1be39fd268fe tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:45:27.469712 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-cc7663e7-2f34-43ba-8a7f-1be39fd268fe tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:45:27.480589 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-cc7663e7-2f34-43ba-8a7f-1be39fd268fe tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:45:27.482607 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-cc7663e7-2f34-43ba-8a7f-1be39fd268fe tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:45:27.484268 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-cc7663e7-2f34-43ba-8a7f-1be39fd268fe tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672" status: 200 len: 1725 microversion: 2.20 time: 0.228624 Oct 27 15:45:27.496685 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 270/484] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Oct 27 15:45:27 2021] GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672 => generated 1725 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 15:45:28.024792 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-52c3ca06-b6ae-4690-9639-30083ed50cce tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:45:28.026975 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-52c3ca06-b6ae-4690-9639-30083ed50cce tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] [instance: f7374bb8-d28b-47a6-a8bd-7ba19de8bd6d] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:45:28.044828 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-52c3ca06-b6ae-4690-9639-30083ed50cce tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:45:28.047629 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-52c3ca06-b6ae-4690-9639-30083ed50cce tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:45:28.049261 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-52c3ca06-b6ae-4690-9639-30083ed50cce tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:45:28.049728 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-52c3ca06-b6ae-4690-9639-30083ed50cce tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:45:28.110703 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-52c3ca06-b6ae-4690-9639-30083ed50cce tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:45:28.111372 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-52c3ca06-b6ae-4690-9639-30083ed50cce tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:45:28.112018 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.objects.instance [None req-52c3ca06-b6ae-4690-9639-30083ed50cce tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lazy-loading 'fault' on Instance uuid f7374bb8-d28b-47a6-a8bd-7ba19de8bd6d {{(pid=122225) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 27 15:45:28.231182 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-52c3ca06-b6ae-4690-9639-30083ed50cce tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0abe23cb5f314bc883ef7958b0ed9b5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fc48df471f247809d82ddf926bfdc6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:45:28.247503 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-52c3ca06-b6ae-4690-9639-30083ed50cce tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] 10.222.0.64 "GET /compute/v2.1/servers/f7374bb8-d28b-47a6-a8bd-7ba19de8bd6d" status: 200 len: 1308 microversion: 2.1 time: 0.228459 Oct 27 15:45:28.251485 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 215/485] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:45:28 2021] GET /compute/v2.1/servers/f7374bb8-d28b-47a6-a8bd-7ba19de8bd6d => generated 1308 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 15:45:28.503517 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-bf9e27a2-fe81-4274-8515-790a49bec436 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:45:28.504976 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-bf9e27a2-fe81-4274-8515-790a49bec436 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:45:28.511262 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-bf9e27a2-fe81-4274-8515-790a49bec436 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:45:28.512120 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-bf9e27a2-fe81-4274-8515-790a49bec436 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:45:28.512905 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-bf9e27a2-fe81-4274-8515-790a49bec436 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:45:28.513334 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-bf9e27a2-fe81-4274-8515-790a49bec436 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:45:28.710091 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-71a349d5-10da-44f3-b8b5-dd17facf96f3 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Action: 'create', calling method: .version_select at 0x7fbc05e6d550>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-2050413747"}} {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 15:45:28.733223 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.quota [None req-71a349d5-10da-44f3-b8b5-dd17facf96f3 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Getting quotas for project 8818377e744d4f6ba65560705c191f0a. Resources: {'key_pairs'} {{(pid=122224) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 27 15:45:28.736393 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-bf9e27a2-fe81-4274-8515-790a49bec436 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:45:28.737877 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.quota [None req-71a349d5-10da-44f3-b8b5-dd17facf96f3 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Getting quotas for user 4c757a383a434a4c9b1b928087af8de7 and project 8818377e744d4f6ba65560705c191f0a. Resources: {'key_pairs'} {{(pid=122224) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 27 15:45:28.745806 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-bf9e27a2-fe81-4274-8515-790a49bec436 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:45:28.747713 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-bf9e27a2-fe81-4274-8515-790a49bec436 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:45:28.749043 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-bf9e27a2-fe81-4274-8515-790a49bec436 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672" status: 200 len: 1725 microversion: 2.20 time: 0.249316 Oct 27 15:45:28.749785 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 216/486] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Oct 27 15:45:28 2021] GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672 => generated 1725 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 15:45:28.909878 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.quota [None req-71a349d5-10da-44f3-b8b5-dd17facf96f3 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Getting quotas for project 8818377e744d4f6ba65560705c191f0a. Resources: {'key_pairs'} {{(pid=122224) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 27 15:45:28.914686 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.quota [None req-71a349d5-10da-44f3-b8b5-dd17facf96f3 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Getting quotas for user 4c757a383a434a4c9b1b928087af8de7 and project 8818377e744d4f6ba65560705c191f0a. Resources: {'key_pairs'} {{(pid=122224) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 27 15:45:28.945726 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-71a349d5-10da-44f3-b8b5-dd17facf96f3 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] 10.222.0.64 "POST /compute/v2.1/os-keypairs" status: 200 len: 2315 microversion: 2.1 time: 0.486698 Oct 27 15:45:28.946674 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 271/487] 10.222.0.64 () {60 vars in 1157 bytes} [Wed Oct 27 15:45:28 2021] POST /compute/v2.1/os-keypairs => generated 2315 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 15:45:29.267575 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-5eaf73dc-c9b6-4762-9dcf-c7e32e01ef14 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:45:29.268278 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-5eaf73dc-c9b6-4762-9dcf-c7e32e01ef14 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] [instance: f7374bb8-d28b-47a6-a8bd-7ba19de8bd6d] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:45:29.276074 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-5eaf73dc-c9b6-4762-9dcf-c7e32e01ef14 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:45:29.276682 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-5eaf73dc-c9b6-4762-9dcf-c7e32e01ef14 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:45:29.277705 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-5eaf73dc-c9b6-4762-9dcf-c7e32e01ef14 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:45:29.278441 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-5eaf73dc-c9b6-4762-9dcf-c7e32e01ef14 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:45:29.293128 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.wsgi [None req-5eaf73dc-c9b6-4762-9dcf-c7e32e01ef14 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] HTTP exception thrown: Instance f7374bb8-d28b-47a6-a8bd-7ba19de8bd6d could not be found. Oct 27 15:45:29.293671 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-5eaf73dc-c9b6-4762-9dcf-c7e32e01ef14 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Returning 404 to user: Instance f7374bb8-d28b-47a6-a8bd-7ba19de8bd6d could not be found. {{(pid=122225) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 27 15:45:29.294512 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-5eaf73dc-c9b6-4762-9dcf-c7e32e01ef14 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] 10.222.0.64 "GET /compute/v2.1/servers/f7374bb8-d28b-47a6-a8bd-7ba19de8bd6d" status: 404 len: 111 microversion: 2.1 time: 0.030916 Oct 27 15:45:29.295062 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 217/488] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:45:29 2021] GET /compute/v2.1/servers/f7374bb8-d28b-47a6-a8bd-7ba19de8bd6d => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 15:45:29.769081 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-26f80963-b337-4515-9149-4811dd4531ff tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:45:29.770361 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-26f80963-b337-4515-9149-4811dd4531ff tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:45:29.777889 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-26f80963-b337-4515-9149-4811dd4531ff tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:45:29.778980 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-26f80963-b337-4515-9149-4811dd4531ff tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:45:29.781547 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-26f80963-b337-4515-9149-4811dd4531ff tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:45:29.782913 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-26f80963-b337-4515-9149-4811dd4531ff tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:45:29.936384 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-26f80963-b337-4515-9149-4811dd4531ff tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:45:29.946747 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-26f80963-b337-4515-9149-4811dd4531ff tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:45:29.948308 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-26f80963-b337-4515-9149-4811dd4531ff tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:45:29.949661 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-26f80963-b337-4515-9149-4811dd4531ff tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672" status: 200 len: 1725 microversion: 2.20 time: 0.186152 Oct 27 15:45:29.950604 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 272/489] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Oct 27 15:45:29 2021] GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672 => generated 1725 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 15:45:30.460012 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-aff86c48-e371-478b-8c7b-d2093cd46048 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:45:30.461070 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-aff86c48-e371-478b-8c7b-d2093cd46048 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] [instance: 3d2e562b-a203-495d-b337-756545861f78] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:45:30.468231 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-aff86c48-e371-478b-8c7b-d2093cd46048 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:45:30.484336 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-aff86c48-e371-478b-8c7b-d2093cd46048 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:45:30.485418 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-aff86c48-e371-478b-8c7b-d2093cd46048 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:45:30.486011 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-aff86c48-e371-478b-8c7b-d2093cd46048 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:45:30.524105 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-aff86c48-e371-478b-8c7b-d2093cd46048 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] [instance: 3d2e562b-a203-495d-b337-756545861f78] Going to try to terminate instance {{(pid=122225) delete /opt/stack/nova/nova/compute/api.py:2612}} Oct 27 15:45:30.637866 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-aff86c48-e371-478b-8c7b-d2093cd46048 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] 10.222.0.64 "DELETE /compute/v2.1/servers/3d2e562b-a203-495d-b337-756545861f78" status: 204 len: 0 microversion: 2.1 time: 0.181025 Oct 27 15:45:30.638769 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 218/490] 10.222.0.64 () {58 vars in 1238 bytes} [Wed Oct 27 15:45:30 2021] DELETE /compute/v2.1/servers/3d2e562b-a203-495d-b337-756545861f78 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 15:45:30.648173 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-4a44a44a-3a2c-4f79-8be6-757e3ca5068a tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:45:30.649524 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-4a44a44a-3a2c-4f79-8be6-757e3ca5068a tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] [instance: 3d2e562b-a203-495d-b337-756545861f78] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:45:30.657011 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-4a44a44a-3a2c-4f79-8be6-757e3ca5068a tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:45:30.657462 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-4a44a44a-3a2c-4f79-8be6-757e3ca5068a tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:45:30.658435 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-4a44a44a-3a2c-4f79-8be6-757e3ca5068a tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:45:30.658864 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-4a44a44a-3a2c-4f79-8be6-757e3ca5068a tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:45:30.812844 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-4a44a44a-3a2c-4f79-8be6-757e3ca5068a tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0abe23cb5f314bc883ef7958b0ed9b5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fc48df471f247809d82ddf926bfdc6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:45:30.824621 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-4a44a44a-3a2c-4f79-8be6-757e3ca5068a tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] 10.222.0.64 "GET /compute/v2.1/servers/3d2e562b-a203-495d-b337-756545861f78" status: 200 len: 1514 microversion: 2.1 time: 0.180801 Oct 27 15:45:30.825612 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 273/491] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:45:30 2021] GET /compute/v2.1/servers/3d2e562b-a203-495d-b337-756545861f78 => generated 1514 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 15:45:30.968215 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-b5c9f3c2-77c5-4e60-b554-9cfb155fcc40 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:45:30.969099 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-b5c9f3c2-77c5-4e60-b554-9cfb155fcc40 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:45:30.978527 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-b5c9f3c2-77c5-4e60-b554-9cfb155fcc40 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:45:30.979297 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-b5c9f3c2-77c5-4e60-b554-9cfb155fcc40 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:45:30.980275 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-b5c9f3c2-77c5-4e60-b554-9cfb155fcc40 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:45:30.980864 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-b5c9f3c2-77c5-4e60-b554-9cfb155fcc40 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:45:31.142078 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-b5c9f3c2-77c5-4e60-b554-9cfb155fcc40 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:45:31.151637 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-b5c9f3c2-77c5-4e60-b554-9cfb155fcc40 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:45:31.153514 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-b5c9f3c2-77c5-4e60-b554-9cfb155fcc40 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:45:31.154758 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-b5c9f3c2-77c5-4e60-b554-9cfb155fcc40 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672" status: 200 len: 1725 microversion: 2.20 time: 0.190693 Oct 27 15:45:31.155314 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 219/492] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Oct 27 15:45:30 2021] GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672 => generated 1725 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 15:45:31.842418 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-5555ee3a-6da1-4a16-b4de-6f5c757d4827 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:45:31.843040 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-5555ee3a-6da1-4a16-b4de-6f5c757d4827 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] [instance: 3d2e562b-a203-495d-b337-756545861f78] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:45:31.850124 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-5555ee3a-6da1-4a16-b4de-6f5c757d4827 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:45:31.850561 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-5555ee3a-6da1-4a16-b4de-6f5c757d4827 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:45:31.851338 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-5555ee3a-6da1-4a16-b4de-6f5c757d4827 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:45:31.851766 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-5555ee3a-6da1-4a16-b4de-6f5c757d4827 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:45:31.988474 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-5555ee3a-6da1-4a16-b4de-6f5c757d4827 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0abe23cb5f314bc883ef7958b0ed9b5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fc48df471f247809d82ddf926bfdc6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:45:31.997430 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-5555ee3a-6da1-4a16-b4de-6f5c757d4827 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] 10.222.0.64 "GET /compute/v2.1/servers/3d2e562b-a203-495d-b337-756545861f78" status: 200 len: 1514 microversion: 2.1 time: 0.158656 Oct 27 15:45:31.998020 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 274/493] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:45:31 2021] GET /compute/v2.1/servers/3d2e562b-a203-495d-b337-756545861f78 => generated 1514 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 15:45:32.178016 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-62752aba-7056-4e74-9170-637434569bf8 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:45:32.179272 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-62752aba-7056-4e74-9170-637434569bf8 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:45:32.201427 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-62752aba-7056-4e74-9170-637434569bf8 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:45:32.202154 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-62752aba-7056-4e74-9170-637434569bf8 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:45:32.203187 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-62752aba-7056-4e74-9170-637434569bf8 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:45:32.203811 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-62752aba-7056-4e74-9170-637434569bf8 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:45:32.344854 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-62752aba-7056-4e74-9170-637434569bf8 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:45:32.356402 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-62752aba-7056-4e74-9170-637434569bf8 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:45:32.358474 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-62752aba-7056-4e74-9170-637434569bf8 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:45:32.359824 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-62752aba-7056-4e74-9170-637434569bf8 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672" status: 200 len: 1725 microversion: 2.20 time: 0.189810 Oct 27 15:45:32.360853 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 220/494] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Oct 27 15:45:32 2021] GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672 => generated 1725 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 15:45:33.015150 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-6409567f-314a-4306-98fb-2b7a3b005e34 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:45:33.015757 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-6409567f-314a-4306-98fb-2b7a3b005e34 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] [instance: 3d2e562b-a203-495d-b337-756545861f78] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:45:33.022735 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-6409567f-314a-4306-98fb-2b7a3b005e34 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:45:33.023070 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-6409567f-314a-4306-98fb-2b7a3b005e34 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:45:33.023833 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-6409567f-314a-4306-98fb-2b7a3b005e34 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:45:33.024300 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-6409567f-314a-4306-98fb-2b7a3b005e34 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:45:33.154955 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-6409567f-314a-4306-98fb-2b7a3b005e34 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0abe23cb5f314bc883ef7958b0ed9b5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fc48df471f247809d82ddf926bfdc6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:45:33.163340 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-6409567f-314a-4306-98fb-2b7a3b005e34 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] 10.222.0.64 "GET /compute/v2.1/servers/3d2e562b-a203-495d-b337-756545861f78" status: 200 len: 1514 microversion: 2.1 time: 0.151832 Oct 27 15:45:33.163929 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 275/495] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:45:33 2021] GET /compute/v2.1/servers/3d2e562b-a203-495d-b337-756545861f78 => generated 1514 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 15:45:33.378596 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-77935419-aa73-41cd-9975-645aeb70da6d tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:45:33.380280 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-77935419-aa73-41cd-9975-645aeb70da6d tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:45:33.386456 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-77935419-aa73-41cd-9975-645aeb70da6d tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:45:33.386890 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-77935419-aa73-41cd-9975-645aeb70da6d tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:45:33.387685 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-77935419-aa73-41cd-9975-645aeb70da6d tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:45:33.388110 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-77935419-aa73-41cd-9975-645aeb70da6d tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:45:33.518421 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-77935419-aa73-41cd-9975-645aeb70da6d tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:45:33.527657 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-77935419-aa73-41cd-9975-645aeb70da6d tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:45:33.529174 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-77935419-aa73-41cd-9975-645aeb70da6d tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:45:33.530316 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-77935419-aa73-41cd-9975-645aeb70da6d tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672" status: 200 len: 1725 microversion: 2.20 time: 0.155709 Oct 27 15:45:33.530858 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 221/496] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Oct 27 15:45:33 2021] GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672 => generated 1725 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 15:45:34.188382 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-2c29e2bc-e801-415f-a783-82dbce5f831e tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:45:34.189071 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-2c29e2bc-e801-415f-a783-82dbce5f831e tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] [instance: 3d2e562b-a203-495d-b337-756545861f78] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:45:34.197700 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-2c29e2bc-e801-415f-a783-82dbce5f831e tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:45:34.198218 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-2c29e2bc-e801-415f-a783-82dbce5f831e tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:45:34.199000 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-2c29e2bc-e801-415f-a783-82dbce5f831e tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:45:34.199432 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-2c29e2bc-e801-415f-a783-82dbce5f831e tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:45:34.240820 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [req-11192257-d210-4c3a-937a-96a5f599ae38 req-908ba643-cc05-40f9-a549-7b1caed791a6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3d2e562b-a203-495d-b337-756545861f78", "name": "network-vif-deleted", "tag": "a76fa086-d710-4480-89a0-e6f5c183bfcf"}]} {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 15:45:34.242645 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 27 15:45:34.242645 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: warnings.warn(msg) Oct 27 15:45:34.250673 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [req-11192257-d210-4c3a-937a-96a5f599ae38 req-908ba643-cc05-40f9-a549-7b1caed791a6 service nova] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:45:34.251688 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [req-11192257-d210-4c3a-937a-96a5f599ae38 req-908ba643-cc05-40f9-a549-7b1caed791a6 service nova] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:45:34.264684 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.compute.server_external_events [req-11192257-d210-4c3a-937a-96a5f599ae38 req-908ba643-cc05-40f9-a549-7b1caed791a6 service nova] Creating event network-vif-deleted:a76fa086-d710-4480-89a0-e6f5c183bfcf for instance 3d2e562b-a203-495d-b337-756545861f78 on hv-cinder-80070 Oct 27 15:45:34.273090 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [req-11192257-d210-4c3a-937a-96a5f599ae38 req-908ba643-cc05-40f9-a549-7b1caed791a6 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035755 Oct 27 15:45:34.273895 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 222/497] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Oct 27 15:45:34 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 15:45:34.295756 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-2c29e2bc-e801-415f-a783-82dbce5f831e tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0abe23cb5f314bc883ef7958b0ed9b5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fc48df471f247809d82ddf926bfdc6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:45:34.304063 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-2c29e2bc-e801-415f-a783-82dbce5f831e tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] 10.222.0.64 "GET /compute/v2.1/servers/3d2e562b-a203-495d-b337-756545861f78" status: 200 len: 1472 microversion: 2.1 time: 0.127384 Oct 27 15:45:34.313512 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 276/498] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:45:34 2021] GET /compute/v2.1/servers/3d2e562b-a203-495d-b337-756545861f78 => generated 1472 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 15:45:34.554212 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-251c87db-dfdd-436d-a5aa-464281dca083 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:45:34.554923 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-251c87db-dfdd-436d-a5aa-464281dca083 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:45:34.561948 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-251c87db-dfdd-436d-a5aa-464281dca083 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:45:34.562405 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-251c87db-dfdd-436d-a5aa-464281dca083 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:45:34.563269 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-251c87db-dfdd-436d-a5aa-464281dca083 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:45:34.563954 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-251c87db-dfdd-436d-a5aa-464281dca083 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:45:34.718171 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-251c87db-dfdd-436d-a5aa-464281dca083 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:45:34.728472 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-251c87db-dfdd-436d-a5aa-464281dca083 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:45:34.730731 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-251c87db-dfdd-436d-a5aa-464281dca083 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:45:34.732484 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-251c87db-dfdd-436d-a5aa-464281dca083 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672" status: 200 len: 1725 microversion: 2.20 time: 0.186578 Oct 27 15:45:34.733369 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 223/499] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Oct 27 15:45:34 2021] GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672 => generated 1725 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 15:45:35.320871 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-7683999c-5f35-4bbe-bd12-b559f91dd19f tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:45:35.321483 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-7683999c-5f35-4bbe-bd12-b559f91dd19f tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] [instance: 3d2e562b-a203-495d-b337-756545861f78] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:45:35.328325 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-7683999c-5f35-4bbe-bd12-b559f91dd19f tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:45:35.328772 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-7683999c-5f35-4bbe-bd12-b559f91dd19f tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:45:35.329548 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-7683999c-5f35-4bbe-bd12-b559f91dd19f tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:45:35.330007 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-7683999c-5f35-4bbe-bd12-b559f91dd19f tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:45:35.345407 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.wsgi [None req-7683999c-5f35-4bbe-bd12-b559f91dd19f tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] HTTP exception thrown: Instance 3d2e562b-a203-495d-b337-756545861f78 could not be found. Oct 27 15:45:35.345884 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-7683999c-5f35-4bbe-bd12-b559f91dd19f tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Returning 404 to user: Instance 3d2e562b-a203-495d-b337-756545861f78 could not be found. {{(pid=122224) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 27 15:45:35.346717 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-7683999c-5f35-4bbe-bd12-b559f91dd19f tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] 10.222.0.64 "GET /compute/v2.1/servers/3d2e562b-a203-495d-b337-756545861f78" status: 404 len: 111 microversion: 2.1 time: 0.029562 Oct 27 15:45:35.347275 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 277/500] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:45:35 2021] GET /compute/v2.1/servers/3d2e562b-a203-495d-b337-756545861f78 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 15:45:35.356314 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-92821608-437c-4211-ac20-2c23866d19fc tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:45:35.356942 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-92821608-437c-4211-ac20-2c23866d19fc tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] [instance: a2e6d3ca-9ddb-4f28-908a-24d8705fb320] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:45:35.362610 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-92821608-437c-4211-ac20-2c23866d19fc tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:45:35.363050 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-92821608-437c-4211-ac20-2c23866d19fc tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:45:35.364068 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-92821608-437c-4211-ac20-2c23866d19fc tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:45:35.364308 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-92821608-437c-4211-ac20-2c23866d19fc tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:45:35.390823 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-92821608-437c-4211-ac20-2c23866d19fc tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] [instance: a2e6d3ca-9ddb-4f28-908a-24d8705fb320] Going to try to terminate instance {{(pid=122225) delete /opt/stack/nova/nova/compute/api.py:2612}} Oct 27 15:45:35.471320 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-92821608-437c-4211-ac20-2c23866d19fc tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] 10.222.0.64 "DELETE /compute/v2.1/servers/a2e6d3ca-9ddb-4f28-908a-24d8705fb320" status: 204 len: 0 microversion: 2.1 time: 0.118262 Oct 27 15:45:35.472201 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 224/501] 10.222.0.64 () {58 vars in 1238 bytes} [Wed Oct 27 15:45:35 2021] DELETE /compute/v2.1/servers/a2e6d3ca-9ddb-4f28-908a-24d8705fb320 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 15:45:35.481891 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-91d442b2-353a-482d-912f-4ea5409b7327 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:45:35.482501 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-91d442b2-353a-482d-912f-4ea5409b7327 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] [instance: a2e6d3ca-9ddb-4f28-908a-24d8705fb320] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:45:35.489425 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-91d442b2-353a-482d-912f-4ea5409b7327 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:45:35.489823 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-91d442b2-353a-482d-912f-4ea5409b7327 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:45:35.490649 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-91d442b2-353a-482d-912f-4ea5409b7327 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:45:35.491043 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-91d442b2-353a-482d-912f-4ea5409b7327 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:45:35.647827 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-91d442b2-353a-482d-912f-4ea5409b7327 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0abe23cb5f314bc883ef7958b0ed9b5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fc48df471f247809d82ddf926bfdc6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:45:35.650464 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-07792c9b-c8ce-4306-8a5a-133e1e88464e tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 15:45:35.651473 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-07792c9b-c8ce-4306-8a5a-133e1e88464e tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: 62c89161-c119-48b2-839d-712db798ff96] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:45:35.655392 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-91d442b2-353a-482d-912f-4ea5409b7327 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] 10.222.0.64 "GET /compute/v2.1/servers/a2e6d3ca-9ddb-4f28-908a-24d8705fb320" status: 200 len: 1512 microversion: 2.1 time: 0.177381 Oct 27 15:45:35.656119 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 278/502] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:45:35 2021] GET /compute/v2.1/servers/a2e6d3ca-9ddb-4f28-908a-24d8705fb320 => generated 1512 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 15:45:35.664183 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-07792c9b-c8ce-4306-8a5a-133e1e88464e tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:45:35.664629 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-07792c9b-c8ce-4306-8a5a-133e1e88464e tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:45:35.665405 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-07792c9b-c8ce-4306-8a5a-133e1e88464e tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:45:35.665827 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-07792c9b-c8ce-4306-8a5a-133e1e88464e tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:45:35.690394 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.objects.instance [None req-07792c9b-c8ce-4306-8a5a-133e1e88464e tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lazy-loading 'flavor' on Instance uuid 62c89161-c119-48b2-839d-712db798ff96 {{(pid=122225) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 27 15:45:35.752097 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-e386caa0-6f11-449e-88bc-5efe4ed0f7e5 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:45:35.753122 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-e386caa0-6f11-449e-88bc-5efe4ed0f7e5 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:45:35.760088 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-e386caa0-6f11-449e-88bc-5efe4ed0f7e5 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:45:35.761666 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-e386caa0-6f11-449e-88bc-5efe4ed0f7e5 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:45:35.762677 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-e386caa0-6f11-449e-88bc-5efe4ed0f7e5 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:45:35.763256 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-e386caa0-6f11-449e-88bc-5efe4ed0f7e5 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:45:35.845068 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-07792c9b-c8ce-4306-8a5a-133e1e88464e tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "POST /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/action" status: 200 len: 32 microversion: 2.1 time: 0.198852 Oct 27 15:45:35.846140 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 225/503] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Oct 27 15:45:35 2021] POST /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/action => generated 32 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 27 15:45:35.856084 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-9977e667-49a4-4d72-b1e3-8e2d3c05a491 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:45:35.856919 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-9977e667-49a4-4d72-b1e3-8e2d3c05a491 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: 62c89161-c119-48b2-839d-712db798ff96] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:45:35.864224 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-9977e667-49a4-4d72-b1e3-8e2d3c05a491 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:45:35.864901 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-9977e667-49a4-4d72-b1e3-8e2d3c05a491 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:45:35.865503 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-9977e667-49a4-4d72-b1e3-8e2d3c05a491 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:45:35.865993 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-9977e667-49a4-4d72-b1e3-8e2d3c05a491 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:45:35.946579 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-e386caa0-6f11-449e-88bc-5efe4ed0f7e5 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:45:35.960768 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-e386caa0-6f11-449e-88bc-5efe4ed0f7e5 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:45:35.964306 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-e386caa0-6f11-449e-88bc-5efe4ed0f7e5 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:45:35.966533 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-e386caa0-6f11-449e-88bc-5efe4ed0f7e5 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672" status: 200 len: 1725 microversion: 2.20 time: 0.218438 Oct 27 15:45:35.967308 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 279/504] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Oct 27 15:45:35 2021] GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672 => generated 1725 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 15:45:36.016563 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-9977e667-49a4-4d72-b1e3-8e2d3c05a491 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96b599f8890b4281a7e311cf37a039e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d7fcab5d3f465793d650f16c6ea8de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:45:36.024855 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-9977e667-49a4-4d72-b1e3-8e2d3c05a491 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96" status: 200 len: 1567 microversion: 2.1 time: 0.172936 Oct 27 15:45:36.025675 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 226/505] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:45:35 2021] GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96 => generated 1567 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 15:45:36.672924 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-6300e701-f9c1-4e26-bb50-8133e6d34e15 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:45:36.673461 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-6300e701-f9c1-4e26-bb50-8133e6d34e15 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] [instance: a2e6d3ca-9ddb-4f28-908a-24d8705fb320] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:45:36.679723 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-6300e701-f9c1-4e26-bb50-8133e6d34e15 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:45:36.680207 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-6300e701-f9c1-4e26-bb50-8133e6d34e15 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:45:36.681009 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-6300e701-f9c1-4e26-bb50-8133e6d34e15 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:45:36.681447 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-6300e701-f9c1-4e26-bb50-8133e6d34e15 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:45:36.809674 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-6300e701-f9c1-4e26-bb50-8133e6d34e15 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0abe23cb5f314bc883ef7958b0ed9b5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fc48df471f247809d82ddf926bfdc6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:45:36.817914 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-6300e701-f9c1-4e26-bb50-8133e6d34e15 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] 10.222.0.64 "GET /compute/v2.1/servers/a2e6d3ca-9ddb-4f28-908a-24d8705fb320" status: 200 len: 1512 microversion: 2.1 time: 0.148659 Oct 27 15:45:36.818670 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 280/506] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:45:36 2021] GET /compute/v2.1/servers/a2e6d3ca-9ddb-4f28-908a-24d8705fb320 => generated 1512 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 15:45:36.984980 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-583e09a5-dc3a-4962-b49c-eb63345fc6dc tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:45:36.985654 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-583e09a5-dc3a-4962-b49c-eb63345fc6dc tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:45:36.997340 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-583e09a5-dc3a-4962-b49c-eb63345fc6dc tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:45:36.997774 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-583e09a5-dc3a-4962-b49c-eb63345fc6dc tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:45:36.998543 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-583e09a5-dc3a-4962-b49c-eb63345fc6dc tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:45:36.998974 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-583e09a5-dc3a-4962-b49c-eb63345fc6dc tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:45:37.042754 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-e11444da-ab54-4171-b7ea-79ac813ec9ab tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:45:37.043357 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-e11444da-ab54-4171-b7ea-79ac813ec9ab tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: 62c89161-c119-48b2-839d-712db798ff96] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:45:37.049348 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-e11444da-ab54-4171-b7ea-79ac813ec9ab tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:45:37.049669 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-e11444da-ab54-4171-b7ea-79ac813ec9ab tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:45:37.050715 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-e11444da-ab54-4171-b7ea-79ac813ec9ab tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:45:37.051946 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-e11444da-ab54-4171-b7ea-79ac813ec9ab tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:45:37.133207 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-583e09a5-dc3a-4962-b49c-eb63345fc6dc tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:45:37.143163 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-583e09a5-dc3a-4962-b49c-eb63345fc6dc tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:45:37.144888 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-583e09a5-dc3a-4962-b49c-eb63345fc6dc tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:45:37.146136 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-583e09a5-dc3a-4962-b49c-eb63345fc6dc tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672" status: 200 len: 1725 microversion: 2.20 time: 0.165100 Oct 27 15:45:37.146691 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 227/507] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Oct 27 15:45:36 2021] GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672 => generated 1725 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 15:45:37.186399 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-e11444da-ab54-4171-b7ea-79ac813ec9ab tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96b599f8890b4281a7e311cf37a039e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d7fcab5d3f465793d650f16c6ea8de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:45:37.194673 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-e11444da-ab54-4171-b7ea-79ac813ec9ab tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96" status: 200 len: 1567 microversion: 2.1 time: 0.155715 Oct 27 15:45:37.195234 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 281/508] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:45:37 2021] GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96 => generated 1567 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 15:45:37.378334 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-97e8765b-5743-4211-8ebf-4a1db1e20b7c tempest-VolumesNegativeTest-2132035956 tempest-VolumesNegativeTest-2132035956-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1089510476", "imageRef": "b585ffbc-6a36-48c9-81b3-e26f9bd0fcba", "flavorRef": "452"}} {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 15:45:37.837125 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-7f862018-b479-4145-8d9a-10e0085deb72 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:45:37.837669 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-7f862018-b479-4145-8d9a-10e0085deb72 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] [instance: a2e6d3ca-9ddb-4f28-908a-24d8705fb320] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:45:37.843806 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-7f862018-b479-4145-8d9a-10e0085deb72 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:45:37.844274 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-7f862018-b479-4145-8d9a-10e0085deb72 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:45:37.845031 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-7f862018-b479-4145-8d9a-10e0085deb72 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:45:37.845458 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-7f862018-b479-4145-8d9a-10e0085deb72 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:45:37.980258 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-7f862018-b479-4145-8d9a-10e0085deb72 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0abe23cb5f314bc883ef7958b0ed9b5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fc48df471f247809d82ddf926bfdc6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:45:37.987511 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-7f862018-b479-4145-8d9a-10e0085deb72 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] 10.222.0.64 "GET /compute/v2.1/servers/a2e6d3ca-9ddb-4f28-908a-24d8705fb320" status: 200 len: 1512 microversion: 2.1 time: 0.155226 Oct 27 15:45:37.988136 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 282/509] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:45:37 2021] GET /compute/v2.1/servers/a2e6d3ca-9ddb-4f28-908a-24d8705fb320 => generated 1512 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 15:45:38.164339 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-403a17fa-983d-47e6-bf40-d5e969fd163b tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:45:38.164948 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-403a17fa-983d-47e6-bf40-d5e969fd163b tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:45:38.170830 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-403a17fa-983d-47e6-bf40-d5e969fd163b tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:45:38.171279 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-403a17fa-983d-47e6-bf40-d5e969fd163b tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:45:38.172081 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-403a17fa-983d-47e6-bf40-d5e969fd163b tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:45:38.172515 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-403a17fa-983d-47e6-bf40-d5e969fd163b tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:45:38.360036 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-403a17fa-983d-47e6-bf40-d5e969fd163b tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:45:38.369340 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-403a17fa-983d-47e6-bf40-d5e969fd163b tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:45:38.370867 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-403a17fa-983d-47e6-bf40-d5e969fd163b tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:45:38.371998 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-403a17fa-983d-47e6-bf40-d5e969fd163b tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672" status: 200 len: 1725 microversion: 2.20 time: 0.211643 Oct 27 15:45:38.383352 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 283/510] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Oct 27 15:45:38 2021] GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672 => generated 1725 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 15:45:38.383352 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-1eef6fe4-f7b1-4b5b-9bcf-2b96fc3c9d31 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:45:38.383352 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-1eef6fe4-f7b1-4b5b-9bcf-2b96fc3c9d31 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: 62c89161-c119-48b2-839d-712db798ff96] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:45:38.385977 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-1eef6fe4-f7b1-4b5b-9bcf-2b96fc3c9d31 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:45:38.386448 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-1eef6fe4-f7b1-4b5b-9bcf-2b96fc3c9d31 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:45:38.387176 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-1eef6fe4-f7b1-4b5b-9bcf-2b96fc3c9d31 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:45:38.387605 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-1eef6fe4-f7b1-4b5b-9bcf-2b96fc3c9d31 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:45:38.595938 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-1eef6fe4-f7b1-4b5b-9bcf-2b96fc3c9d31 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96b599f8890b4281a7e311cf37a039e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d7fcab5d3f465793d650f16c6ea8de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:45:38.604393 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-1eef6fe4-f7b1-4b5b-9bcf-2b96fc3c9d31 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96" status: 200 len: 1567 microversion: 2.1 time: 0.230298 Oct 27 15:45:38.604964 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 284/511] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:45:38 2021] GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96 => generated 1567 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 15:45:39.007768 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-52b21bd8-2423-4372-a259-a2e639d436df tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:45:39.009361 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-52b21bd8-2423-4372-a259-a2e639d436df tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] [instance: a2e6d3ca-9ddb-4f28-908a-24d8705fb320] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:45:39.022755 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-52b21bd8-2423-4372-a259-a2e639d436df tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:45:39.023518 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-52b21bd8-2423-4372-a259-a2e639d436df tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:45:39.031174 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-52b21bd8-2423-4372-a259-a2e639d436df tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:45:39.031673 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-52b21bd8-2423-4372-a259-a2e639d436df tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:45:39.121028 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-52b21bd8-2423-4372-a259-a2e639d436df tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0abe23cb5f314bc883ef7958b0ed9b5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fc48df471f247809d82ddf926bfdc6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:45:39.132392 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-52b21bd8-2423-4372-a259-a2e639d436df tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] 10.222.0.64 "GET /compute/v2.1/servers/a2e6d3ca-9ddb-4f28-908a-24d8705fb320" status: 200 len: 1470 microversion: 2.1 time: 0.131413 Oct 27 15:45:39.133135 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 285/512] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:45:38 2021] GET /compute/v2.1/servers/a2e6d3ca-9ddb-4f28-908a-24d8705fb320 => generated 1470 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 15:45:39.139496 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [req-910c063f-527f-42ef-9d5e-1bceb939f77c req-eec27ccf-e72a-473f-937d-5b974c55ed0b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a2e6d3ca-9ddb-4f28-908a-24d8705fb320", "name": "network-vif-deleted", "tag": "63ec4f11-578e-4a46-9aa2-ef65a12a2552"}]} {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 15:45:39.141611 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 27 15:45:39.141611 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: warnings.warn(msg) Oct 27 15:45:39.155449 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [req-910c063f-527f-42ef-9d5e-1bceb939f77c req-eec27ccf-e72a-473f-937d-5b974c55ed0b service nova] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:45:39.156087 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [req-910c063f-527f-42ef-9d5e-1bceb939f77c req-eec27ccf-e72a-473f-937d-5b974c55ed0b service nova] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:45:39.168596 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.compute.server_external_events [req-910c063f-527f-42ef-9d5e-1bceb939f77c req-eec27ccf-e72a-473f-937d-5b974c55ed0b service nova] Creating event network-vif-deleted:63ec4f11-578e-4a46-9aa2-ef65a12a2552 for instance a2e6d3ca-9ddb-4f28-908a-24d8705fb320 on hv-cinder-80070 Oct 27 15:45:39.173961 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [req-910c063f-527f-42ef-9d5e-1bceb939f77c req-eec27ccf-e72a-473f-937d-5b974c55ed0b service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039144 Oct 27 15:45:39.175001 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 286/513] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Oct 27 15:45:39 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 15:45:39.391443 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-af01c263-a9fe-4a3a-8a93-5961e4617918 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:45:39.392159 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-af01c263-a9fe-4a3a-8a93-5961e4617918 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:45:39.398916 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-af01c263-a9fe-4a3a-8a93-5961e4617918 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:45:39.399359 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-af01c263-a9fe-4a3a-8a93-5961e4617918 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:45:39.400188 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-af01c263-a9fe-4a3a-8a93-5961e4617918 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:45:39.400621 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-af01c263-a9fe-4a3a-8a93-5961e4617918 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:45:39.528625 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-af01c263-a9fe-4a3a-8a93-5961e4617918 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:45:39.537709 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-af01c263-a9fe-4a3a-8a93-5961e4617918 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:45:39.539219 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-af01c263-a9fe-4a3a-8a93-5961e4617918 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:45:39.540424 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-af01c263-a9fe-4a3a-8a93-5961e4617918 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672" status: 200 len: 1725 microversion: 2.20 time: 0.153037 Oct 27 15:45:39.540988 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 287/514] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Oct 27 15:45:39 2021] GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672 => generated 1725 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 15:45:39.622301 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-0624993c-ed74-4f94-ae0d-c431fe6957dc tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:45:39.623077 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-0624993c-ed74-4f94-ae0d-c431fe6957dc tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: 62c89161-c119-48b2-839d-712db798ff96] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:45:39.630489 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-0624993c-ed74-4f94-ae0d-c431fe6957dc tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:45:39.630860 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-0624993c-ed74-4f94-ae0d-c431fe6957dc tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:45:39.631647 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-0624993c-ed74-4f94-ae0d-c431fe6957dc tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:45:39.632104 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-0624993c-ed74-4f94-ae0d-c431fe6957dc tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:45:39.766784 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-0624993c-ed74-4f94-ae0d-c431fe6957dc tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96b599f8890b4281a7e311cf37a039e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d7fcab5d3f465793d650f16c6ea8de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:45:39.776150 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-0624993c-ed74-4f94-ae0d-c431fe6957dc tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96" status: 200 len: 1567 microversion: 2.1 time: 0.157707 Oct 27 15:45:39.776747 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 288/515] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:45:39 2021] GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96 => generated 1567 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 15:45:40.150712 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-e2076489-c75d-4e22-b88f-85e2f0bfdccf tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:45:40.151372 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-e2076489-c75d-4e22-b88f-85e2f0bfdccf tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] [instance: a2e6d3ca-9ddb-4f28-908a-24d8705fb320] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:45:40.157619 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-e2076489-c75d-4e22-b88f-85e2f0bfdccf tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:45:40.158066 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-e2076489-c75d-4e22-b88f-85e2f0bfdccf tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:45:40.158837 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-e2076489-c75d-4e22-b88f-85e2f0bfdccf tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:45:40.159272 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-e2076489-c75d-4e22-b88f-85e2f0bfdccf tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:45:40.172387 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.wsgi [None req-e2076489-c75d-4e22-b88f-85e2f0bfdccf tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] HTTP exception thrown: Instance a2e6d3ca-9ddb-4f28-908a-24d8705fb320 could not be found. Oct 27 15:45:40.172978 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-e2076489-c75d-4e22-b88f-85e2f0bfdccf tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Returning 404 to user: Instance a2e6d3ca-9ddb-4f28-908a-24d8705fb320 could not be found. {{(pid=122224) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 27 15:45:40.173791 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-e2076489-c75d-4e22-b88f-85e2f0bfdccf tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] 10.222.0.64 "GET /compute/v2.1/servers/a2e6d3ca-9ddb-4f28-908a-24d8705fb320" status: 404 len: 111 microversion: 2.1 time: 0.026990 Oct 27 15:45:40.174319 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 289/516] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:45:40 2021] GET /compute/v2.1/servers/a2e6d3ca-9ddb-4f28-908a-24d8705fb320 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 27 15:45:40.558506 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-5a4396d9-5393-4689-b099-6b2bd3545180 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:45:40.559131 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-5a4396d9-5393-4689-b099-6b2bd3545180 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:45:40.564935 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-5a4396d9-5393-4689-b099-6b2bd3545180 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:45:40.565376 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-5a4396d9-5393-4689-b099-6b2bd3545180 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:45:40.566140 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-5a4396d9-5393-4689-b099-6b2bd3545180 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:45:40.567027 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-5a4396d9-5393-4689-b099-6b2bd3545180 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:45:40.708348 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-5a4396d9-5393-4689-b099-6b2bd3545180 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:45:40.716656 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-5a4396d9-5393-4689-b099-6b2bd3545180 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:45:40.718158 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-5a4396d9-5393-4689-b099-6b2bd3545180 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:45:40.719332 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-5a4396d9-5393-4689-b099-6b2bd3545180 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672" status: 200 len: 1725 microversion: 2.20 time: 0.164625 Oct 27 15:45:40.719910 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 290/517] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Oct 27 15:45:40 2021] GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672 => generated 1725 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 15:45:40.794932 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-6ae6c9d6-ddc6-4ec1-a231-ba1ec13cdbe9 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:45:40.795526 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-6ae6c9d6-ddc6-4ec1-a231-ba1ec13cdbe9 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: 62c89161-c119-48b2-839d-712db798ff96] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:45:40.801584 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-6ae6c9d6-ddc6-4ec1-a231-ba1ec13cdbe9 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:45:40.802033 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-6ae6c9d6-ddc6-4ec1-a231-ba1ec13cdbe9 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:45:40.802818 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-6ae6c9d6-ddc6-4ec1-a231-ba1ec13cdbe9 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:45:40.803256 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-6ae6c9d6-ddc6-4ec1-a231-ba1ec13cdbe9 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:45:40.927938 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-6ae6c9d6-ddc6-4ec1-a231-ba1ec13cdbe9 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96b599f8890b4281a7e311cf37a039e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d7fcab5d3f465793d650f16c6ea8de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:45:40.936101 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-6ae6c9d6-ddc6-4ec1-a231-ba1ec13cdbe9 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96" status: 200 len: 1567 microversion: 2.1 time: 0.145161 Oct 27 15:45:40.936667 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 291/518] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:45:40 2021] GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96 => generated 1567 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 15:45:41.303523 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-60e89389-536f-4e59-8fce-225a8bea828a tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:45:41.304162 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-60e89389-536f-4e59-8fce-225a8bea828a tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] [instance: a4e225e4-7815-4f6a-b1e6-53edab3c1abd] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:45:41.310140 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-60e89389-536f-4e59-8fce-225a8bea828a tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:45:41.310583 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-60e89389-536f-4e59-8fce-225a8bea828a tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:45:41.311343 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-60e89389-536f-4e59-8fce-225a8bea828a tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:45:41.311774 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-60e89389-536f-4e59-8fce-225a8bea828a tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:45:41.337075 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-60e89389-536f-4e59-8fce-225a8bea828a tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] [instance: a4e225e4-7815-4f6a-b1e6-53edab3c1abd] Going to try to terminate instance {{(pid=122224) delete /opt/stack/nova/nova/compute/api.py:2612}} Oct 27 15:45:41.411187 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-60e89389-536f-4e59-8fce-225a8bea828a tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] 10.222.0.64 "DELETE /compute/v2.1/servers/a4e225e4-7815-4f6a-b1e6-53edab3c1abd" status: 204 len: 0 microversion: 2.1 time: 0.111199 Oct 27 15:45:41.412192 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 292/519] 10.222.0.64 () {58 vars in 1238 bytes} [Wed Oct 27 15:45:41 2021] DELETE /compute/v2.1/servers/a4e225e4-7815-4f6a-b1e6-53edab3c1abd => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 27 15:45:41.422788 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-8a9b441f-3d9f-4a70-bc14-001f2e7289d3 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:45:41.423479 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-8a9b441f-3d9f-4a70-bc14-001f2e7289d3 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] [instance: a4e225e4-7815-4f6a-b1e6-53edab3c1abd] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:45:41.429626 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-8a9b441f-3d9f-4a70-bc14-001f2e7289d3 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:45:41.430084 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-8a9b441f-3d9f-4a70-bc14-001f2e7289d3 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:45:41.430832 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-8a9b441f-3d9f-4a70-bc14-001f2e7289d3 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:45:41.431261 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-8a9b441f-3d9f-4a70-bc14-001f2e7289d3 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:45:41.562087 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-8a9b441f-3d9f-4a70-bc14-001f2e7289d3 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0abe23cb5f314bc883ef7958b0ed9b5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fc48df471f247809d82ddf926bfdc6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:45:41.571014 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-8a9b441f-3d9f-4a70-bc14-001f2e7289d3 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] 10.222.0.64 "GET /compute/v2.1/servers/a4e225e4-7815-4f6a-b1e6-53edab3c1abd" status: 200 len: 1512 microversion: 2.1 time: 0.153473 Oct 27 15:45:41.571602 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 293/520] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:45:41 2021] GET /compute/v2.1/servers/a4e225e4-7815-4f6a-b1e6-53edab3c1abd => generated 1512 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 15:45:41.740280 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-ef5584a0-8006-48d9-bcc3-c65e663b508c tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:45:41.740882 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-ef5584a0-8006-48d9-bcc3-c65e663b508c tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:45:41.746791 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-ef5584a0-8006-48d9-bcc3-c65e663b508c tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:45:41.747230 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-ef5584a0-8006-48d9-bcc3-c65e663b508c tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:45:41.748016 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-ef5584a0-8006-48d9-bcc3-c65e663b508c tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:45:41.748444 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-ef5584a0-8006-48d9-bcc3-c65e663b508c tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:45:41.869221 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-ef5584a0-8006-48d9-bcc3-c65e663b508c tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:45:41.877386 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-ef5584a0-8006-48d9-bcc3-c65e663b508c tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:45:41.879515 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-ef5584a0-8006-48d9-bcc3-c65e663b508c tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:45:41.880858 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-ef5584a0-8006-48d9-bcc3-c65e663b508c tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672" status: 200 len: 1725 microversion: 2.20 time: 0.145118 Oct 27 15:45:41.881420 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 294/521] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Oct 27 15:45:41 2021] GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672 => generated 1725 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 15:45:41.952700 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-34e410db-7641-41db-afd0-2e2778002c5e tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:45:41.953303 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-34e410db-7641-41db-afd0-2e2778002c5e tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: 62c89161-c119-48b2-839d-712db798ff96] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:45:41.959252 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-34e410db-7641-41db-afd0-2e2778002c5e tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:45:41.959703 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-34e410db-7641-41db-afd0-2e2778002c5e tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:45:41.960513 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-34e410db-7641-41db-afd0-2e2778002c5e tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:45:41.960945 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-34e410db-7641-41db-afd0-2e2778002c5e tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:45:42.090086 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-34e410db-7641-41db-afd0-2e2778002c5e tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96b599f8890b4281a7e311cf37a039e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d7fcab5d3f465793d650f16c6ea8de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:45:42.098703 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-34e410db-7641-41db-afd0-2e2778002c5e tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96" status: 200 len: 1567 microversion: 2.1 time: 0.149116 Oct 27 15:45:42.099284 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 295/522] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:45:41 2021] GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96 => generated 1567 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 15:45:42.588578 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-538ecf83-76eb-473d-85b7-27ae475cad05 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:45:42.589349 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-538ecf83-76eb-473d-85b7-27ae475cad05 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] [instance: a4e225e4-7815-4f6a-b1e6-53edab3c1abd] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:45:42.595279 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-538ecf83-76eb-473d-85b7-27ae475cad05 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:45:42.595717 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-538ecf83-76eb-473d-85b7-27ae475cad05 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:45:42.596598 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-538ecf83-76eb-473d-85b7-27ae475cad05 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:45:42.597075 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-538ecf83-76eb-473d-85b7-27ae475cad05 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:45:42.732612 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-538ecf83-76eb-473d-85b7-27ae475cad05 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0abe23cb5f314bc883ef7958b0ed9b5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fc48df471f247809d82ddf926bfdc6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:45:42.741147 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-538ecf83-76eb-473d-85b7-27ae475cad05 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] 10.222.0.64 "GET /compute/v2.1/servers/a4e225e4-7815-4f6a-b1e6-53edab3c1abd" status: 200 len: 1512 microversion: 2.1 time: 0.156194 Oct 27 15:45:42.741863 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 296/523] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:45:42 2021] GET /compute/v2.1/servers/a4e225e4-7815-4f6a-b1e6-53edab3c1abd => generated 1512 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 15:45:42.900085 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-1ac6da5f-f9e2-4745-93cc-4c821a5b5a0d tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:45:42.900699 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-1ac6da5f-f9e2-4745-93cc-4c821a5b5a0d tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:45:42.908274 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-1ac6da5f-f9e2-4745-93cc-4c821a5b5a0d tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:45:42.908716 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-1ac6da5f-f9e2-4745-93cc-4c821a5b5a0d tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:45:42.909487 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-1ac6da5f-f9e2-4745-93cc-4c821a5b5a0d tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:45:42.910616 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-1ac6da5f-f9e2-4745-93cc-4c821a5b5a0d tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:45:43.120299 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-1ac6da5f-f9e2-4745-93cc-4c821a5b5a0d tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:45:43.134588 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-1ac6da5f-f9e2-4745-93cc-4c821a5b5a0d tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:45:43.137512 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-1ac6da5f-f9e2-4745-93cc-4c821a5b5a0d tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:45:43.139717 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-1ac6da5f-f9e2-4745-93cc-4c821a5b5a0d tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672" status: 200 len: 1746 microversion: 2.20 time: 0.244012 Oct 27 15:45:43.140961 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 297/524] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Oct 27 15:45:42 2021] GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672 => generated 1746 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 15:45:43.159248 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-d726aa4b-3811-48aa-a2e4-834b1882920e tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:45:43.160307 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-d726aa4b-3811-48aa-a2e4-834b1882920e tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: 62c89161-c119-48b2-839d-712db798ff96] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:45:43.166759 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-d726aa4b-3811-48aa-a2e4-834b1882920e tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:45:43.167317 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-d726aa4b-3811-48aa-a2e4-834b1882920e tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:45:43.168368 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-d726aa4b-3811-48aa-a2e4-834b1882920e tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:45:43.170936 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-d726aa4b-3811-48aa-a2e4-834b1882920e tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:45:43.392744 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-d726aa4b-3811-48aa-a2e4-834b1882920e tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96b599f8890b4281a7e311cf37a039e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d7fcab5d3f465793d650f16c6ea8de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:45:43.400935 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-d726aa4b-3811-48aa-a2e4-834b1882920e tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96" status: 200 len: 1567 microversion: 2.1 time: 0.246139 Oct 27 15:45:43.401735 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 298/525] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:45:43 2021] GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96 => generated 1567 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 15:45:43.761566 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-5d33e913-64f7-4ab2-b365-08174bab5751 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:45:43.762301 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-5d33e913-64f7-4ab2-b365-08174bab5751 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] [instance: a4e225e4-7815-4f6a-b1e6-53edab3c1abd] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:45:43.768782 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-5d33e913-64f7-4ab2-b365-08174bab5751 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:45:43.769275 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-5d33e913-64f7-4ab2-b365-08174bab5751 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:45:43.770595 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-5d33e913-64f7-4ab2-b365-08174bab5751 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:45:43.771025 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-5d33e913-64f7-4ab2-b365-08174bab5751 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:45:43.921353 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-5d33e913-64f7-4ab2-b365-08174bab5751 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0abe23cb5f314bc883ef7958b0ed9b5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fc48df471f247809d82ddf926bfdc6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:45:43.930296 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-5d33e913-64f7-4ab2-b365-08174bab5751 tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] 10.222.0.64 "GET /compute/v2.1/servers/a4e225e4-7815-4f6a-b1e6-53edab3c1abd" status: 200 len: 1512 microversion: 2.1 time: 0.173513 Oct 27 15:45:43.930888 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 299/526] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:45:43 2021] GET /compute/v2.1/servers/a4e225e4-7815-4f6a-b1e6-53edab3c1abd => generated 1512 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 15:45:44.168632 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-42dbdd78-1405-4a44-987d-7baf97eba287 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:45:44.169300 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-42dbdd78-1405-4a44-987d-7baf97eba287 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:45:44.178848 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-42dbdd78-1405-4a44-987d-7baf97eba287 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:45:44.179761 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-42dbdd78-1405-4a44-987d-7baf97eba287 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:45:44.180828 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-42dbdd78-1405-4a44-987d-7baf97eba287 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:45:44.181304 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-42dbdd78-1405-4a44-987d-7baf97eba287 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:45:44.333380 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-42dbdd78-1405-4a44-987d-7baf97eba287 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:45:44.345461 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-42dbdd78-1405-4a44-987d-7baf97eba287 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:45:44.346983 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-42dbdd78-1405-4a44-987d-7baf97eba287 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:45:44.350016 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-42dbdd78-1405-4a44-987d-7baf97eba287 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672" status: 200 len: 1746 microversion: 2.20 time: 0.184887 Oct 27 15:45:44.350766 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 300/527] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Oct 27 15:45:44 2021] GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672 => generated 1746 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 15:45:44.419565 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-f2ddaa47-68b0-426f-acd5-5436d3cd90e8 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:45:44.420110 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-f2ddaa47-68b0-426f-acd5-5436d3cd90e8 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: 62c89161-c119-48b2-839d-712db798ff96] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:45:44.429604 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-f2ddaa47-68b0-426f-acd5-5436d3cd90e8 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:45:44.431018 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-f2ddaa47-68b0-426f-acd5-5436d3cd90e8 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:45:44.431885 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-f2ddaa47-68b0-426f-acd5-5436d3cd90e8 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:45:44.432316 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-f2ddaa47-68b0-426f-acd5-5436d3cd90e8 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:45:44.720541 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-f2ddaa47-68b0-426f-acd5-5436d3cd90e8 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96b599f8890b4281a7e311cf37a039e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d7fcab5d3f465793d650f16c6ea8de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:45:44.756406 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-f2ddaa47-68b0-426f-acd5-5436d3cd90e8 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96" status: 200 len: 1567 microversion: 2.1 time: 0.335963 Oct 27 15:45:44.767881 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 301/528] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:45:44 2021] GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96 => generated 1567 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 15:45:44.947661 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-5f88b25d-67c7-4a9c-84b3-aa97ba8fd04e tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:45:44.950909 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-5f88b25d-67c7-4a9c-84b3-aa97ba8fd04e tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] [instance: a4e225e4-7815-4f6a-b1e6-53edab3c1abd] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:45:44.955628 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-5f88b25d-67c7-4a9c-84b3-aa97ba8fd04e tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:45:44.956090 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-5f88b25d-67c7-4a9c-84b3-aa97ba8fd04e tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:45:44.957267 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-5f88b25d-67c7-4a9c-84b3-aa97ba8fd04e tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:45:44.957483 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-5f88b25d-67c7-4a9c-84b3-aa97ba8fd04e tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:45:45.206324 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-5f88b25d-67c7-4a9c-84b3-aa97ba8fd04e tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0abe23cb5f314bc883ef7958b0ed9b5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fc48df471f247809d82ddf926bfdc6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:45:45.215114 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-5f88b25d-67c7-4a9c-84b3-aa97ba8fd04e tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] 10.222.0.64 "GET /compute/v2.1/servers/a4e225e4-7815-4f6a-b1e6-53edab3c1abd" status: 200 len: 1512 microversion: 2.1 time: 0.271221 Oct 27 15:45:45.215697 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 302/529] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:45:44 2021] GET /compute/v2.1/servers/a4e225e4-7815-4f6a-b1e6-53edab3c1abd => generated 1512 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 15:45:45.220304 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [req-0a3c4130-ff6d-4fe6-bf54-1f38facebd60 req-749f1e3d-38e5-4cda-974a-2c0b22c80d0d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a4e225e4-7815-4f6a-b1e6-53edab3c1abd", "name": "network-vif-deleted", "tag": "fb349725-2f48-49da-a6bd-4dd4cd255a4f"}]} {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 15:45:45.222456 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 27 15:45:45.222456 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: warnings.warn(msg) Oct 27 15:45:45.233494 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [req-0a3c4130-ff6d-4fe6-bf54-1f38facebd60 req-749f1e3d-38e5-4cda-974a-2c0b22c80d0d service nova] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:45:45.233931 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [req-0a3c4130-ff6d-4fe6-bf54-1f38facebd60 req-749f1e3d-38e5-4cda-974a-2c0b22c80d0d service nova] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:45:45.246807 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.compute.server_external_events [req-0a3c4130-ff6d-4fe6-bf54-1f38facebd60 req-749f1e3d-38e5-4cda-974a-2c0b22c80d0d service nova] Creating event network-vif-deleted:fb349725-2f48-49da-a6bd-4dd4cd255a4f for instance a4e225e4-7815-4f6a-b1e6-53edab3c1abd on hv-cinder-80070 Oct 27 15:45:45.251612 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [req-0a3c4130-ff6d-4fe6-bf54-1f38facebd60 req-749f1e3d-38e5-4cda-974a-2c0b22c80d0d service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034793 Oct 27 15:45:45.252486 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 303/530] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Oct 27 15:45:45 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 15:45:45.369882 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-fc9f8107-cbfa-45ff-9fd1-4b16a19da5ea tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:45:45.370601 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-fc9f8107-cbfa-45ff-9fd1-4b16a19da5ea tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:45:45.376811 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-fc9f8107-cbfa-45ff-9fd1-4b16a19da5ea tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:45:45.377256 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-fc9f8107-cbfa-45ff-9fd1-4b16a19da5ea tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:45:45.378043 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-fc9f8107-cbfa-45ff-9fd1-4b16a19da5ea tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:45:45.378479 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-fc9f8107-cbfa-45ff-9fd1-4b16a19da5ea tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:45:45.513139 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-fc9f8107-cbfa-45ff-9fd1-4b16a19da5ea tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:45:45.522220 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-fc9f8107-cbfa-45ff-9fd1-4b16a19da5ea tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:45:45.523714 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-fc9f8107-cbfa-45ff-9fd1-4b16a19da5ea tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:45:45.524931 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-fc9f8107-cbfa-45ff-9fd1-4b16a19da5ea tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672" status: 200 len: 1741 microversion: 2.20 time: 0.159217 Oct 27 15:45:45.525489 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 304/531] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Oct 27 15:45:45 2021] GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672 => generated 1741 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 15:45:45.788319 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-510f5816-ee78-4157-8c0d-03a191e2f91f tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:45:45.789006 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-510f5816-ee78-4157-8c0d-03a191e2f91f tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: 62c89161-c119-48b2-839d-712db798ff96] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:45:45.794939 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-510f5816-ee78-4157-8c0d-03a191e2f91f tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:45:45.795393 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-510f5816-ee78-4157-8c0d-03a191e2f91f tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:45:45.796221 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-510f5816-ee78-4157-8c0d-03a191e2f91f tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:45:45.796862 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-510f5816-ee78-4157-8c0d-03a191e2f91f tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:45:45.935655 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-510f5816-ee78-4157-8c0d-03a191e2f91f tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96b599f8890b4281a7e311cf37a039e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d7fcab5d3f465793d650f16c6ea8de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:45:45.944593 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-510f5816-ee78-4157-8c0d-03a191e2f91f tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96" status: 200 len: 1567 microversion: 2.1 time: 0.159936 Oct 27 15:45:45.945177 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 305/532] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:45:45 2021] GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96 => generated 1567 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 15:45:46.233156 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-6a91dc4e-c6a1-47d4-8e0c-844aaf0cf94f tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:45:46.233787 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-6a91dc4e-c6a1-47d4-8e0c-844aaf0cf94f tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] [instance: a4e225e4-7815-4f6a-b1e6-53edab3c1abd] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:45:46.240674 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-6a91dc4e-c6a1-47d4-8e0c-844aaf0cf94f tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:45:46.241138 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-6a91dc4e-c6a1-47d4-8e0c-844aaf0cf94f tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:45:46.241910 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-6a91dc4e-c6a1-47d4-8e0c-844aaf0cf94f tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:45:46.242345 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-6a91dc4e-c6a1-47d4-8e0c-844aaf0cf94f tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:45:46.256930 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.wsgi [None req-6a91dc4e-c6a1-47d4-8e0c-844aaf0cf94f tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] HTTP exception thrown: Instance a4e225e4-7815-4f6a-b1e6-53edab3c1abd could not be found. Oct 27 15:45:46.258691 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-6a91dc4e-c6a1-47d4-8e0c-844aaf0cf94f tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] Returning 404 to user: Instance a4e225e4-7815-4f6a-b1e6-53edab3c1abd could not be found. {{(pid=122224) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 27 15:45:46.258691 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-6a91dc4e-c6a1-47d4-8e0c-844aaf0cf94f tempest-AttachVolumeNegativeTest-1355281852 tempest-AttachVolumeNegativeTest-1355281852-project] 10.222.0.64 "GET /compute/v2.1/servers/a4e225e4-7815-4f6a-b1e6-53edab3c1abd" status: 404 len: 111 microversion: 2.1 time: 0.028865 Oct 27 15:45:46.259136 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 306/533] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:45:46 2021] GET /compute/v2.1/servers/a4e225e4-7815-4f6a-b1e6-53edab3c1abd => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 27 15:45:46.487034 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [req-6952c051-b608-4d4f-802b-d46b5d7b1b62 req-3363dac7-f730-4a85-bdfe-21e2a59fd1f0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a115c672-012e-4e45-b5c9-4427e7b66672", "name": "network-vif-plugged", "status": "completed", "tag": "c9ac335c-5a25-416c-803f-ac2f3d462176"}]} {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 15:45:46.489451 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 27 15:45:46.489451 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: warnings.warn(msg) Oct 27 15:45:46.498226 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [req-6952c051-b608-4d4f-802b-d46b5d7b1b62 req-3363dac7-f730-4a85-bdfe-21e2a59fd1f0 service nova] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:45:46.499051 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [req-6952c051-b608-4d4f-802b-d46b5d7b1b62 req-3363dac7-f730-4a85-bdfe-21e2a59fd1f0 service nova] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:45:46.517140 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.compute.server_external_events [req-6952c051-b608-4d4f-802b-d46b5d7b1b62 req-3363dac7-f730-4a85-bdfe-21e2a59fd1f0 service nova] Creating event network-vif-plugged:c9ac335c-5a25-416c-803f-ac2f3d462176 for instance a115c672-012e-4e45-b5c9-4427e7b66672 on hv-cinder-80070 Oct 27 15:45:46.526770 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [req-6952c051-b608-4d4f-802b-d46b5d7b1b62 req-3363dac7-f730-4a85-bdfe-21e2a59fd1f0 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044202 Oct 27 15:45:46.527477 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 307/534] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Oct 27 15:45:46 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 15:45:46.543505 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-fa90e1dc-4869-4626-926c-51426ad68e99 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:45:46.544244 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-fa90e1dc-4869-4626-926c-51426ad68e99 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:45:46.556151 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-fa90e1dc-4869-4626-926c-51426ad68e99 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:45:46.556907 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-fa90e1dc-4869-4626-926c-51426ad68e99 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:45:46.557861 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-fa90e1dc-4869-4626-926c-51426ad68e99 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:45:46.558507 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-fa90e1dc-4869-4626-926c-51426ad68e99 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:45:46.771339 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-fa90e1dc-4869-4626-926c-51426ad68e99 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:45:46.780464 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-fa90e1dc-4869-4626-926c-51426ad68e99 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:45:46.784149 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-fa90e1dc-4869-4626-926c-51426ad68e99 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:45:46.785564 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-fa90e1dc-4869-4626-926c-51426ad68e99 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672" status: 200 len: 1741 microversion: 2.20 time: 0.246092 Oct 27 15:45:46.787380 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 308/535] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Oct 27 15:45:46 2021] GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672 => generated 1741 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 15:45:46.962736 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-31165bf9-ecf4-4e1b-b0d2-7c9da630c3b5 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:45:46.964137 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-31165bf9-ecf4-4e1b-b0d2-7c9da630c3b5 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: 62c89161-c119-48b2-839d-712db798ff96] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:45:46.970111 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-31165bf9-ecf4-4e1b-b0d2-7c9da630c3b5 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:45:46.970709 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-31165bf9-ecf4-4e1b-b0d2-7c9da630c3b5 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:45:46.971509 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-31165bf9-ecf4-4e1b-b0d2-7c9da630c3b5 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:45:46.971975 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-31165bf9-ecf4-4e1b-b0d2-7c9da630c3b5 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:45:47.113535 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-31165bf9-ecf4-4e1b-b0d2-7c9da630c3b5 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96b599f8890b4281a7e311cf37a039e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d7fcab5d3f465793d650f16c6ea8de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:45:47.124981 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-31165bf9-ecf4-4e1b-b0d2-7c9da630c3b5 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96" status: 200 len: 1567 microversion: 2.1 time: 0.164860 Oct 27 15:45:47.124981 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 309/536] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:45:46 2021] GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96 => generated 1567 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 15:45:47.805441 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-7740eab8-fda0-439a-8fd5-5763c730a902 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:45:47.806061 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-7740eab8-fda0-439a-8fd5-5763c730a902 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:45:47.812732 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-7740eab8-fda0-439a-8fd5-5763c730a902 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:45:47.813188 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-7740eab8-fda0-439a-8fd5-5763c730a902 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:45:47.813951 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-7740eab8-fda0-439a-8fd5-5763c730a902 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:45:47.814388 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-7740eab8-fda0-439a-8fd5-5763c730a902 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:45:47.965192 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-7740eab8-fda0-439a-8fd5-5763c730a902 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:45:47.973636 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-7740eab8-fda0-439a-8fd5-5763c730a902 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:45:47.977139 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-7740eab8-fda0-439a-8fd5-5763c730a902 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:45:47.978421 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-7740eab8-fda0-439a-8fd5-5763c730a902 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672" status: 200 len: 1741 microversion: 2.20 time: 0.177390 Oct 27 15:45:47.979126 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 310/537] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Oct 27 15:45:47 2021] GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672 => generated 1741 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 15:45:48.142640 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-afaee0ba-bed2-4f81-b7f6-9bd1307f6f3a tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:45:48.143248 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-afaee0ba-bed2-4f81-b7f6-9bd1307f6f3a tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: 62c89161-c119-48b2-839d-712db798ff96] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:45:48.149850 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-afaee0ba-bed2-4f81-b7f6-9bd1307f6f3a tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:45:48.150294 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-afaee0ba-bed2-4f81-b7f6-9bd1307f6f3a tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:45:48.151099 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-afaee0ba-bed2-4f81-b7f6-9bd1307f6f3a tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:45:48.151532 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-afaee0ba-bed2-4f81-b7f6-9bd1307f6f3a tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:45:48.292597 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.network.neutron [None req-97e8765b-5743-4211-8ebf-4a1db1e20b7c tempest-VolumesNegativeTest-2132035956 tempest-VolumesNegativeTest-2132035956-project] validate_networks() for None {{(pid=122225) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Oct 27 15:45:48.329298 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-afaee0ba-bed2-4f81-b7f6-9bd1307f6f3a tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96b599f8890b4281a7e311cf37a039e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d7fcab5d3f465793d650f16c6ea8de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:45:48.344173 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-afaee0ba-bed2-4f81-b7f6-9bd1307f6f3a tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96" status: 200 len: 1567 microversion: 2.1 time: 0.204933 Oct 27 15:45:48.349476 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 311/538] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:45:48 2021] GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96 => generated 1567 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 15:45:48.616821 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.virt.hardware [None req-97e8765b-5743-4211-8ebf-4a1db1e20b7c tempest-VolumesNegativeTest-2132035956 tempest-VolumesNegativeTest-2132035956-project] Flavor limits 0:0:0 {{(pid=122225) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 15:45:48.617564 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.virt.hardware [None req-97e8765b-5743-4211-8ebf-4a1db1e20b7c tempest-VolumesNegativeTest-2132035956 tempest-VolumesNegativeTest-2132035956-project] Image limits 0:0:0 {{(pid=122225) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 15:45:48.618210 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.virt.hardware [None req-97e8765b-5743-4211-8ebf-4a1db1e20b7c tempest-VolumesNegativeTest-2132035956 tempest-VolumesNegativeTest-2132035956-project] Flavor pref 0:0:0 {{(pid=122225) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 15:45:48.618935 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.virt.hardware [None req-97e8765b-5743-4211-8ebf-4a1db1e20b7c tempest-VolumesNegativeTest-2132035956 tempest-VolumesNegativeTest-2132035956-project] Image pref 0:0:0 {{(pid=122225) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 15:45:48.619788 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.virt.hardware [None req-97e8765b-5743-4211-8ebf-4a1db1e20b7c tempest-VolumesNegativeTest-2132035956 tempest-VolumesNegativeTest-2132035956-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122225) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 15:45:48.630771 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-97e8765b-5743-4211-8ebf-4a1db1e20b7c tempest-VolumesNegativeTest-2132035956 tempest-VolumesNegativeTest-2132035956-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:45:48.631684 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-97e8765b-5743-4211-8ebf-4a1db1e20b7c tempest-VolumesNegativeTest-2132035956 tempest-VolumesNegativeTest-2132035956-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:45:48.632542 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-97e8765b-5743-4211-8ebf-4a1db1e20b7c tempest-VolumesNegativeTest-2132035956 tempest-VolumesNegativeTest-2132035956-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:45:48.633001 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-97e8765b-5743-4211-8ebf-4a1db1e20b7c tempest-VolumesNegativeTest-2132035956 tempest-VolumesNegativeTest-2132035956-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:45:48.659894 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.quota [None req-97e8765b-5743-4211-8ebf-4a1db1e20b7c tempest-VolumesNegativeTest-2132035956 tempest-VolumesNegativeTest-2132035956-project] Getting quotas for project ccaff4cb8c9f424ca1305e4eafac8c50. Resources: {'ram', 'instances', 'cores'} {{(pid=122225) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 27 15:45:48.664907 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.quota [None req-97e8765b-5743-4211-8ebf-4a1db1e20b7c tempest-VolumesNegativeTest-2132035956 tempest-VolumesNegativeTest-2132035956-project] Getting quotas for user 88a99f03499f4af49c5da201ee2e9973 and project ccaff4cb8c9f424ca1305e4eafac8c50. Resources: {'ram', 'instances', 'cores'} {{(pid=122225) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 27 15:45:48.678632 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-97e8765b-5743-4211-8ebf-4a1db1e20b7c tempest-VolumesNegativeTest-2132035956 tempest-VolumesNegativeTest-2132035956-project] Going to run 1 instances... {{(pid=122225) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Oct 27 15:45:48.681415 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-97e8765b-5743-4211-8ebf-4a1db1e20b7c tempest-VolumesNegativeTest-2132035956 tempest-VolumesNegativeTest-2132035956-project] [instance: fa9eb157-6ba2-4953-b2b7-9b2e83f97878] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b585ffbc-6a36-48c9-81b3-e26f9bd0fcba',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122225) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Oct 27 15:45:48.734002 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-97e8765b-5743-4211-8ebf-4a1db1e20b7c tempest-VolumesNegativeTest-2132035956 tempest-VolumesNegativeTest-2132035956-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 11.356110 Oct 27 15:45:48.736143 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 228/539] 10.222.0.64 () {60 vars in 1146 bytes} [Wed Oct 27 15:45:37 2021] POST /compute/v2.1/servers => generated 380 bytes in 11362 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 15:45:48.744104 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-710b8e6f-c65a-414f-ade0-96208c57d726 tempest-VolumesNegativeTest-2132035956 tempest-VolumesNegativeTest-2132035956-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:45:48.744648 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-710b8e6f-c65a-414f-ade0-96208c57d726 tempest-VolumesNegativeTest-2132035956 tempest-VolumesNegativeTest-2132035956-project] [instance: fa9eb157-6ba2-4953-b2b7-9b2e83f97878] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:45:48.814477 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-710b8e6f-c65a-414f-ade0-96208c57d726 tempest-VolumesNegativeTest-2132035956 tempest-VolumesNegativeTest-2132035956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88a99f03499f4af49c5da201ee2e9973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccaff4cb8c9f424ca1305e4eafac8c50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:45:48.822362 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-710b8e6f-c65a-414f-ade0-96208c57d726 tempest-VolumesNegativeTest-2132035956 tempest-VolumesNegativeTest-2132035956-project] 10.222.0.64 "GET /compute/v2.1/servers/fa9eb157-6ba2-4953-b2b7-9b2e83f97878" status: 200 len: 1215 microversion: 2.1 time: 0.083690 Oct 27 15:45:48.822953 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 312/540] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:45:48 2021] GET /compute/v2.1/servers/fa9eb157-6ba2-4953-b2b7-9b2e83f97878 => generated 1215 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 15:45:48.997572 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-551b40af-cf0c-42b8-bd78-793e2718c1d0 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:45:48.998719 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-551b40af-cf0c-42b8-bd78-793e2718c1d0 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:45:49.006503 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-551b40af-cf0c-42b8-bd78-793e2718c1d0 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:45:49.007121 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-551b40af-cf0c-42b8-bd78-793e2718c1d0 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:45:49.008237 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-551b40af-cf0c-42b8-bd78-793e2718c1d0 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:45:49.008835 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-551b40af-cf0c-42b8-bd78-793e2718c1d0 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:45:49.237744 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-551b40af-cf0c-42b8-bd78-793e2718c1d0 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:45:49.252309 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-551b40af-cf0c-42b8-bd78-793e2718c1d0 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:45:49.254281 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-551b40af-cf0c-42b8-bd78-793e2718c1d0 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:45:49.257053 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-551b40af-cf0c-42b8-bd78-793e2718c1d0 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672" status: 200 len: 1741 microversion: 2.20 time: 0.263072 Oct 27 15:45:49.257931 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 229/541] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Oct 27 15:45:48 2021] GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672 => generated 1741 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 15:45:49.366065 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-1d1ac02f-18e8-4b92-a9f0-c7366bb9a37c tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:45:49.366697 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-1d1ac02f-18e8-4b92-a9f0-c7366bb9a37c tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: 62c89161-c119-48b2-839d-712db798ff96] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:45:49.373973 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-1d1ac02f-18e8-4b92-a9f0-c7366bb9a37c tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:45:49.374418 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-1d1ac02f-18e8-4b92-a9f0-c7366bb9a37c tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:45:49.375198 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-1d1ac02f-18e8-4b92-a9f0-c7366bb9a37c tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:45:49.375633 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-1d1ac02f-18e8-4b92-a9f0-c7366bb9a37c tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:45:49.535014 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-1d1ac02f-18e8-4b92-a9f0-c7366bb9a37c tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96b599f8890b4281a7e311cf37a039e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d7fcab5d3f465793d650f16c6ea8de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:45:49.556784 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-1d1ac02f-18e8-4b92-a9f0-c7366bb9a37c tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96" status: 200 len: 1567 microversion: 2.1 time: 0.195083 Oct 27 15:45:49.557415 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 313/542] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:45:49 2021] GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96 => generated 1567 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 15:45:49.842004 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-e96165a9-8e21-44a8-b4f9-52358719bf2f tempest-VolumesNegativeTest-2132035956 tempest-VolumesNegativeTest-2132035956-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:45:49.844046 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-e96165a9-8e21-44a8-b4f9-52358719bf2f tempest-VolumesNegativeTest-2132035956 tempest-VolumesNegativeTest-2132035956-project] [instance: fa9eb157-6ba2-4953-b2b7-9b2e83f97878] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:45:49.853512 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-e96165a9-8e21-44a8-b4f9-52358719bf2f tempest-VolumesNegativeTest-2132035956 tempest-VolumesNegativeTest-2132035956-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:45:49.854302 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-e96165a9-8e21-44a8-b4f9-52358719bf2f tempest-VolumesNegativeTest-2132035956 tempest-VolumesNegativeTest-2132035956-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:45:49.855082 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-e96165a9-8e21-44a8-b4f9-52358719bf2f tempest-VolumesNegativeTest-2132035956 tempest-VolumesNegativeTest-2132035956-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:45:49.855510 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-e96165a9-8e21-44a8-b4f9-52358719bf2f tempest-VolumesNegativeTest-2132035956 tempest-VolumesNegativeTest-2132035956-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:45:49.930714 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-e96165a9-8e21-44a8-b4f9-52358719bf2f tempest-VolumesNegativeTest-2132035956 tempest-VolumesNegativeTest-2132035956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88a99f03499f4af49c5da201ee2e9973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccaff4cb8c9f424ca1305e4eafac8c50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:45:49.944520 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-e96165a9-8e21-44a8-b4f9-52358719bf2f tempest-VolumesNegativeTest-2132035956 tempest-VolumesNegativeTest-2132035956-project] 10.222.0.64 "GET /compute/v2.1/servers/fa9eb157-6ba2-4953-b2b7-9b2e83f97878" status: 200 len: 1267 microversion: 2.1 time: 0.106804 Oct 27 15:45:49.945330 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 230/543] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:45:49 2021] GET /compute/v2.1/servers/fa9eb157-6ba2-4953-b2b7-9b2e83f97878 => generated 1267 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 15:45:50.275803 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-c0902f4e-62eb-481e-9347-6a6bd78c64ee tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:45:50.276501 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-c0902f4e-62eb-481e-9347-6a6bd78c64ee tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:45:50.288202 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-c0902f4e-62eb-481e-9347-6a6bd78c64ee tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:45:50.289655 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-c0902f4e-62eb-481e-9347-6a6bd78c64ee tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:45:50.290805 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-c0902f4e-62eb-481e-9347-6a6bd78c64ee tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:45:50.292439 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-c0902f4e-62eb-481e-9347-6a6bd78c64ee tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:45:50.573873 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-08c93905-ba91-4688-978f-a81614e1d37a tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:45:50.574472 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-08c93905-ba91-4688-978f-a81614e1d37a tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: 62c89161-c119-48b2-839d-712db798ff96] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:45:50.592765 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-08c93905-ba91-4688-978f-a81614e1d37a tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:45:50.592765 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-08c93905-ba91-4688-978f-a81614e1d37a tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:45:50.593283 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-08c93905-ba91-4688-978f-a81614e1d37a tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:45:50.593717 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-08c93905-ba91-4688-978f-a81614e1d37a tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:45:50.821106 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-c0902f4e-62eb-481e-9347-6a6bd78c64ee tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:45:50.829140 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-c0902f4e-62eb-481e-9347-6a6bd78c64ee tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:45:50.832307 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-08c93905-ba91-4688-978f-a81614e1d37a tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96b599f8890b4281a7e311cf37a039e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d7fcab5d3f465793d650f16c6ea8de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:45:50.834323 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-c0902f4e-62eb-481e-9347-6a6bd78c64ee tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:45:50.835534 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-c0902f4e-62eb-481e-9347-6a6bd78c64ee tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672" status: 200 len: 1741 microversion: 2.20 time: 0.564319 Oct 27 15:45:50.841433 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 314/544] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Oct 27 15:45:50 2021] GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672 => generated 1741 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 15:45:50.841845 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-08c93905-ba91-4688-978f-a81614e1d37a tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96" status: 200 len: 1567 microversion: 2.1 time: 0.271288 Oct 27 15:45:50.843055 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 231/545] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:45:50 2021] GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96 => generated 1567 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 15:45:50.966972 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-6bfa3799-11be-4d81-a4ab-503dbc2cdba6 tempest-VolumesNegativeTest-2132035956 tempest-VolumesNegativeTest-2132035956-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:45:50.972082 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-6bfa3799-11be-4d81-a4ab-503dbc2cdba6 tempest-VolumesNegativeTest-2132035956 tempest-VolumesNegativeTest-2132035956-project] [instance: fa9eb157-6ba2-4953-b2b7-9b2e83f97878] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:45:50.989731 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-6bfa3799-11be-4d81-a4ab-503dbc2cdba6 tempest-VolumesNegativeTest-2132035956 tempest-VolumesNegativeTest-2132035956-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:45:50.991027 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-6bfa3799-11be-4d81-a4ab-503dbc2cdba6 tempest-VolumesNegativeTest-2132035956 tempest-VolumesNegativeTest-2132035956-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:45:50.992696 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-6bfa3799-11be-4d81-a4ab-503dbc2cdba6 tempest-VolumesNegativeTest-2132035956 tempest-VolumesNegativeTest-2132035956-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:45:50.993729 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-6bfa3799-11be-4d81-a4ab-503dbc2cdba6 tempest-VolumesNegativeTest-2132035956 tempest-VolumesNegativeTest-2132035956-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:45:51.155431 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-6bfa3799-11be-4d81-a4ab-503dbc2cdba6 tempest-VolumesNegativeTest-2132035956 tempest-VolumesNegativeTest-2132035956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88a99f03499f4af49c5da201ee2e9973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccaff4cb8c9f424ca1305e4eafac8c50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:45:51.165570 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-6bfa3799-11be-4d81-a4ab-503dbc2cdba6 tempest-VolumesNegativeTest-2132035956 tempest-VolumesNegativeTest-2132035956-project] 10.222.0.64 "GET /compute/v2.1/servers/fa9eb157-6ba2-4953-b2b7-9b2e83f97878" status: 200 len: 1273 microversion: 2.1 time: 0.205626 Oct 27 15:45:51.166059 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 315/546] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:45:50 2021] GET /compute/v2.1/servers/fa9eb157-6ba2-4953-b2b7-9b2e83f97878 => generated 1273 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 15:45:51.859972 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-63f62a23-c4c2-4954-be09-0df09c75ea63 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:45:51.866691 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-e8569733-935a-43cc-9a55-501bfb187a4c tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:45:51.868167 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-63f62a23-c4c2-4954-be09-0df09c75ea63 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:45:51.869018 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-e8569733-935a-43cc-9a55-501bfb187a4c tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: 62c89161-c119-48b2-839d-712db798ff96] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:45:51.887205 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-63f62a23-c4c2-4954-be09-0df09c75ea63 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:45:51.890388 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-e8569733-935a-43cc-9a55-501bfb187a4c tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:45:51.891088 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-63f62a23-c4c2-4954-be09-0df09c75ea63 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:45:51.892102 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-63f62a23-c4c2-4954-be09-0df09c75ea63 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:45:51.892708 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-e8569733-935a-43cc-9a55-501bfb187a4c tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:45:51.901963 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-63f62a23-c4c2-4954-be09-0df09c75ea63 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:45:51.908754 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-e8569733-935a-43cc-9a55-501bfb187a4c tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:45:51.912556 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-e8569733-935a-43cc-9a55-501bfb187a4c tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:45:52.185375 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-63f62a23-c4c2-4954-be09-0df09c75ea63 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:45:52.194255 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-63f62a23-c4c2-4954-be09-0df09c75ea63 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:45:52.195770 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-63f62a23-c4c2-4954-be09-0df09c75ea63 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:45:52.196975 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-63f62a23-c4c2-4954-be09-0df09c75ea63 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672" status: 200 len: 1741 microversion: 2.20 time: 0.341018 Oct 27 15:45:52.197532 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 232/547] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Oct 27 15:45:51 2021] GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672 => generated 1741 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 15:45:52.202479 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-1e03694a-0780-47ca-8708-b4a1bcdfbbd0 tempest-VolumesNegativeTest-2132035956 tempest-VolumesNegativeTest-2132035956-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:45:52.203379 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-1e03694a-0780-47ca-8708-b4a1bcdfbbd0 tempest-VolumesNegativeTest-2132035956 tempest-VolumesNegativeTest-2132035956-project] [instance: fa9eb157-6ba2-4953-b2b7-9b2e83f97878] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:45:52.214341 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-1e03694a-0780-47ca-8708-b4a1bcdfbbd0 tempest-VolumesNegativeTest-2132035956 tempest-VolumesNegativeTest-2132035956-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:45:52.214985 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-1e03694a-0780-47ca-8708-b4a1bcdfbbd0 tempest-VolumesNegativeTest-2132035956 tempest-VolumesNegativeTest-2132035956-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:45:52.215775 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-1e03694a-0780-47ca-8708-b4a1bcdfbbd0 tempest-VolumesNegativeTest-2132035956 tempest-VolumesNegativeTest-2132035956-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:45:52.216240 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-1e03694a-0780-47ca-8708-b4a1bcdfbbd0 tempest-VolumesNegativeTest-2132035956 tempest-VolumesNegativeTest-2132035956-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:45:52.294763 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-e8569733-935a-43cc-9a55-501bfb187a4c tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96b599f8890b4281a7e311cf37a039e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d7fcab5d3f465793d650f16c6ea8de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:45:52.304203 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-e8569733-935a-43cc-9a55-501bfb187a4c tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96" status: 200 len: 1567 microversion: 2.1 time: 0.442196 Oct 27 15:45:52.305188 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 316/548] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:45:51 2021] GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96 => generated 1567 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 15:45:52.415834 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-1e03694a-0780-47ca-8708-b4a1bcdfbbd0 tempest-VolumesNegativeTest-2132035956 tempest-VolumesNegativeTest-2132035956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88a99f03499f4af49c5da201ee2e9973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccaff4cb8c9f424ca1305e4eafac8c50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:45:52.428947 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-1e03694a-0780-47ca-8708-b4a1bcdfbbd0 tempest-VolumesNegativeTest-2132035956 tempest-VolumesNegativeTest-2132035956-project] 10.222.0.64 "GET /compute/v2.1/servers/fa9eb157-6ba2-4953-b2b7-9b2e83f97878" status: 200 len: 1315 microversion: 2.1 time: 0.229931 Oct 27 15:45:52.430273 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 233/549] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:45:52 2021] GET /compute/v2.1/servers/fa9eb157-6ba2-4953-b2b7-9b2e83f97878 => generated 1315 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 15:45:52.728309 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [req-1ed7240e-ac28-4860-9900-f5301384e042 req-070997da-80ff-4ada-af16-63a5f3b59379 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fa9eb157-6ba2-4953-b2b7-9b2e83f97878", "tag": "0817cfca-a4f6-4ee1-9fc5-268d60c33774"}]} {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 15:45:52.735667 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 27 15:45:52.735667 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: warnings.warn(msg) Oct 27 15:45:52.770794 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [req-1ed7240e-ac28-4860-9900-f5301384e042 req-070997da-80ff-4ada-af16-63a5f3b59379 service nova] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:45:52.776379 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [req-1ed7240e-ac28-4860-9900-f5301384e042 req-070997da-80ff-4ada-af16-63a5f3b59379 service nova] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:45:52.802671 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.compute.server_external_events [req-1ed7240e-ac28-4860-9900-f5301384e042 req-070997da-80ff-4ada-af16-63a5f3b59379 service nova] Creating event network-changed:0817cfca-a4f6-4ee1-9fc5-268d60c33774 for instance fa9eb157-6ba2-4953-b2b7-9b2e83f97878 on hv-cinder-80070 Oct 27 15:45:52.809303 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [req-1ed7240e-ac28-4860-9900-f5301384e042 req-070997da-80ff-4ada-af16-63a5f3b59379 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087332 Oct 27 15:45:52.810162 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 317/550] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Oct 27 15:45:52 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 15:45:53.215490 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-6291114e-8971-47d1-9375-ab104045218c tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:45:53.216129 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-6291114e-8971-47d1-9375-ab104045218c tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:45:53.240688 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-6291114e-8971-47d1-9375-ab104045218c tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:45:53.244895 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-6291114e-8971-47d1-9375-ab104045218c tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:45:53.246491 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-6291114e-8971-47d1-9375-ab104045218c tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:45:53.247107 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-6291114e-8971-47d1-9375-ab104045218c tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:45:53.324098 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-342ca9bf-b0da-4cb7-9716-7a7a4f2f3295 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:45:53.324960 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-342ca9bf-b0da-4cb7-9716-7a7a4f2f3295 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: 62c89161-c119-48b2-839d-712db798ff96] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:45:53.334498 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-342ca9bf-b0da-4cb7-9716-7a7a4f2f3295 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:45:53.335471 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-342ca9bf-b0da-4cb7-9716-7a7a4f2f3295 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:45:53.336813 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-342ca9bf-b0da-4cb7-9716-7a7a4f2f3295 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:45:53.337390 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-342ca9bf-b0da-4cb7-9716-7a7a4f2f3295 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:45:53.487138 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-6291114e-8971-47d1-9375-ab104045218c tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:45:53.497793 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-6291114e-8971-47d1-9375-ab104045218c tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:45:53.500108 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-6291114e-8971-47d1-9375-ab104045218c tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:45:53.501547 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-6291114e-8971-47d1-9375-ab104045218c tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672" status: 200 len: 1741 microversion: 2.20 time: 0.290823 Oct 27 15:45:53.502735 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 234/551] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Oct 27 15:45:53 2021] GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672 => generated 1741 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 15:45:53.508229 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-d3ca163e-ef6f-412b-89f2-f5c076b411a6 tempest-VolumesNegativeTest-2132035956 tempest-VolumesNegativeTest-2132035956-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:45:53.509135 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-d3ca163e-ef6f-412b-89f2-f5c076b411a6 tempest-VolumesNegativeTest-2132035956 tempest-VolumesNegativeTest-2132035956-project] [instance: fa9eb157-6ba2-4953-b2b7-9b2e83f97878] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:45:53.515228 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-d3ca163e-ef6f-412b-89f2-f5c076b411a6 tempest-VolumesNegativeTest-2132035956 tempest-VolumesNegativeTest-2132035956-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:45:53.516055 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-d3ca163e-ef6f-412b-89f2-f5c076b411a6 tempest-VolumesNegativeTest-2132035956 tempest-VolumesNegativeTest-2132035956-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:45:53.519952 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-d3ca163e-ef6f-412b-89f2-f5c076b411a6 tempest-VolumesNegativeTest-2132035956 tempest-VolumesNegativeTest-2132035956-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:45:53.521314 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-d3ca163e-ef6f-412b-89f2-f5c076b411a6 tempest-VolumesNegativeTest-2132035956 tempest-VolumesNegativeTest-2132035956-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:45:53.690453 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-d3ca163e-ef6f-412b-89f2-f5c076b411a6 tempest-VolumesNegativeTest-2132035956 tempest-VolumesNegativeTest-2132035956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88a99f03499f4af49c5da201ee2e9973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccaff4cb8c9f424ca1305e4eafac8c50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:45:53.715080 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-d3ca163e-ef6f-412b-89f2-f5c076b411a6 tempest-VolumesNegativeTest-2132035956 tempest-VolumesNegativeTest-2132035956-project] 10.222.0.64 "GET /compute/v2.1/servers/fa9eb157-6ba2-4953-b2b7-9b2e83f97878" status: 200 len: 1315 microversion: 2.1 time: 0.210723 Oct 27 15:45:53.715668 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 235/552] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:45:53 2021] GET /compute/v2.1/servers/fa9eb157-6ba2-4953-b2b7-9b2e83f97878 => generated 1315 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 15:45:54.012588 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-342ca9bf-b0da-4cb7-9716-7a7a4f2f3295 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96b599f8890b4281a7e311cf37a039e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d7fcab5d3f465793d650f16c6ea8de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:45:54.024755 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-342ca9bf-b0da-4cb7-9716-7a7a4f2f3295 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96" status: 200 len: 1567 microversion: 2.1 time: 0.705876 Oct 27 15:45:54.025877 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 318/553] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:45:53 2021] GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96 => generated 1567 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 15:45:54.521837 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-e5db1dda-d764-40f9-9f56-4408e1aec21a tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:45:54.522390 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-e5db1dda-d764-40f9-9f56-4408e1aec21a tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:45:54.528786 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-e5db1dda-d764-40f9-9f56-4408e1aec21a tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:45:54.529581 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-e5db1dda-d764-40f9-9f56-4408e1aec21a tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:45:54.530470 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-e5db1dda-d764-40f9-9f56-4408e1aec21a tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:45:54.531013 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-e5db1dda-d764-40f9-9f56-4408e1aec21a tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:45:54.682792 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-e5db1dda-d764-40f9-9f56-4408e1aec21a tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:45:54.691375 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-e5db1dda-d764-40f9-9f56-4408e1aec21a tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:45:54.693270 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-e5db1dda-d764-40f9-9f56-4408e1aec21a tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:45:54.701872 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-e5db1dda-d764-40f9-9f56-4408e1aec21a tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672" status: 200 len: 1741 microversion: 2.20 time: 0.177992 Oct 27 15:45:54.702788 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 236/554] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Oct 27 15:45:54 2021] GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672 => generated 1741 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 15:45:54.734624 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-516a1c07-1047-462c-b5e1-d03baed1a301 tempest-VolumesNegativeTest-2132035956 tempest-VolumesNegativeTest-2132035956-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:45:54.735979 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-516a1c07-1047-462c-b5e1-d03baed1a301 tempest-VolumesNegativeTest-2132035956 tempest-VolumesNegativeTest-2132035956-project] [instance: fa9eb157-6ba2-4953-b2b7-9b2e83f97878] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:45:54.743344 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-516a1c07-1047-462c-b5e1-d03baed1a301 tempest-VolumesNegativeTest-2132035956 tempest-VolumesNegativeTest-2132035956-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:45:54.743789 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-516a1c07-1047-462c-b5e1-d03baed1a301 tempest-VolumesNegativeTest-2132035956 tempest-VolumesNegativeTest-2132035956-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:45:54.744589 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-516a1c07-1047-462c-b5e1-d03baed1a301 tempest-VolumesNegativeTest-2132035956 tempest-VolumesNegativeTest-2132035956-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:45:54.745020 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-516a1c07-1047-462c-b5e1-d03baed1a301 tempest-VolumesNegativeTest-2132035956 tempest-VolumesNegativeTest-2132035956-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:45:54.940601 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-516a1c07-1047-462c-b5e1-d03baed1a301 tempest-VolumesNegativeTest-2132035956 tempest-VolumesNegativeTest-2132035956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88a99f03499f4af49c5da201ee2e9973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccaff4cb8c9f424ca1305e4eafac8c50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:45:54.950289 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-516a1c07-1047-462c-b5e1-d03baed1a301 tempest-VolumesNegativeTest-2132035956 tempest-VolumesNegativeTest-2132035956-project] 10.222.0.64 "GET /compute/v2.1/servers/fa9eb157-6ba2-4953-b2b7-9b2e83f97878" status: 200 len: 1315 microversion: 2.1 time: 0.220486 Oct 27 15:45:54.951019 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 319/555] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:45:54 2021] GET /compute/v2.1/servers/fa9eb157-6ba2-4953-b2b7-9b2e83f97878 => generated 1315 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 15:45:55.046617 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-acb25fad-bb41-418e-9c07-e6015dcef1bc tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:45:55.047477 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-acb25fad-bb41-418e-9c07-e6015dcef1bc tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: 62c89161-c119-48b2-839d-712db798ff96] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:45:55.054537 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-acb25fad-bb41-418e-9c07-e6015dcef1bc tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:45:55.055241 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-acb25fad-bb41-418e-9c07-e6015dcef1bc tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:45:55.056214 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-acb25fad-bb41-418e-9c07-e6015dcef1bc tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:45:55.056801 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-acb25fad-bb41-418e-9c07-e6015dcef1bc tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:45:55.231092 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-acb25fad-bb41-418e-9c07-e6015dcef1bc tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96b599f8890b4281a7e311cf37a039e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d7fcab5d3f465793d650f16c6ea8de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:45:55.238976 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-acb25fad-bb41-418e-9c07-e6015dcef1bc tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96" status: 200 len: 1567 microversion: 2.1 time: 0.199530 Oct 27 15:45:55.240216 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 237/556] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:45:55 2021] GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96 => generated 1567 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 15:45:55.721910 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-c34951e6-0e9f-4702-a826-87632c4053ea tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:45:55.722522 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-c34951e6-0e9f-4702-a826-87632c4053ea tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:45:55.728934 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-c34951e6-0e9f-4702-a826-87632c4053ea tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:45:55.729407 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-c34951e6-0e9f-4702-a826-87632c4053ea tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:45:55.730183 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-c34951e6-0e9f-4702-a826-87632c4053ea tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:45:55.730618 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-c34951e6-0e9f-4702-a826-87632c4053ea tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:45:55.865950 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-c34951e6-0e9f-4702-a826-87632c4053ea tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:45:55.874276 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-c34951e6-0e9f-4702-a826-87632c4053ea tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:45:55.875980 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-c34951e6-0e9f-4702-a826-87632c4053ea tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:45:55.877395 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-c34951e6-0e9f-4702-a826-87632c4053ea tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672" status: 200 len: 1741 microversion: 2.20 time: 0.159328 Oct 27 15:45:55.889448 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 320/557] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Oct 27 15:45:55 2021] GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672 => generated 1741 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 15:45:55.969249 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-01f480c6-67e5-42a1-9525-a65aafcaa498 tempest-VolumesNegativeTest-2132035956 tempest-VolumesNegativeTest-2132035956-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:45:55.970564 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-01f480c6-67e5-42a1-9525-a65aafcaa498 tempest-VolumesNegativeTest-2132035956 tempest-VolumesNegativeTest-2132035956-project] [instance: fa9eb157-6ba2-4953-b2b7-9b2e83f97878] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:45:55.981641 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-01f480c6-67e5-42a1-9525-a65aafcaa498 tempest-VolumesNegativeTest-2132035956 tempest-VolumesNegativeTest-2132035956-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:45:55.982378 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-01f480c6-67e5-42a1-9525-a65aafcaa498 tempest-VolumesNegativeTest-2132035956 tempest-VolumesNegativeTest-2132035956-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:45:55.983550 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-01f480c6-67e5-42a1-9525-a65aafcaa498 tempest-VolumesNegativeTest-2132035956 tempest-VolumesNegativeTest-2132035956-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:45:55.984277 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-01f480c6-67e5-42a1-9525-a65aafcaa498 tempest-VolumesNegativeTest-2132035956 tempest-VolumesNegativeTest-2132035956-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:45:56.135804 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-01f480c6-67e5-42a1-9525-a65aafcaa498 tempest-VolumesNegativeTest-2132035956 tempest-VolumesNegativeTest-2132035956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88a99f03499f4af49c5da201ee2e9973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccaff4cb8c9f424ca1305e4eafac8c50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:45:56.144040 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-01f480c6-67e5-42a1-9525-a65aafcaa498 tempest-VolumesNegativeTest-2132035956 tempest-VolumesNegativeTest-2132035956-project] 10.222.0.64 "GET /compute/v2.1/servers/fa9eb157-6ba2-4953-b2b7-9b2e83f97878" status: 200 len: 1315 microversion: 2.1 time: 0.178393 Oct 27 15:45:56.144643 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 238/558] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:45:55 2021] GET /compute/v2.1/servers/fa9eb157-6ba2-4953-b2b7-9b2e83f97878 => generated 1315 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 15:45:56.258073 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-5b62d148-97e6-4bd2-b9b0-d0e49a8310d9 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:45:56.258687 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-5b62d148-97e6-4bd2-b9b0-d0e49a8310d9 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: 62c89161-c119-48b2-839d-712db798ff96] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:45:56.264822 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-5b62d148-97e6-4bd2-b9b0-d0e49a8310d9 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:45:56.265443 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-5b62d148-97e6-4bd2-b9b0-d0e49a8310d9 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:45:56.266223 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-5b62d148-97e6-4bd2-b9b0-d0e49a8310d9 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:45:56.266653 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-5b62d148-97e6-4bd2-b9b0-d0e49a8310d9 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:45:56.484164 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-5b62d148-97e6-4bd2-b9b0-d0e49a8310d9 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96b599f8890b4281a7e311cf37a039e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d7fcab5d3f465793d650f16c6ea8de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:45:56.494994 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-5b62d148-97e6-4bd2-b9b0-d0e49a8310d9 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96" status: 200 len: 1567 microversion: 2.1 time: 0.241038 Oct 27 15:45:56.495952 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 321/559] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:45:56 2021] GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96 => generated 1567 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 15:45:56.896992 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-5aedaed4-b983-4d31-8863-96d665d5cf35 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:45:56.897802 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-5aedaed4-b983-4d31-8863-96d665d5cf35 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:45:56.904789 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-5aedaed4-b983-4d31-8863-96d665d5cf35 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:45:56.905637 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-5aedaed4-b983-4d31-8863-96d665d5cf35 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:45:56.906700 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-5aedaed4-b983-4d31-8863-96d665d5cf35 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:45:56.907306 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-5aedaed4-b983-4d31-8863-96d665d5cf35 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:45:57.064120 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-5aedaed4-b983-4d31-8863-96d665d5cf35 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:45:57.073216 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-5aedaed4-b983-4d31-8863-96d665d5cf35 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:45:57.075056 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-5aedaed4-b983-4d31-8863-96d665d5cf35 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:45:57.076459 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-5aedaed4-b983-4d31-8863-96d665d5cf35 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672" status: 200 len: 1741 microversion: 2.20 time: 0.184568 Oct 27 15:45:57.077023 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 239/560] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Oct 27 15:45:56 2021] GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672 => generated 1741 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 15:45:57.161700 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-3c236984-2fc9-4d00-a8a0-0eadf180a36f tempest-VolumesNegativeTest-2132035956 tempest-VolumesNegativeTest-2132035956-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:45:57.162308 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-3c236984-2fc9-4d00-a8a0-0eadf180a36f tempest-VolumesNegativeTest-2132035956 tempest-VolumesNegativeTest-2132035956-project] [instance: fa9eb157-6ba2-4953-b2b7-9b2e83f97878] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:45:57.169504 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-3c236984-2fc9-4d00-a8a0-0eadf180a36f tempest-VolumesNegativeTest-2132035956 tempest-VolumesNegativeTest-2132035956-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:45:57.170300 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-3c236984-2fc9-4d00-a8a0-0eadf180a36f tempest-VolumesNegativeTest-2132035956 tempest-VolumesNegativeTest-2132035956-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:45:57.171178 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-3c236984-2fc9-4d00-a8a0-0eadf180a36f tempest-VolumesNegativeTest-2132035956 tempest-VolumesNegativeTest-2132035956-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:45:57.171588 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-3c236984-2fc9-4d00-a8a0-0eadf180a36f tempest-VolumesNegativeTest-2132035956 tempest-VolumesNegativeTest-2132035956-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:45:57.321936 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-3c236984-2fc9-4d00-a8a0-0eadf180a36f tempest-VolumesNegativeTest-2132035956 tempest-VolumesNegativeTest-2132035956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88a99f03499f4af49c5da201ee2e9973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccaff4cb8c9f424ca1305e4eafac8c50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:45:57.329634 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-3c236984-2fc9-4d00-a8a0-0eadf180a36f tempest-VolumesNegativeTest-2132035956 tempest-VolumesNegativeTest-2132035956-project] 10.222.0.64 "GET /compute/v2.1/servers/fa9eb157-6ba2-4953-b2b7-9b2e83f97878" status: 200 len: 1315 microversion: 2.1 time: 0.172367 Oct 27 15:45:57.330195 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 322/561] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:45:57 2021] GET /compute/v2.1/servers/fa9eb157-6ba2-4953-b2b7-9b2e83f97878 => generated 1315 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 15:45:57.513400 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-7bd34603-ef18-49ba-8a82-a1c201bd37f5 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:45:57.514141 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-7bd34603-ef18-49ba-8a82-a1c201bd37f5 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: 62c89161-c119-48b2-839d-712db798ff96] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:45:57.521839 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-7bd34603-ef18-49ba-8a82-a1c201bd37f5 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:45:57.522198 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-7bd34603-ef18-49ba-8a82-a1c201bd37f5 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:45:57.523019 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-7bd34603-ef18-49ba-8a82-a1c201bd37f5 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:45:57.523450 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-7bd34603-ef18-49ba-8a82-a1c201bd37f5 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:45:57.665637 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-7bd34603-ef18-49ba-8a82-a1c201bd37f5 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96b599f8890b4281a7e311cf37a039e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d7fcab5d3f465793d650f16c6ea8de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:45:57.674969 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-7bd34603-ef18-49ba-8a82-a1c201bd37f5 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96" status: 200 len: 1567 microversion: 2.1 time: 0.165937 Oct 27 15:45:57.676178 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 240/562] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:45:57 2021] GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96 => generated 1567 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 15:45:58.099693 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-e6fe5c9f-5067-4fb4-96c7-4aa625a0cff7 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:45:58.106277 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-e6fe5c9f-5067-4fb4-96c7-4aa625a0cff7 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:45:58.121669 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-e6fe5c9f-5067-4fb4-96c7-4aa625a0cff7 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:45:58.122418 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-e6fe5c9f-5067-4fb4-96c7-4aa625a0cff7 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:45:58.123750 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-e6fe5c9f-5067-4fb4-96c7-4aa625a0cff7 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:45:58.124571 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-e6fe5c9f-5067-4fb4-96c7-4aa625a0cff7 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:45:58.324284 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-e6fe5c9f-5067-4fb4-96c7-4aa625a0cff7 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:45:58.334803 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-e6fe5c9f-5067-4fb4-96c7-4aa625a0cff7 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:45:58.336743 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-e6fe5c9f-5067-4fb4-96c7-4aa625a0cff7 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:45:58.338216 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-e6fe5c9f-5067-4fb4-96c7-4aa625a0cff7 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672" status: 200 len: 1741 microversion: 2.20 time: 0.245668 Oct 27 15:45:58.338955 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 323/563] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Oct 27 15:45:58 2021] GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672 => generated 1741 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 15:45:58.349474 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-49e8f4cc-d1b9-44f5-9099-5ce81c4f877c tempest-VolumesNegativeTest-2132035956 tempest-VolumesNegativeTest-2132035956-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:45:58.350787 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-49e8f4cc-d1b9-44f5-9099-5ce81c4f877c tempest-VolumesNegativeTest-2132035956 tempest-VolumesNegativeTest-2132035956-project] [instance: fa9eb157-6ba2-4953-b2b7-9b2e83f97878] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:45:58.357817 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-49e8f4cc-d1b9-44f5-9099-5ce81c4f877c tempest-VolumesNegativeTest-2132035956 tempest-VolumesNegativeTest-2132035956-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:45:58.358690 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-49e8f4cc-d1b9-44f5-9099-5ce81c4f877c tempest-VolumesNegativeTest-2132035956 tempest-VolumesNegativeTest-2132035956-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:45:58.359767 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-49e8f4cc-d1b9-44f5-9099-5ce81c4f877c tempest-VolumesNegativeTest-2132035956 tempest-VolumesNegativeTest-2132035956-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:45:58.360486 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-49e8f4cc-d1b9-44f5-9099-5ce81c4f877c tempest-VolumesNegativeTest-2132035956 tempest-VolumesNegativeTest-2132035956-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:45:58.503599 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-49e8f4cc-d1b9-44f5-9099-5ce81c4f877c tempest-VolumesNegativeTest-2132035956 tempest-VolumesNegativeTest-2132035956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88a99f03499f4af49c5da201ee2e9973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccaff4cb8c9f424ca1305e4eafac8c50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:45:58.522432 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-49e8f4cc-d1b9-44f5-9099-5ce81c4f877c tempest-VolumesNegativeTest-2132035956 tempest-VolumesNegativeTest-2132035956-project] 10.222.0.64 "GET /compute/v2.1/servers/fa9eb157-6ba2-4953-b2b7-9b2e83f97878" status: 200 len: 1315 microversion: 2.1 time: 0.177560 Oct 27 15:45:58.523023 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 241/564] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:45:58 2021] GET /compute/v2.1/servers/fa9eb157-6ba2-4953-b2b7-9b2e83f97878 => generated 1315 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 15:45:58.692761 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-49a93f18-5103-4da4-b786-75dcf04e5615 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:45:58.693419 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-49a93f18-5103-4da4-b786-75dcf04e5615 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: 62c89161-c119-48b2-839d-712db798ff96] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:45:58.700431 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-49a93f18-5103-4da4-b786-75dcf04e5615 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:45:58.701001 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-49a93f18-5103-4da4-b786-75dcf04e5615 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:45:58.701893 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-49a93f18-5103-4da4-b786-75dcf04e5615 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:45:58.702568 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-49a93f18-5103-4da4-b786-75dcf04e5615 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:45:58.873578 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-49a93f18-5103-4da4-b786-75dcf04e5615 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96b599f8890b4281a7e311cf37a039e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d7fcab5d3f465793d650f16c6ea8de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:45:58.886232 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-49a93f18-5103-4da4-b786-75dcf04e5615 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96" status: 200 len: 1567 microversion: 2.1 time: 0.196777 Oct 27 15:45:58.887738 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 324/565] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:45:58 2021] GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96 => generated 1567 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 15:45:59.358591 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-29759d11-58bf-4a12-8596-f7c447cf1392 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:45:59.360113 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-29759d11-58bf-4a12-8596-f7c447cf1392 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:45:59.369719 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-29759d11-58bf-4a12-8596-f7c447cf1392 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:45:59.370927 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-29759d11-58bf-4a12-8596-f7c447cf1392 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:45:59.371953 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-29759d11-58bf-4a12-8596-f7c447cf1392 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:45:59.372489 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-29759d11-58bf-4a12-8596-f7c447cf1392 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:45:59.538151 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-668dff4f-f031-4d61-b227-08d71e2e6262 tempest-VolumesNegativeTest-2132035956 tempest-VolumesNegativeTest-2132035956-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:45:59.539312 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-668dff4f-f031-4d61-b227-08d71e2e6262 tempest-VolumesNegativeTest-2132035956 tempest-VolumesNegativeTest-2132035956-project] [instance: fa9eb157-6ba2-4953-b2b7-9b2e83f97878] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:45:59.547765 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-668dff4f-f031-4d61-b227-08d71e2e6262 tempest-VolumesNegativeTest-2132035956 tempest-VolumesNegativeTest-2132035956-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:45:59.548235 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-668dff4f-f031-4d61-b227-08d71e2e6262 tempest-VolumesNegativeTest-2132035956 tempest-VolumesNegativeTest-2132035956-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:45:59.548785 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-29759d11-58bf-4a12-8596-f7c447cf1392 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:45:59.549594 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-668dff4f-f031-4d61-b227-08d71e2e6262 tempest-VolumesNegativeTest-2132035956 tempest-VolumesNegativeTest-2132035956-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:45:59.550200 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-668dff4f-f031-4d61-b227-08d71e2e6262 tempest-VolumesNegativeTest-2132035956 tempest-VolumesNegativeTest-2132035956-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:45:59.561558 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-29759d11-58bf-4a12-8596-f7c447cf1392 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:45:59.563876 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-29759d11-58bf-4a12-8596-f7c447cf1392 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:45:59.565481 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-29759d11-58bf-4a12-8596-f7c447cf1392 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672" status: 200 len: 1741 microversion: 2.20 time: 0.210827 Oct 27 15:45:59.567103 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 242/566] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Oct 27 15:45:59 2021] GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672 => generated 1741 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 15:45:59.742623 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-668dff4f-f031-4d61-b227-08d71e2e6262 tempest-VolumesNegativeTest-2132035956 tempest-VolumesNegativeTest-2132035956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88a99f03499f4af49c5da201ee2e9973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccaff4cb8c9f424ca1305e4eafac8c50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:45:59.751262 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-668dff4f-f031-4d61-b227-08d71e2e6262 tempest-VolumesNegativeTest-2132035956 tempest-VolumesNegativeTest-2132035956-project] 10.222.0.64 "GET /compute/v2.1/servers/fa9eb157-6ba2-4953-b2b7-9b2e83f97878" status: 200 len: 1315 microversion: 2.1 time: 0.216689 Oct 27 15:45:59.761275 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 325/567] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:45:59 2021] GET /compute/v2.1/servers/fa9eb157-6ba2-4953-b2b7-9b2e83f97878 => generated 1315 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 15:45:59.903065 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-78a95012-5b69-47a5-88a8-6ba2ad459647 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:45:59.903770 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-78a95012-5b69-47a5-88a8-6ba2ad459647 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: 62c89161-c119-48b2-839d-712db798ff96] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:45:59.909677 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-78a95012-5b69-47a5-88a8-6ba2ad459647 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:45:59.910113 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-78a95012-5b69-47a5-88a8-6ba2ad459647 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:45:59.911663 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-78a95012-5b69-47a5-88a8-6ba2ad459647 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:45:59.912611 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-78a95012-5b69-47a5-88a8-6ba2ad459647 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:46:00.038452 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-78a95012-5b69-47a5-88a8-6ba2ad459647 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96b599f8890b4281a7e311cf37a039e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d7fcab5d3f465793d650f16c6ea8de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:46:00.046220 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-78a95012-5b69-47a5-88a8-6ba2ad459647 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96" status: 200 len: 1567 microversion: 2.1 time: 0.146969 Oct 27 15:46:00.046784 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 243/568] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:45:59 2021] GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96 => generated 1567 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 15:46:00.635836 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-ee2c3fe8-8118-4b34-bc15-59632e6abe82 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:46:00.636469 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-ee2c3fe8-8118-4b34-bc15-59632e6abe82 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:46:00.642860 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-ee2c3fe8-8118-4b34-bc15-59632e6abe82 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:46:00.643303 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-ee2c3fe8-8118-4b34-bc15-59632e6abe82 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:46:00.644223 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-ee2c3fe8-8118-4b34-bc15-59632e6abe82 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:46:00.644658 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-ee2c3fe8-8118-4b34-bc15-59632e6abe82 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:46:00.771595 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-130113e5-c0be-4ed7-9d89-92c5723ea07b tempest-VolumesNegativeTest-2132035956 tempest-VolumesNegativeTest-2132035956-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:46:00.773411 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-130113e5-c0be-4ed7-9d89-92c5723ea07b tempest-VolumesNegativeTest-2132035956 tempest-VolumesNegativeTest-2132035956-project] [instance: fa9eb157-6ba2-4953-b2b7-9b2e83f97878] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:46:00.780493 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-130113e5-c0be-4ed7-9d89-92c5723ea07b tempest-VolumesNegativeTest-2132035956 tempest-VolumesNegativeTest-2132035956-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:46:00.781112 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-130113e5-c0be-4ed7-9d89-92c5723ea07b tempest-VolumesNegativeTest-2132035956 tempest-VolumesNegativeTest-2132035956-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:46:00.782060 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-130113e5-c0be-4ed7-9d89-92c5723ea07b tempest-VolumesNegativeTest-2132035956 tempest-VolumesNegativeTest-2132035956-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:46:00.782415 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-ee2c3fe8-8118-4b34-bc15-59632e6abe82 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:46:00.783994 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-130113e5-c0be-4ed7-9d89-92c5723ea07b tempest-VolumesNegativeTest-2132035956 tempest-VolumesNegativeTest-2132035956-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:46:00.792958 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-ee2c3fe8-8118-4b34-bc15-59632e6abe82 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:46:00.794354 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-ee2c3fe8-8118-4b34-bc15-59632e6abe82 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:46:00.795526 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-ee2c3fe8-8118-4b34-bc15-59632e6abe82 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672" status: 200 len: 1741 microversion: 2.20 time: 0.163375 Oct 27 15:46:00.796111 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 326/569] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Oct 27 15:46:00 2021] GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672 => generated 1741 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 15:46:00.948954 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-130113e5-c0be-4ed7-9d89-92c5723ea07b tempest-VolumesNegativeTest-2132035956 tempest-VolumesNegativeTest-2132035956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88a99f03499f4af49c5da201ee2e9973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccaff4cb8c9f424ca1305e4eafac8c50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:46:00.960919 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-130113e5-c0be-4ed7-9d89-92c5723ea07b tempest-VolumesNegativeTest-2132035956 tempest-VolumesNegativeTest-2132035956-project] 10.222.0.64 "GET /compute/v2.1/servers/fa9eb157-6ba2-4953-b2b7-9b2e83f97878" status: 200 len: 1315 microversion: 2.1 time: 0.195067 Oct 27 15:46:00.961581 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 244/570] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:46:00 2021] GET /compute/v2.1/servers/fa9eb157-6ba2-4953-b2b7-9b2e83f97878 => generated 1315 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 15:46:01.063332 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-ea018299-c0bc-420f-9ddb-3e46ac4ae391 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:46:01.064002 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-ea018299-c0bc-420f-9ddb-3e46ac4ae391 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: 62c89161-c119-48b2-839d-712db798ff96] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:46:01.070517 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-ea018299-c0bc-420f-9ddb-3e46ac4ae391 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:46:01.070953 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-ea018299-c0bc-420f-9ddb-3e46ac4ae391 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:46:01.071715 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-ea018299-c0bc-420f-9ddb-3e46ac4ae391 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:46:01.072171 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-ea018299-c0bc-420f-9ddb-3e46ac4ae391 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:46:01.274894 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-ea018299-c0bc-420f-9ddb-3e46ac4ae391 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96b599f8890b4281a7e311cf37a039e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d7fcab5d3f465793d650f16c6ea8de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:46:01.282623 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-ea018299-c0bc-420f-9ddb-3e46ac4ae391 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96" status: 200 len: 1567 microversion: 2.1 time: 0.222868 Oct 27 15:46:01.283199 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 327/571] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:46:01 2021] GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96 => generated 1567 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 15:46:01.820891 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-6ee99113-ae46-44e8-a59a-0b94781be5fc tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:46:01.821481 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-6ee99113-ae46-44e8-a59a-0b94781be5fc tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:46:01.827667 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-6ee99113-ae46-44e8-a59a-0b94781be5fc tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:46:01.828139 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-6ee99113-ae46-44e8-a59a-0b94781be5fc tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:46:01.828906 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-6ee99113-ae46-44e8-a59a-0b94781be5fc tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:46:01.829336 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-6ee99113-ae46-44e8-a59a-0b94781be5fc tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:46:01.956506 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-6ee99113-ae46-44e8-a59a-0b94781be5fc tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:46:01.965529 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-6ee99113-ae46-44e8-a59a-0b94781be5fc tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:46:01.967016 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-6ee99113-ae46-44e8-a59a-0b94781be5fc tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:46:01.968210 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-6ee99113-ae46-44e8-a59a-0b94781be5fc tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672" status: 200 len: 1723 microversion: 2.20 time: 0.151054 Oct 27 15:46:01.968784 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 245/572] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Oct 27 15:46:01 2021] GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672 => generated 1723 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 15:46:01.981097 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-41eb7162-63d3-4d8a-b8d3-92d32210082c tempest-VolumesNegativeTest-2132035956 tempest-VolumesNegativeTest-2132035956-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:46:01.981805 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-41eb7162-63d3-4d8a-b8d3-92d32210082c tempest-VolumesNegativeTest-2132035956 tempest-VolumesNegativeTest-2132035956-project] [instance: fa9eb157-6ba2-4953-b2b7-9b2e83f97878] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:46:01.987787 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-41eb7162-63d3-4d8a-b8d3-92d32210082c tempest-VolumesNegativeTest-2132035956 tempest-VolumesNegativeTest-2132035956-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:46:01.988276 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-41eb7162-63d3-4d8a-b8d3-92d32210082c tempest-VolumesNegativeTest-2132035956 tempest-VolumesNegativeTest-2132035956-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:46:01.989322 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-41eb7162-63d3-4d8a-b8d3-92d32210082c tempest-VolumesNegativeTest-2132035956 tempest-VolumesNegativeTest-2132035956-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:46:01.989534 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-41eb7162-63d3-4d8a-b8d3-92d32210082c tempest-VolumesNegativeTest-2132035956 tempest-VolumesNegativeTest-2132035956-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:46:02.123134 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-41eb7162-63d3-4d8a-b8d3-92d32210082c tempest-VolumesNegativeTest-2132035956 tempest-VolumesNegativeTest-2132035956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88a99f03499f4af49c5da201ee2e9973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccaff4cb8c9f424ca1305e4eafac8c50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:46:02.133145 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-41eb7162-63d3-4d8a-b8d3-92d32210082c tempest-VolumesNegativeTest-2132035956 tempest-VolumesNegativeTest-2132035956-project] 10.222.0.64 "GET /compute/v2.1/servers/fa9eb157-6ba2-4953-b2b7-9b2e83f97878" status: 200 len: 1315 microversion: 2.1 time: 0.157187 Oct 27 15:46:02.133925 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 328/573] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:46:01 2021] GET /compute/v2.1/servers/fa9eb157-6ba2-4953-b2b7-9b2e83f97878 => generated 1315 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 15:46:02.300226 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-bec8e48f-bbd3-4ea8-88cb-90a7b1bac699 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:46:02.300986 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-bec8e48f-bbd3-4ea8-88cb-90a7b1bac699 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: 62c89161-c119-48b2-839d-712db798ff96] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:46:02.307579 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-bec8e48f-bbd3-4ea8-88cb-90a7b1bac699 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:46:02.308163 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-bec8e48f-bbd3-4ea8-88cb-90a7b1bac699 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:46:02.308911 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-bec8e48f-bbd3-4ea8-88cb-90a7b1bac699 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:46:02.309342 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-bec8e48f-bbd3-4ea8-88cb-90a7b1bac699 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:46:02.444370 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-bec8e48f-bbd3-4ea8-88cb-90a7b1bac699 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96b599f8890b4281a7e311cf37a039e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d7fcab5d3f465793d650f16c6ea8de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:46:02.454689 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-bec8e48f-bbd3-4ea8-88cb-90a7b1bac699 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96" status: 200 len: 1567 microversion: 2.1 time: 0.158038 Oct 27 15:46:02.455701 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 246/574] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:46:02 2021] GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96 => generated 1567 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 15:46:02.594928 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [req-07a87a4f-da0c-4889-8e74-de24ac1afa86 req-9bbbe1e4-d526-41e0-93ef-2d9b74f21f8f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fa9eb157-6ba2-4953-b2b7-9b2e83f97878", "name": "network-vif-plugged", "status": "completed", "tag": "0817cfca-a4f6-4ee1-9fc5-268d60c33774"}]} {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 15:46:02.596557 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 27 15:46:02.596557 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: warnings.warn(msg) Oct 27 15:46:02.605590 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [req-07a87a4f-da0c-4889-8e74-de24ac1afa86 req-9bbbe1e4-d526-41e0-93ef-2d9b74f21f8f service nova] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:46:02.606628 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [req-07a87a4f-da0c-4889-8e74-de24ac1afa86 req-9bbbe1e4-d526-41e0-93ef-2d9b74f21f8f service nova] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:46:02.618222 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.compute.server_external_events [req-07a87a4f-da0c-4889-8e74-de24ac1afa86 req-9bbbe1e4-d526-41e0-93ef-2d9b74f21f8f service nova] Creating event network-vif-plugged:0817cfca-a4f6-4ee1-9fc5-268d60c33774 for instance fa9eb157-6ba2-4953-b2b7-9b2e83f97878 on hv-cinder-80070 Oct 27 15:46:02.623190 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [req-07a87a4f-da0c-4889-8e74-de24ac1afa86 req-9bbbe1e4-d526-41e0-93ef-2d9b74f21f8f service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031870 Oct 27 15:46:02.623778 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 329/575] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Oct 27 15:46:02 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 15:46:02.782087 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-5b3c7e62-d33b-4dc8-982a-0a22985b2d95 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "83c14b0a-376f-4e7f-8127-955f6bf3e3e5", "device": "/dev/sdb"}} {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 15:46:02.784329 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-5b3c7e62-d33b-4dc8-982a-0a22985b2d95 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] [instance: 013da7c4-ac69-4554-827b-d68e9bac0e54] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:46:02.791227 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-5b3c7e62-d33b-4dc8-982a-0a22985b2d95 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:46:02.791673 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-5b3c7e62-d33b-4dc8-982a-0a22985b2d95 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:46:02.792502 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-5b3c7e62-d33b-4dc8-982a-0a22985b2d95 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:46:02.792906 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-5b3c7e62-d33b-4dc8-982a-0a22985b2d95 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:46:02.988107 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-93eeb353-c1c1-43b9-a568-a44097c8460b tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:46:02.988808 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-93eeb353-c1c1-43b9-a568-a44097c8460b tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:46:02.995767 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-93eeb353-c1c1-43b9-a568-a44097c8460b tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:46:02.996241 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-93eeb353-c1c1-43b9-a568-a44097c8460b tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:46:02.997006 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-93eeb353-c1c1-43b9-a568-a44097c8460b tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:46:02.997440 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-93eeb353-c1c1-43b9-a568-a44097c8460b tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:46:03.137732 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-93eeb353-c1c1-43b9-a568-a44097c8460b tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:46:03.148554 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-93eeb353-c1c1-43b9-a568-a44097c8460b tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:46:03.150199 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-93eeb353-c1c1-43b9-a568-a44097c8460b tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:46:03.151530 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-93eeb353-c1c1-43b9-a568-a44097c8460b tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672" status: 200 len: 1723 microversion: 2.20 time: 0.167598 Oct 27 15:46:03.152207 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 330/576] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Oct 27 15:46:02 2021] GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672 => generated 1723 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 15:46:03.156485 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-a03c8237-b8c0-4847-bf3a-615110327811 tempest-VolumesNegativeTest-2132035956 tempest-VolumesNegativeTest-2132035956-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:46:03.157089 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-a03c8237-b8c0-4847-bf3a-615110327811 tempest-VolumesNegativeTest-2132035956 tempest-VolumesNegativeTest-2132035956-project] [instance: fa9eb157-6ba2-4953-b2b7-9b2e83f97878] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:46:03.163227 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-a03c8237-b8c0-4847-bf3a-615110327811 tempest-VolumesNegativeTest-2132035956 tempest-VolumesNegativeTest-2132035956-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:46:03.163787 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-a03c8237-b8c0-4847-bf3a-615110327811 tempest-VolumesNegativeTest-2132035956 tempest-VolumesNegativeTest-2132035956-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:46:03.164482 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-a03c8237-b8c0-4847-bf3a-615110327811 tempest-VolumesNegativeTest-2132035956 tempest-VolumesNegativeTest-2132035956-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:46:03.164921 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-a03c8237-b8c0-4847-bf3a-615110327811 tempest-VolumesNegativeTest-2132035956 tempest-VolumesNegativeTest-2132035956-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:46:03.278328 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-5b3c7e62-d33b-4dc8-982a-0a22985b2d95 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] 10.222.0.64 "POST /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.499767 Oct 27 15:46:03.279452 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 247/577] 10.222.0.64 () {60 vars in 1322 bytes} [Wed Oct 27 15:46:02 2021] POST /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54/os-volume_attachments => generated 194 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 15:46:03.321461 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-a03c8237-b8c0-4847-bf3a-615110327811 tempest-VolumesNegativeTest-2132035956 tempest-VolumesNegativeTest-2132035956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88a99f03499f4af49c5da201ee2e9973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccaff4cb8c9f424ca1305e4eafac8c50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:46:03.330629 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-a03c8237-b8c0-4847-bf3a-615110327811 tempest-VolumesNegativeTest-2132035956 tempest-VolumesNegativeTest-2132035956-project] 10.222.0.64 "GET /compute/v2.1/servers/fa9eb157-6ba2-4953-b2b7-9b2e83f97878" status: 200 len: 1315 microversion: 2.1 time: 0.177393 Oct 27 15:46:03.331228 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 331/578] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:46:03 2021] GET /compute/v2.1/servers/fa9eb157-6ba2-4953-b2b7-9b2e83f97878 => generated 1315 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 15:46:03.473656 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-579774fc-89a9-4b27-99cb-f6351cef6f2a tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:46:03.474364 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-579774fc-89a9-4b27-99cb-f6351cef6f2a tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: 62c89161-c119-48b2-839d-712db798ff96] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:46:03.481956 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-579774fc-89a9-4b27-99cb-f6351cef6f2a tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:46:03.482953 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-579774fc-89a9-4b27-99cb-f6351cef6f2a tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:46:03.483838 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-579774fc-89a9-4b27-99cb-f6351cef6f2a tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:46:03.484586 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-579774fc-89a9-4b27-99cb-f6351cef6f2a tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:46:03.620687 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-579774fc-89a9-4b27-99cb-f6351cef6f2a tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96b599f8890b4281a7e311cf37a039e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d7fcab5d3f465793d650f16c6ea8de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:46:03.628451 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-579774fc-89a9-4b27-99cb-f6351cef6f2a tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96" status: 200 len: 1567 microversion: 2.1 time: 0.159870 Oct 27 15:46:03.629180 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 248/579] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:46:03 2021] GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96 => generated 1567 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 15:46:04.170349 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-4101dac4-f0a0-4de3-89ff-923a768df186 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:46:04.170862 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-4101dac4-f0a0-4de3-89ff-923a768df186 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:46:04.177783 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-4101dac4-f0a0-4de3-89ff-923a768df186 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:46:04.178231 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-4101dac4-f0a0-4de3-89ff-923a768df186 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:46:04.178995 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-4101dac4-f0a0-4de3-89ff-923a768df186 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:46:04.179418 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-4101dac4-f0a0-4de3-89ff-923a768df186 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:46:04.306929 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-4101dac4-f0a0-4de3-89ff-923a768df186 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:46:04.314809 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-4101dac4-f0a0-4de3-89ff-923a768df186 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:46:04.316356 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-4101dac4-f0a0-4de3-89ff-923a768df186 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:46:04.318668 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-4101dac4-f0a0-4de3-89ff-923a768df186 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672" status: 200 len: 1723 microversion: 2.20 time: 0.152155 Oct 27 15:46:04.319233 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 332/580] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Oct 27 15:46:04 2021] GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672 => generated 1723 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 15:46:04.348768 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-d5d578af-8ff1-4978-bd52-a02d6b6bbd9b tempest-VolumesNegativeTest-2132035956 tempest-VolumesNegativeTest-2132035956-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:46:04.349411 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-d5d578af-8ff1-4978-bd52-a02d6b6bbd9b tempest-VolumesNegativeTest-2132035956 tempest-VolumesNegativeTest-2132035956-project] [instance: fa9eb157-6ba2-4953-b2b7-9b2e83f97878] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:46:04.356196 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-d5d578af-8ff1-4978-bd52-a02d6b6bbd9b tempest-VolumesNegativeTest-2132035956 tempest-VolumesNegativeTest-2132035956-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:46:04.356196 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-d5d578af-8ff1-4978-bd52-a02d6b6bbd9b tempest-VolumesNegativeTest-2132035956 tempest-VolumesNegativeTest-2132035956-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:46:04.356766 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-d5d578af-8ff1-4978-bd52-a02d6b6bbd9b tempest-VolumesNegativeTest-2132035956 tempest-VolumesNegativeTest-2132035956-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:46:04.357356 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-d5d578af-8ff1-4978-bd52-a02d6b6bbd9b tempest-VolumesNegativeTest-2132035956 tempest-VolumesNegativeTest-2132035956-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:46:04.580537 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-d5d578af-8ff1-4978-bd52-a02d6b6bbd9b tempest-VolumesNegativeTest-2132035956 tempest-VolumesNegativeTest-2132035956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88a99f03499f4af49c5da201ee2e9973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccaff4cb8c9f424ca1305e4eafac8c50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:46:04.592425 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-d5d578af-8ff1-4978-bd52-a02d6b6bbd9b tempest-VolumesNegativeTest-2132035956 tempest-VolumesNegativeTest-2132035956-project] 10.222.0.64 "GET /compute/v2.1/servers/fa9eb157-6ba2-4953-b2b7-9b2e83f97878" status: 200 len: 1315 microversion: 2.1 time: 0.247758 Oct 27 15:46:04.600636 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 249/581] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:46:04 2021] GET /compute/v2.1/servers/fa9eb157-6ba2-4953-b2b7-9b2e83f97878 => generated 1315 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 15:46:04.657973 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [req-2b6675e6-6427-4c4d-93c0-5a54b8cb1791 req-509f865e-40d8-4ec0-8e99-69225f72460d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a115c672-012e-4e45-b5c9-4427e7b66672", "name": "network-vif-unplugged", "status": "completed", "tag": "c9ac335c-5a25-416c-803f-ac2f3d462176"}]} {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 15:46:04.663560 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-e61eaeda-7723-456d-ac41-be75fcdcb2a5 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:46:04.664645 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-e61eaeda-7723-456d-ac41-be75fcdcb2a5 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: 62c89161-c119-48b2-839d-712db798ff96] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:46:04.666495 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 27 15:46:04.666495 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: warnings.warn(msg) Oct 27 15:46:04.674984 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-e61eaeda-7723-456d-ac41-be75fcdcb2a5 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:46:04.682000 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-e61eaeda-7723-456d-ac41-be75fcdcb2a5 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:46:04.682825 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-e61eaeda-7723-456d-ac41-be75fcdcb2a5 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:46:04.683279 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-e61eaeda-7723-456d-ac41-be75fcdcb2a5 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:46:04.685217 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [req-2b6675e6-6427-4c4d-93c0-5a54b8cb1791 req-509f865e-40d8-4ec0-8e99-69225f72460d service nova] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:46:04.685960 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [req-2b6675e6-6427-4c4d-93c0-5a54b8cb1791 req-509f865e-40d8-4ec0-8e99-69225f72460d service nova] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:46:04.703712 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.compute.server_external_events [req-2b6675e6-6427-4c4d-93c0-5a54b8cb1791 req-509f865e-40d8-4ec0-8e99-69225f72460d service nova] Creating event network-vif-unplugged:c9ac335c-5a25-416c-803f-ac2f3d462176 for instance a115c672-012e-4e45-b5c9-4427e7b66672 on hv-cinder-80070 Oct 27 15:46:04.709566 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [req-2b6675e6-6427-4c4d-93c0-5a54b8cb1791 req-509f865e-40d8-4ec0-8e99-69225f72460d service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.065083 Oct 27 15:46:04.710339 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 333/582] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Oct 27 15:46:04 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 15:46:04.715338 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-dd4eb325-ff1f-439c-abba-6709efee7743 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1027386698", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-2050413747", "security_groups": [{"name": "tempest-secgroup-smoke-338213581"}], "block_device_mapping_v2": [{"uuid": "82e8083f-419e-4058-a996-da93713d7f80", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "816f1cdd-21be-4397-bf09-ccc55a5f04b0"}]}} {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 15:46:04.837582 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-e61eaeda-7723-456d-ac41-be75fcdcb2a5 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96b599f8890b4281a7e311cf37a039e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d7fcab5d3f465793d650f16c6ea8de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:46:04.849413 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-e61eaeda-7723-456d-ac41-be75fcdcb2a5 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96" status: 200 len: 1567 microversion: 2.1 time: 0.204299 Oct 27 15:46:04.850066 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 250/583] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:46:04 2021] GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96 => generated 1567 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 15:46:04.851150 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.network.neutron [None req-dd4eb325-ff1f-439c-abba-6709efee7743 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] validate_networks() for [('816f1cdd-21be-4397-bf09-ccc55a5f04b0', None, None, None, None, None)] {{(pid=122224) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Oct 27 15:46:05.273437 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.virt.hardware [None req-dd4eb325-ff1f-439c-abba-6709efee7743 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Flavor limits 0:0:0 {{(pid=122224) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 15:46:05.273965 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.virt.hardware [None req-dd4eb325-ff1f-439c-abba-6709efee7743 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Image limits 0:0:0 {{(pid=122224) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 15:46:05.274311 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.virt.hardware [None req-dd4eb325-ff1f-439c-abba-6709efee7743 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Flavor pref 0:0:0 {{(pid=122224) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 15:46:05.274743 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.virt.hardware [None req-dd4eb325-ff1f-439c-abba-6709efee7743 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Image pref 0:0:0 {{(pid=122224) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 15:46:05.275151 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.virt.hardware [None req-dd4eb325-ff1f-439c-abba-6709efee7743 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122224) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 15:46:05.284424 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-dd4eb325-ff1f-439c-abba-6709efee7743 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:46:05.284867 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-dd4eb325-ff1f-439c-abba-6709efee7743 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:46:05.285773 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-dd4eb325-ff1f-439c-abba-6709efee7743 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:46:05.286311 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-dd4eb325-ff1f-439c-abba-6709efee7743 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:46:05.303159 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.quota [None req-dd4eb325-ff1f-439c-abba-6709efee7743 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Getting quotas for project 8818377e744d4f6ba65560705c191f0a. Resources: {'ram', 'instances', 'cores'} {{(pid=122224) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 27 15:46:05.307507 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.quota [None req-dd4eb325-ff1f-439c-abba-6709efee7743 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Getting quotas for user 4c757a383a434a4c9b1b928087af8de7 and project 8818377e744d4f6ba65560705c191f0a. Resources: {'ram', 'instances', 'cores'} {{(pid=122224) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 27 15:46:05.337405 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-971b593f-bd27-4dc6-b6e5-2193c5498ddf tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:46:05.338013 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-971b593f-bd27-4dc6-b6e5-2193c5498ddf tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:46:05.345892 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-971b593f-bd27-4dc6-b6e5-2193c5498ddf tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:46:05.346559 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-971b593f-bd27-4dc6-b6e5-2193c5498ddf tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:46:05.347334 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-971b593f-bd27-4dc6-b6e5-2193c5498ddf tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:46:05.348212 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-971b593f-bd27-4dc6-b6e5-2193c5498ddf tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:46:05.376377 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-dd4eb325-ff1f-439c-abba-6709efee7743 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Going to run 1 instances... {{(pid=122224) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Oct 27 15:46:05.378685 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-dd4eb325-ff1f-439c-abba-6709efee7743 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] [instance: a79303e6-05ad-4901-96b7-ce845b4016f4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='82e8083f-419e-4058-a996-da93713d7f80',volume_size=None,volume_type=None)] {{(pid=122224) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Oct 27 15:46:05.489807 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-971b593f-bd27-4dc6-b6e5-2193c5498ddf tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:46:05.498672 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-971b593f-bd27-4dc6-b6e5-2193c5498ddf tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:46:05.500369 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-971b593f-bd27-4dc6-b6e5-2193c5498ddf tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:46:05.501589 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-971b593f-bd27-4dc6-b6e5-2193c5498ddf tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672" status: 200 len: 1666 microversion: 2.20 time: 0.168047 Oct 27 15:46:05.502607 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 251/584] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Oct 27 15:46:05 2021] GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672 => generated 1666 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 15:46:05.528486 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-bb58151f-a66d-46c0-b3d8-24692b420b5a tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "edff6846-9aa2-4888-8ad9-b3c115a453d3"}} {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 15:46:05.529883 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-bb58151f-a66d-46c0-b3d8-24692b420b5a tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:46:05.537591 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-bb58151f-a66d-46c0-b3d8-24692b420b5a tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:46:05.538445 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-bb58151f-a66d-46c0-b3d8-24692b420b5a tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:46:05.539400 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-bb58151f-a66d-46c0-b3d8-24692b420b5a tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:46:05.540124 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-bb58151f-a66d-46c0-b3d8-24692b420b5a tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:46:05.564372 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-dd4eb325-ff1f-439c-abba-6709efee7743 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.852733 Oct 27 15:46:05.565643 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 334/585] 10.222.0.64 () {60 vars in 1146 bytes} [Wed Oct 27 15:46:04 2021] POST /compute/v2.1/servers => generated 405 bytes in 855 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 15:46:05.577032 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-e148207d-643a-41b6-a3b6-fa09a8c8901d tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:46:05.577637 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-e148207d-643a-41b6-a3b6-fa09a8c8901d tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] [instance: a79303e6-05ad-4901-96b7-ce845b4016f4] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:46:05.647737 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-e148207d-643a-41b6-a3b6-fa09a8c8901d tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c757a383a434a4c9b1b928087af8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8818377e744d4f6ba65560705c191f0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:46:05.656481 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-e148207d-643a-41b6-a3b6-fa09a8c8901d tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] 10.222.0.64 "GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4" status: 200 len: 1095 microversion: 2.1 time: 0.083313 Oct 27 15:46:05.657265 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 335/586] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:46:05 2021] GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4 => generated 1095 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 15:46:05.663772 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-a38e4079-992a-465f-bb33-65c9379e956e tempest-VolumesNegativeTest-2132035956 tempest-VolumesNegativeTest-2132035956-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:46:05.664657 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-a38e4079-992a-465f-bb33-65c9379e956e tempest-VolumesNegativeTest-2132035956 tempest-VolumesNegativeTest-2132035956-project] [instance: fa9eb157-6ba2-4953-b2b7-9b2e83f97878] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:46:05.685107 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-a38e4079-992a-465f-bb33-65c9379e956e tempest-VolumesNegativeTest-2132035956 tempest-VolumesNegativeTest-2132035956-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:46:05.686246 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-a38e4079-992a-465f-bb33-65c9379e956e tempest-VolumesNegativeTest-2132035956 tempest-VolumesNegativeTest-2132035956-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:46:05.688402 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-a38e4079-992a-465f-bb33-65c9379e956e tempest-VolumesNegativeTest-2132035956 tempest-VolumesNegativeTest-2132035956-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:46:05.688897 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-a38e4079-992a-465f-bb33-65c9379e956e tempest-VolumesNegativeTest-2132035956 tempest-VolumesNegativeTest-2132035956-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:46:05.858257 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-a38e4079-992a-465f-bb33-65c9379e956e tempest-VolumesNegativeTest-2132035956 tempest-VolumesNegativeTest-2132035956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88a99f03499f4af49c5da201ee2e9973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccaff4cb8c9f424ca1305e4eafac8c50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:46:05.870042 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-a38e4079-992a-465f-bb33-65c9379e956e tempest-VolumesNegativeTest-2132035956 tempest-VolumesNegativeTest-2132035956-project] 10.222.0.64 "GET /compute/v2.1/servers/fa9eb157-6ba2-4953-b2b7-9b2e83f97878" status: 200 len: 1465 microversion: 2.1 time: 0.211294 Oct 27 15:46:05.871001 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 336/587] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:46:05 2021] GET /compute/v2.1/servers/fa9eb157-6ba2-4953-b2b7-9b2e83f97878 => generated 1465 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 15:46:05.893242 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-8ede88e4-6900-42d7-8af7-d569a3777454 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:46:05.894667 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-8ede88e4-6900-42d7-8af7-d569a3777454 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: 62c89161-c119-48b2-839d-712db798ff96] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:46:05.904003 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-8ede88e4-6900-42d7-8af7-d569a3777454 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:46:05.905051 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-8ede88e4-6900-42d7-8af7-d569a3777454 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:46:05.906208 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-8ede88e4-6900-42d7-8af7-d569a3777454 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:46:05.907202 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-8ede88e4-6900-42d7-8af7-d569a3777454 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:46:05.982690 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-bb58151f-a66d-46c0-b3d8-24692b420b5a tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "POST /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.460384 Oct 27 15:46:05.984309 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 252/588] 10.222.0.64 () {62 vars in 1363 bytes} [Wed Oct 27 15:46:05 2021] POST /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672/os-volume_attachments => generated 188 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 15:46:05.992018 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-107ce9af-ea9a-431c-bd18-d18113016f18 tempest-VolumesNegativeTest-2132035956 tempest-VolumesNegativeTest-2132035956-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:46:05.992875 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-107ce9af-ea9a-431c-bd18-d18113016f18 tempest-VolumesNegativeTest-2132035956 tempest-VolumesNegativeTest-2132035956-project] [instance: fa9eb157-6ba2-4953-b2b7-9b2e83f97878] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:46:06.002072 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-107ce9af-ea9a-431c-bd18-d18113016f18 tempest-VolumesNegativeTest-2132035956 tempest-VolumesNegativeTest-2132035956-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:46:06.003025 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-107ce9af-ea9a-431c-bd18-d18113016f18 tempest-VolumesNegativeTest-2132035956 tempest-VolumesNegativeTest-2132035956-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:46:06.004106 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-107ce9af-ea9a-431c-bd18-d18113016f18 tempest-VolumesNegativeTest-2132035956 tempest-VolumesNegativeTest-2132035956-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:46:06.004796 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-107ce9af-ea9a-431c-bd18-d18113016f18 tempest-VolumesNegativeTest-2132035956 tempest-VolumesNegativeTest-2132035956-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:46:06.039575 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-107ce9af-ea9a-431c-bd18-d18113016f18 tempest-VolumesNegativeTest-2132035956 tempest-VolumesNegativeTest-2132035956-project] [instance: fa9eb157-6ba2-4953-b2b7-9b2e83f97878] Going to try to terminate instance {{(pid=122225) delete /opt/stack/nova/nova/compute/api.py:2612}} Oct 27 15:46:06.154964 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-8ede88e4-6900-42d7-8af7-d569a3777454 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96b599f8890b4281a7e311cf37a039e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d7fcab5d3f465793d650f16c6ea8de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:46:06.158294 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-107ce9af-ea9a-431c-bd18-d18113016f18 tempest-VolumesNegativeTest-2132035956 tempest-VolumesNegativeTest-2132035956-project] 10.222.0.64 "DELETE /compute/v2.1/servers/fa9eb157-6ba2-4953-b2b7-9b2e83f97878" status: 204 len: 0 microversion: 2.1 time: 0.171761 Oct 27 15:46:06.158898 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 253/589] 10.222.0.64 () {58 vars in 1238 bytes} [Wed Oct 27 15:46:05 2021] DELETE /compute/v2.1/servers/fa9eb157-6ba2-4953-b2b7-9b2e83f97878 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 15:46:06.167756 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-8ede88e4-6900-42d7-8af7-d569a3777454 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96" status: 200 len: 1567 microversion: 2.1 time: 0.282842 Oct 27 15:46:06.168968 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 337/590] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:46:05 2021] GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96 => generated 1567 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 15:46:06.170247 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-38da1aa6-f86a-450b-9c46-60baabb6483b tempest-VolumesNegativeTest-2132035956 tempest-VolumesNegativeTest-2132035956-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:46:06.171077 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-38da1aa6-f86a-450b-9c46-60baabb6483b tempest-VolumesNegativeTest-2132035956 tempest-VolumesNegativeTest-2132035956-project] [instance: fa9eb157-6ba2-4953-b2b7-9b2e83f97878] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:46:06.187258 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-38da1aa6-f86a-450b-9c46-60baabb6483b tempest-VolumesNegativeTest-2132035956 tempest-VolumesNegativeTest-2132035956-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:46:06.188067 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-38da1aa6-f86a-450b-9c46-60baabb6483b tempest-VolumesNegativeTest-2132035956 tempest-VolumesNegativeTest-2132035956-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:46:06.188901 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-38da1aa6-f86a-450b-9c46-60baabb6483b tempest-VolumesNegativeTest-2132035956 tempest-VolumesNegativeTest-2132035956-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:46:06.189518 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-38da1aa6-f86a-450b-9c46-60baabb6483b tempest-VolumesNegativeTest-2132035956 tempest-VolumesNegativeTest-2132035956-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:46:06.192976 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-ba969e23-2858-4582-b501-3f51fc69b792 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 15:46:06.193869 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-ba969e23-2858-4582-b501-3f51fc69b792 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:46:06.203372 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-ba969e23-2858-4582-b501-3f51fc69b792 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:46:06.203819 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-ba969e23-2858-4582-b501-3f51fc69b792 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:46:06.204673 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-ba969e23-2858-4582-b501-3f51fc69b792 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:46:06.205656 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-ba969e23-2858-4582-b501-3f51fc69b792 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:46:06.323746 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-ba969e23-2858-4582-b501-3f51fc69b792 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "POST /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672/action" status: 202 len: 0 microversion: 2.20 time: 0.134636 Oct 27 15:46:06.327837 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 338/591] 10.222.0.64 () {62 vars in 1318 bytes} [Wed Oct 27 15:46:06 2021] POST /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672/action => generated 0 bytes in 137 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 27 15:46:06.333545 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-f56ec229-9eae-4e1b-8491-aaea21dcbeac tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:46:06.334168 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-f56ec229-9eae-4e1b-8491-aaea21dcbeac tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:46:06.340957 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-f56ec229-9eae-4e1b-8491-aaea21dcbeac tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:46:06.341410 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-f56ec229-9eae-4e1b-8491-aaea21dcbeac tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:46:06.342213 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-f56ec229-9eae-4e1b-8491-aaea21dcbeac tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:46:06.342652 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-f56ec229-9eae-4e1b-8491-aaea21dcbeac tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:46:06.500539 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-f56ec229-9eae-4e1b-8491-aaea21dcbeac tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:46:06.511027 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-f56ec229-9eae-4e1b-8491-aaea21dcbeac tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:46:06.517849 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-f56ec229-9eae-4e1b-8491-aaea21dcbeac tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:46:06.519046 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-f56ec229-9eae-4e1b-8491-aaea21dcbeac tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672" status: 200 len: 1752 microversion: 2.20 time: 0.190185 Oct 27 15:46:06.519611 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 339/592] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Oct 27 15:46:06 2021] GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672 => generated 1752 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 15:46:06.634825 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-38da1aa6-f86a-450b-9c46-60baabb6483b tempest-VolumesNegativeTest-2132035956 tempest-VolumesNegativeTest-2132035956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88a99f03499f4af49c5da201ee2e9973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccaff4cb8c9f424ca1305e4eafac8c50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:46:06.644808 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-38da1aa6-f86a-450b-9c46-60baabb6483b tempest-VolumesNegativeTest-2132035956 tempest-VolumesNegativeTest-2132035956-project] 10.222.0.64 "GET /compute/v2.1/servers/fa9eb157-6ba2-4953-b2b7-9b2e83f97878" status: 200 len: 1471 microversion: 2.1 time: 0.480211 Oct 27 15:46:06.646004 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 254/593] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:46:06 2021] GET /compute/v2.1/servers/fa9eb157-6ba2-4953-b2b7-9b2e83f97878 => generated 1471 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 15:46:06.675153 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-404b1359-f48a-4cab-b055-4d3634dee66c tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:46:06.675762 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-404b1359-f48a-4cab-b055-4d3634dee66c tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] [instance: a79303e6-05ad-4901-96b7-ce845b4016f4] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:46:06.682274 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-404b1359-f48a-4cab-b055-4d3634dee66c tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:46:06.682727 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-404b1359-f48a-4cab-b055-4d3634dee66c tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:46:06.683535 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-404b1359-f48a-4cab-b055-4d3634dee66c tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:46:06.684016 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-404b1359-f48a-4cab-b055-4d3634dee66c tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:46:06.762137 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-404b1359-f48a-4cab-b055-4d3634dee66c tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c757a383a434a4c9b1b928087af8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8818377e744d4f6ba65560705c191f0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:46:06.769568 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-404b1359-f48a-4cab-b055-4d3634dee66c tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] 10.222.0.64 "GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4" status: 200 len: 1193 microversion: 2.1 time: 0.098088 Oct 27 15:46:06.771177 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 340/594] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:46:06 2021] GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4 => generated 1193 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 15:46:07.187119 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-5d9c38e4-bd83-4f9b-b133-64e69eee9b5f tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:46:07.188425 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-5d9c38e4-bd83-4f9b-b133-64e69eee9b5f tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: 62c89161-c119-48b2-839d-712db798ff96] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:46:07.197112 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-5d9c38e4-bd83-4f9b-b133-64e69eee9b5f tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:46:07.197612 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-5d9c38e4-bd83-4f9b-b133-64e69eee9b5f tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:46:07.198760 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-5d9c38e4-bd83-4f9b-b133-64e69eee9b5f tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:46:07.199448 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-5d9c38e4-bd83-4f9b-b133-64e69eee9b5f tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:46:07.368311 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-5d9c38e4-bd83-4f9b-b133-64e69eee9b5f tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96b599f8890b4281a7e311cf37a039e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d7fcab5d3f465793d650f16c6ea8de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:46:07.377582 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-5d9c38e4-bd83-4f9b-b133-64e69eee9b5f tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96" status: 200 len: 1567 microversion: 2.1 time: 0.195271 Oct 27 15:46:07.388089 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 255/595] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:46:07 2021] GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96 => generated 1567 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 15:46:07.540180 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-ee7e96bb-ad8c-47af-adb3-263d7e50fbe1 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:46:07.540180 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-ee7e96bb-ad8c-47af-adb3-263d7e50fbe1 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:46:07.546612 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-ee7e96bb-ad8c-47af-adb3-263d7e50fbe1 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:46:07.547364 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-ee7e96bb-ad8c-47af-adb3-263d7e50fbe1 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:46:07.548438 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-ee7e96bb-ad8c-47af-adb3-263d7e50fbe1 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:46:07.549212 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-ee7e96bb-ad8c-47af-adb3-263d7e50fbe1 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:46:07.663293 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-55e6e086-3e58-408f-bc1f-44978af1f7f7 tempest-VolumesNegativeTest-2132035956 tempest-VolumesNegativeTest-2132035956-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:46:07.663911 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-55e6e086-3e58-408f-bc1f-44978af1f7f7 tempest-VolumesNegativeTest-2132035956 tempest-VolumesNegativeTest-2132035956-project] [instance: fa9eb157-6ba2-4953-b2b7-9b2e83f97878] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:46:07.670045 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-55e6e086-3e58-408f-bc1f-44978af1f7f7 tempest-VolumesNegativeTest-2132035956 tempest-VolumesNegativeTest-2132035956-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:46:07.670480 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-55e6e086-3e58-408f-bc1f-44978af1f7f7 tempest-VolumesNegativeTest-2132035956 tempest-VolumesNegativeTest-2132035956-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:46:07.671248 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-55e6e086-3e58-408f-bc1f-44978af1f7f7 tempest-VolumesNegativeTest-2132035956 tempest-VolumesNegativeTest-2132035956-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:46:07.671673 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-55e6e086-3e58-408f-bc1f-44978af1f7f7 tempest-VolumesNegativeTest-2132035956 tempest-VolumesNegativeTest-2132035956-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:46:07.766831 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-ee7e96bb-ad8c-47af-adb3-263d7e50fbe1 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:46:07.778963 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-ee7e96bb-ad8c-47af-adb3-263d7e50fbe1 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:46:07.783185 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-ee7e96bb-ad8c-47af-adb3-263d7e50fbe1 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:46:07.785834 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-ee7e96bb-ad8c-47af-adb3-263d7e50fbe1 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672" status: 200 len: 1752 microversion: 2.20 time: 0.251223 Oct 27 15:46:07.797492 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 341/596] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Oct 27 15:46:07 2021] GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672 => generated 1752 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 15:46:07.803881 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-c63e0e45-db0a-4a10-948b-fbf5d4f7f966 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:46:07.804997 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-c63e0e45-db0a-4a10-948b-fbf5d4f7f966 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] [instance: a79303e6-05ad-4901-96b7-ce845b4016f4] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:46:07.812723 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-c63e0e45-db0a-4a10-948b-fbf5d4f7f966 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:46:07.813464 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-c63e0e45-db0a-4a10-948b-fbf5d4f7f966 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:46:07.814409 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-c63e0e45-db0a-4a10-948b-fbf5d4f7f966 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:46:07.815003 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-c63e0e45-db0a-4a10-948b-fbf5d4f7f966 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:46:07.819175 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-55e6e086-3e58-408f-bc1f-44978af1f7f7 tempest-VolumesNegativeTest-2132035956 tempest-VolumesNegativeTest-2132035956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88a99f03499f4af49c5da201ee2e9973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccaff4cb8c9f424ca1305e4eafac8c50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:46:07.827144 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-55e6e086-3e58-408f-bc1f-44978af1f7f7 tempest-VolumesNegativeTest-2132035956 tempest-VolumesNegativeTest-2132035956-project] 10.222.0.64 "GET /compute/v2.1/servers/fa9eb157-6ba2-4953-b2b7-9b2e83f97878" status: 200 len: 1471 microversion: 2.1 time: 0.167910 Oct 27 15:46:07.828167 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 256/597] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:46:07 2021] GET /compute/v2.1/servers/fa9eb157-6ba2-4953-b2b7-9b2e83f97878 => generated 1471 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 15:46:08.027987 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-c63e0e45-db0a-4a10-948b-fbf5d4f7f966 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c757a383a434a4c9b1b928087af8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8818377e744d4f6ba65560705c191f0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:46:08.036674 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-c63e0e45-db0a-4a10-948b-fbf5d4f7f966 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] 10.222.0.64 "GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4" status: 200 len: 1278 microversion: 2.1 time: 0.236572 Oct 27 15:46:08.039836 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 342/598] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:46:07 2021] GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4 => generated 1278 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 15:46:08.395292 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-0c8f0333-88b8-4399-8141-cebd667aec35 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:46:08.396194 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-0c8f0333-88b8-4399-8141-cebd667aec35 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: 62c89161-c119-48b2-839d-712db798ff96] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:46:08.408855 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-0c8f0333-88b8-4399-8141-cebd667aec35 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:46:08.412213 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-0c8f0333-88b8-4399-8141-cebd667aec35 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:46:08.413548 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-0c8f0333-88b8-4399-8141-cebd667aec35 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:46:08.416448 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-0c8f0333-88b8-4399-8141-cebd667aec35 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:46:08.756140 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-0c8f0333-88b8-4399-8141-cebd667aec35 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96b599f8890b4281a7e311cf37a039e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d7fcab5d3f465793d650f16c6ea8de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:46:08.766481 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-0c8f0333-88b8-4399-8141-cebd667aec35 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96" status: 200 len: 1567 microversion: 2.1 time: 0.375437 Oct 27 15:46:08.767397 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 257/599] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:46:08 2021] GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96 => generated 1567 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 15:46:08.805888 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-1e15f8f1-07ac-4efa-b363-85c35686b52f tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:46:08.806346 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-1e15f8f1-07ac-4efa-b363-85c35686b52f tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:46:08.822531 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [req-fef4151f-0e99-4453-bfd5-e68c864a420e req-c32fa77a-43b0-42ca-8847-7346ce6ebeeb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a79303e6-05ad-4901-96b7-ce845b4016f4", "tag": "9cdb66cd-4ae2-4cf0-98ca-af0002156976"}]} {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 15:46:08.824774 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 27 15:46:08.824774 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: warnings.warn(msg) Oct 27 15:46:08.835566 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-1e15f8f1-07ac-4efa-b363-85c35686b52f tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:46:08.839943 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-1e15f8f1-07ac-4efa-b363-85c35686b52f tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:46:08.841687 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-1e15f8f1-07ac-4efa-b363-85c35686b52f tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:46:08.842635 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-1e15f8f1-07ac-4efa-b363-85c35686b52f tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:46:08.858072 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [req-fef4151f-0e99-4453-bfd5-e68c864a420e req-c32fa77a-43b0-42ca-8847-7346ce6ebeeb service nova] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:46:08.860368 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [req-fef4151f-0e99-4453-bfd5-e68c864a420e req-c32fa77a-43b0-42ca-8847-7346ce6ebeeb service nova] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:46:08.876187 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.compute.server_external_events [req-fef4151f-0e99-4453-bfd5-e68c864a420e req-c32fa77a-43b0-42ca-8847-7346ce6ebeeb service nova] Creating event network-changed:9cdb66cd-4ae2-4cf0-98ca-af0002156976 for instance a79303e6-05ad-4901-96b7-ce845b4016f4 on hv-cinder-80070 Oct 27 15:46:08.887315 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [req-fef4151f-0e99-4453-bfd5-e68c864a420e req-c32fa77a-43b0-42ca-8847-7346ce6ebeeb service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071048 Oct 27 15:46:08.888780 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 258/600] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Oct 27 15:46:08 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 15:46:08.899830 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-8080f81a-5027-4da3-8a62-68c2a02bdc2d tempest-VolumesNegativeTest-2132035956 tempest-VolumesNegativeTest-2132035956-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:46:08.901368 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-8080f81a-5027-4da3-8a62-68c2a02bdc2d tempest-VolumesNegativeTest-2132035956 tempest-VolumesNegativeTest-2132035956-project] [instance: fa9eb157-6ba2-4953-b2b7-9b2e83f97878] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:46:08.909633 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-8080f81a-5027-4da3-8a62-68c2a02bdc2d tempest-VolumesNegativeTest-2132035956 tempest-VolumesNegativeTest-2132035956-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:46:08.910979 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-8080f81a-5027-4da3-8a62-68c2a02bdc2d tempest-VolumesNegativeTest-2132035956 tempest-VolumesNegativeTest-2132035956-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:46:08.913783 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-8080f81a-5027-4da3-8a62-68c2a02bdc2d tempest-VolumesNegativeTest-2132035956 tempest-VolumesNegativeTest-2132035956-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:46:08.914416 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-8080f81a-5027-4da3-8a62-68c2a02bdc2d tempest-VolumesNegativeTest-2132035956 tempest-VolumesNegativeTest-2132035956-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:46:09.189202 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-1e15f8f1-07ac-4efa-b363-85c35686b52f tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:46:09.200927 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-1e15f8f1-07ac-4efa-b363-85c35686b52f tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:46:09.203008 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-1e15f8f1-07ac-4efa-b363-85c35686b52f tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:46:09.204761 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-1e15f8f1-07ac-4efa-b363-85c35686b52f tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672" status: 200 len: 1754 microversion: 2.20 time: 0.404114 Oct 27 15:46:09.217581 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 343/601] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Oct 27 15:46:08 2021] GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672 => generated 1754 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 15:46:09.224700 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-762afb0a-9c19-4e1f-99db-cafe93042eb0 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:46:09.225924 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-762afb0a-9c19-4e1f-99db-cafe93042eb0 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] [instance: a79303e6-05ad-4901-96b7-ce845b4016f4] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:46:09.234555 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-762afb0a-9c19-4e1f-99db-cafe93042eb0 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:46:09.235524 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-762afb0a-9c19-4e1f-99db-cafe93042eb0 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:46:09.238005 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-762afb0a-9c19-4e1f-99db-cafe93042eb0 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:46:09.238005 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-762afb0a-9c19-4e1f-99db-cafe93042eb0 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:46:09.251323 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-8080f81a-5027-4da3-8a62-68c2a02bdc2d tempest-VolumesNegativeTest-2132035956 tempest-VolumesNegativeTest-2132035956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88a99f03499f4af49c5da201ee2e9973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccaff4cb8c9f424ca1305e4eafac8c50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:46:09.262264 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-8080f81a-5027-4da3-8a62-68c2a02bdc2d tempest-VolumesNegativeTest-2132035956 tempest-VolumesNegativeTest-2132035956-project] 10.222.0.64 "GET /compute/v2.1/servers/fa9eb157-6ba2-4953-b2b7-9b2e83f97878" status: 200 len: 1471 microversion: 2.1 time: 0.372117 Oct 27 15:46:09.263176 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 259/602] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:46:08 2021] GET /compute/v2.1/servers/fa9eb157-6ba2-4953-b2b7-9b2e83f97878 => generated 1471 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 15:46:09.268379 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [req-406e78d8-1ed4-42b7-98ae-f57b85a2b202 req-4c0d28d4-0e40-43a0-a00d-3b62b2256cc1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fa9eb157-6ba2-4953-b2b7-9b2e83f97878", "name": "network-vif-deleted", "tag": "0817cfca-a4f6-4ee1-9fc5-268d60c33774"}]} {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 15:46:09.271254 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 27 15:46:09.271254 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: warnings.warn(msg) Oct 27 15:46:09.281946 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [req-406e78d8-1ed4-42b7-98ae-f57b85a2b202 req-4c0d28d4-0e40-43a0-a00d-3b62b2256cc1 service nova] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:46:09.283362 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [req-406e78d8-1ed4-42b7-98ae-f57b85a2b202 req-4c0d28d4-0e40-43a0-a00d-3b62b2256cc1 service nova] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:46:09.315397 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.compute.server_external_events [req-406e78d8-1ed4-42b7-98ae-f57b85a2b202 req-4c0d28d4-0e40-43a0-a00d-3b62b2256cc1 service nova] Creating event network-vif-deleted:0817cfca-a4f6-4ee1-9fc5-268d60c33774 for instance fa9eb157-6ba2-4953-b2b7-9b2e83f97878 on hv-cinder-80070 Oct 27 15:46:09.322141 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [req-406e78d8-1ed4-42b7-98ae-f57b85a2b202 req-4c0d28d4-0e40-43a0-a00d-3b62b2256cc1 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057376 Oct 27 15:46:09.323073 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 260/603] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Oct 27 15:46:09 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 15:46:09.488427 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-762afb0a-9c19-4e1f-99db-cafe93042eb0 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c757a383a434a4c9b1b928087af8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8818377e744d4f6ba65560705c191f0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:46:09.495786 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-762afb0a-9c19-4e1f-99db-cafe93042eb0 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] 10.222.0.64 "GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4" status: 200 len: 1278 microversion: 2.1 time: 0.276424 Oct 27 15:46:09.496762 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 344/604] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:46:09 2021] GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4 => generated 1278 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 15:46:09.785073 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-7dd6fa69-864a-42bb-a6a0-29211aedd9c1 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:46:09.785817 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-7dd6fa69-864a-42bb-a6a0-29211aedd9c1 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: 62c89161-c119-48b2-839d-712db798ff96] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:46:09.794088 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-7dd6fa69-864a-42bb-a6a0-29211aedd9c1 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:46:09.794808 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-7dd6fa69-864a-42bb-a6a0-29211aedd9c1 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:46:09.795895 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-7dd6fa69-864a-42bb-a6a0-29211aedd9c1 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:46:09.796692 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-7dd6fa69-864a-42bb-a6a0-29211aedd9c1 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:46:10.060182 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-7dd6fa69-864a-42bb-a6a0-29211aedd9c1 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96b599f8890b4281a7e311cf37a039e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d7fcab5d3f465793d650f16c6ea8de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:46:10.068909 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-7dd6fa69-864a-42bb-a6a0-29211aedd9c1 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96" status: 200 len: 1567 microversion: 2.1 time: 0.288203 Oct 27 15:46:10.069830 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 261/605] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:46:09 2021] GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96 => generated 1567 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 15:46:10.225724 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-2964d160-f11a-4709-b409-247181e35326 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:46:10.226688 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-2964d160-f11a-4709-b409-247181e35326 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:46:10.233448 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-2964d160-f11a-4709-b409-247181e35326 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:46:10.233900 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-2964d160-f11a-4709-b409-247181e35326 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:46:10.234685 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-2964d160-f11a-4709-b409-247181e35326 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:46:10.235121 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-2964d160-f11a-4709-b409-247181e35326 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:46:10.279959 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-6fe20071-2bcd-4afa-8312-7132c027d96d tempest-VolumesNegativeTest-2132035956 tempest-VolumesNegativeTest-2132035956-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:46:10.280753 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-6fe20071-2bcd-4afa-8312-7132c027d96d tempest-VolumesNegativeTest-2132035956 tempest-VolumesNegativeTest-2132035956-project] [instance: fa9eb157-6ba2-4953-b2b7-9b2e83f97878] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:46:10.287077 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-6fe20071-2bcd-4afa-8312-7132c027d96d tempest-VolumesNegativeTest-2132035956 tempest-VolumesNegativeTest-2132035956-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:46:10.287556 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-6fe20071-2bcd-4afa-8312-7132c027d96d tempest-VolumesNegativeTest-2132035956 tempest-VolumesNegativeTest-2132035956-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:46:10.288387 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-6fe20071-2bcd-4afa-8312-7132c027d96d tempest-VolumesNegativeTest-2132035956 tempest-VolumesNegativeTest-2132035956-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:46:10.288852 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-6fe20071-2bcd-4afa-8312-7132c027d96d tempest-VolumesNegativeTest-2132035956 tempest-VolumesNegativeTest-2132035956-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:46:10.304027 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.wsgi [None req-6fe20071-2bcd-4afa-8312-7132c027d96d tempest-VolumesNegativeTest-2132035956 tempest-VolumesNegativeTest-2132035956-project] HTTP exception thrown: Instance fa9eb157-6ba2-4953-b2b7-9b2e83f97878 could not be found. Oct 27 15:46:10.304785 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-6fe20071-2bcd-4afa-8312-7132c027d96d tempest-VolumesNegativeTest-2132035956 tempest-VolumesNegativeTest-2132035956-project] Returning 404 to user: Instance fa9eb157-6ba2-4953-b2b7-9b2e83f97878 could not be found. {{(pid=122225) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 27 15:46:10.305717 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-6fe20071-2bcd-4afa-8312-7132c027d96d tempest-VolumesNegativeTest-2132035956 tempest-VolumesNegativeTest-2132035956-project] 10.222.0.64 "GET /compute/v2.1/servers/fa9eb157-6ba2-4953-b2b7-9b2e83f97878" status: 404 len: 111 microversion: 2.1 time: 0.029752 Oct 27 15:46:10.306543 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 262/606] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:46:10 2021] GET /compute/v2.1/servers/fa9eb157-6ba2-4953-b2b7-9b2e83f97878 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 27 15:46:10.472496 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-2964d160-f11a-4709-b409-247181e35326 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:46:10.485556 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-2964d160-f11a-4709-b409-247181e35326 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:46:10.489458 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-2964d160-f11a-4709-b409-247181e35326 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:46:10.492403 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-2964d160-f11a-4709-b409-247181e35326 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672" status: 200 len: 1754 microversion: 2.20 time: 0.270882 Oct 27 15:46:10.494431 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 345/607] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Oct 27 15:46:10 2021] GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672 => generated 1754 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 15:46:10.514407 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-0bce53a4-9926-466c-b1cc-a7c6a71adbab tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:46:10.515097 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-0bce53a4-9926-466c-b1cc-a7c6a71adbab tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] [instance: a79303e6-05ad-4901-96b7-ce845b4016f4] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:46:10.525958 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-0bce53a4-9926-466c-b1cc-a7c6a71adbab tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:46:10.526410 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-0bce53a4-9926-466c-b1cc-a7c6a71adbab tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:46:10.527339 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-0bce53a4-9926-466c-b1cc-a7c6a71adbab tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:46:10.527879 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-0bce53a4-9926-466c-b1cc-a7c6a71adbab tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:46:10.676894 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-0bce53a4-9926-466c-b1cc-a7c6a71adbab tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c757a383a434a4c9b1b928087af8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8818377e744d4f6ba65560705c191f0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:46:10.684369 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-0bce53a4-9926-466c-b1cc-a7c6a71adbab tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] 10.222.0.64 "GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4" status: 200 len: 1278 microversion: 2.1 time: 0.174459 Oct 27 15:46:10.693186 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 263/608] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:46:10 2021] GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4 => generated 1278 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 15:46:11.089517 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-9a02af7a-6f52-41db-b5ed-e9b1e1e58b3c tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:46:11.090486 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-9a02af7a-6f52-41db-b5ed-e9b1e1e58b3c tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: 62c89161-c119-48b2-839d-712db798ff96] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:46:11.101629 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-9a02af7a-6f52-41db-b5ed-e9b1e1e58b3c tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:46:11.102174 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-9a02af7a-6f52-41db-b5ed-e9b1e1e58b3c tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:46:11.104024 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-9a02af7a-6f52-41db-b5ed-e9b1e1e58b3c tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:46:11.106875 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-9a02af7a-6f52-41db-b5ed-e9b1e1e58b3c tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:46:11.350862 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-9a02af7a-6f52-41db-b5ed-e9b1e1e58b3c tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96b599f8890b4281a7e311cf37a039e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d7fcab5d3f465793d650f16c6ea8de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:46:11.360171 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-9a02af7a-6f52-41db-b5ed-e9b1e1e58b3c tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96" status: 200 len: 1567 microversion: 2.1 time: 0.274824 Oct 27 15:46:11.360954 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 346/609] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:46:11 2021] GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96 => generated 1567 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 15:46:11.511399 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-8458b244-0254-462a-b317-db3c53928ff3 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:46:11.512100 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-8458b244-0254-462a-b317-db3c53928ff3 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:46:11.519674 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-8458b244-0254-462a-b317-db3c53928ff3 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:46:11.520207 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-8458b244-0254-462a-b317-db3c53928ff3 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:46:11.520995 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-8458b244-0254-462a-b317-db3c53928ff3 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:46:11.521434 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-8458b244-0254-462a-b317-db3c53928ff3 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:46:11.670215 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-8458b244-0254-462a-b317-db3c53928ff3 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:46:11.683291 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-8458b244-0254-462a-b317-db3c53928ff3 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:46:11.686637 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-8458b244-0254-462a-b317-db3c53928ff3 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:46:11.688267 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-8458b244-0254-462a-b317-db3c53928ff3 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672" status: 200 len: 1754 microversion: 2.20 time: 0.180654 Oct 27 15:46:11.688910 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 264/610] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Oct 27 15:46:11 2021] GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672 => generated 1754 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 15:46:11.701771 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-33fbb631-494f-4a6c-b790-d378a99577ee tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:46:11.702472 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-33fbb631-494f-4a6c-b790-d378a99577ee tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] [instance: a79303e6-05ad-4901-96b7-ce845b4016f4] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:46:11.708830 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-33fbb631-494f-4a6c-b790-d378a99577ee tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:46:11.709281 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-33fbb631-494f-4a6c-b790-d378a99577ee tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:46:11.710066 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-33fbb631-494f-4a6c-b790-d378a99577ee tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:46:11.711112 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-33fbb631-494f-4a6c-b790-d378a99577ee tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:46:11.845943 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-33fbb631-494f-4a6c-b790-d378a99577ee tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c757a383a434a4c9b1b928087af8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8818377e744d4f6ba65560705c191f0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:46:11.853754 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-33fbb631-494f-4a6c-b790-d378a99577ee tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] 10.222.0.64 "GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4" status: 200 len: 1266 microversion: 2.1 time: 0.155663 Oct 27 15:46:11.854502 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 347/611] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:46:11 2021] GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4 => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 15:46:12.378018 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-deb40243-0aab-4be6-82ca-8d35719c7816 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:46:12.378776 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-deb40243-0aab-4be6-82ca-8d35719c7816 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: 62c89161-c119-48b2-839d-712db798ff96] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:46:12.385438 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-deb40243-0aab-4be6-82ca-8d35719c7816 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:46:12.386003 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-deb40243-0aab-4be6-82ca-8d35719c7816 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:46:12.386892 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-deb40243-0aab-4be6-82ca-8d35719c7816 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:46:12.387551 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-deb40243-0aab-4be6-82ca-8d35719c7816 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:46:12.549021 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-deb40243-0aab-4be6-82ca-8d35719c7816 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96b599f8890b4281a7e311cf37a039e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d7fcab5d3f465793d650f16c6ea8de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:46:12.562591 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-deb40243-0aab-4be6-82ca-8d35719c7816 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96" status: 200 len: 1547 microversion: 2.1 time: 0.187913 Oct 27 15:46:12.563051 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 265/612] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:46:12 2021] GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96 => generated 1547 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 15:46:12.579705 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-7522fc96-5e36-48f3-9f67-a225a0317327 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:46:12.580859 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-7522fc96-5e36-48f3-9f67-a225a0317327 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: 62c89161-c119-48b2-839d-712db798ff96] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:46:12.587840 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-7522fc96-5e36-48f3-9f67-a225a0317327 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:46:12.588348 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-7522fc96-5e36-48f3-9f67-a225a0317327 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:46:12.589135 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-7522fc96-5e36-48f3-9f67-a225a0317327 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:46:12.589567 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-7522fc96-5e36-48f3-9f67-a225a0317327 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:46:12.706350 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-d5366084-ee28-4b33-a846-47c8f2a81a18 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:46:12.706885 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-d5366084-ee28-4b33-a846-47c8f2a81a18 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:46:12.713664 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-d5366084-ee28-4b33-a846-47c8f2a81a18 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:46:12.714111 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-d5366084-ee28-4b33-a846-47c8f2a81a18 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:46:12.714885 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-d5366084-ee28-4b33-a846-47c8f2a81a18 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:46:12.715315 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-d5366084-ee28-4b33-a846-47c8f2a81a18 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:46:12.853001 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-d5366084-ee28-4b33-a846-47c8f2a81a18 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:46:12.861306 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-d5366084-ee28-4b33-a846-47c8f2a81a18 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:46:12.863022 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-d5366084-ee28-4b33-a846-47c8f2a81a18 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:46:12.864390 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-d5366084-ee28-4b33-a846-47c8f2a81a18 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672" status: 200 len: 1754 microversion: 2.20 time: 0.161706 Oct 27 15:46:12.864946 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 266/613] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Oct 27 15:46:12 2021] GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672 => generated 1754 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 15:46:12.875646 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.wsgi [None req-7522fc96-5e36-48f3-9f67-a225a0317327 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] HTTP exception thrown: Cannot 'detach_volume' instance 62c89161-c119-48b2-839d-712db798ff96 while it is in vm_state rescued Oct 27 15:46:12.876367 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-7522fc96-5e36-48f3-9f67-a225a0317327 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Returning 409 to user: Cannot 'detach_volume' instance 62c89161-c119-48b2-839d-712db798ff96 while it is in vm_state rescued {{(pid=122224) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 27 15:46:12.877357 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-8f1e808e-45e8-4356-872c-c9b8695d3b0f tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:46:12.877485 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-7522fc96-5e36-48f3-9f67-a225a0317327 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "DELETE /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments/1a159978-aec1-4494-8cf3-0edd45b0ae39" status: 409 len: 152 microversion: 2.1 time: 0.301503 Oct 27 15:46:12.877912 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 348/614] 10.222.0.64 () {58 vars in 1415 bytes} [Wed Oct 27 15:46:12 2021] DELETE /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments/1a159978-aec1-4494-8cf3-0edd45b0ae39 => generated 152 bytes in 303 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 27 15:46:12.878046 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-8f1e808e-45e8-4356-872c-c9b8695d3b0f tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] [instance: a79303e6-05ad-4901-96b7-ce845b4016f4] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:46:12.884689 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-8f1e808e-45e8-4356-872c-c9b8695d3b0f tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:46:12.885151 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-8f1e808e-45e8-4356-872c-c9b8695d3b0f tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:46:12.886780 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-8f1e808e-45e8-4356-872c-c9b8695d3b0f tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:46:12.887226 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-8f1e808e-45e8-4356-872c-c9b8695d3b0f tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:46:12.890897 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-cb97f565-965f-407b-8987-d0829350df3c tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 15:46:12.891441 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-cb97f565-965f-407b-8987-d0829350df3c tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: 62c89161-c119-48b2-839d-712db798ff96] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:46:12.899696 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-cb97f565-965f-407b-8987-d0829350df3c tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:46:12.900454 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-cb97f565-965f-407b-8987-d0829350df3c tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:46:12.901232 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-cb97f565-965f-407b-8987-d0829350df3c tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:46:12.901670 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-cb97f565-965f-407b-8987-d0829350df3c tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:46:12.977861 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-cb97f565-965f-407b-8987-d0829350df3c tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "POST /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/action" status: 202 len: 0 microversion: 2.1 time: 0.094064 Oct 27 15:46:12.978771 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 349/615] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Oct 27 15:46:12 2021] POST /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/action => generated 0 bytes in 96 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 15:46:12.988433 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-ada6d067-a165-4fb0-ac12-6add06ce5eb2 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:46:12.990010 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-ada6d067-a165-4fb0-ac12-6add06ce5eb2 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: 62c89161-c119-48b2-839d-712db798ff96] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:46:12.997713 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-ada6d067-a165-4fb0-ac12-6add06ce5eb2 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:46:12.998445 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-ada6d067-a165-4fb0-ac12-6add06ce5eb2 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:46:13.000431 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-ada6d067-a165-4fb0-ac12-6add06ce5eb2 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:46:13.001122 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-ada6d067-a165-4fb0-ac12-6add06ce5eb2 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:46:13.022078 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-8f1e808e-45e8-4356-872c-c9b8695d3b0f tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c757a383a434a4c9b1b928087af8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8818377e744d4f6ba65560705c191f0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:46:13.029901 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-8f1e808e-45e8-4356-872c-c9b8695d3b0f tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] 10.222.0.64 "GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4" status: 200 len: 1266 microversion: 2.1 time: 0.156196 Oct 27 15:46:13.030480 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 267/616] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:46:12 2021] GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4 => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 15:46:13.244154 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-ada6d067-a165-4fb0-ac12-6add06ce5eb2 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96b599f8890b4281a7e311cf37a039e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d7fcab5d3f465793d650f16c6ea8de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:46:13.261601 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-ada6d067-a165-4fb0-ac12-6add06ce5eb2 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96" status: 200 len: 1555 microversion: 2.1 time: 0.277083 Oct 27 15:46:13.262649 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 350/617] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:46:12 2021] GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96 => generated 1555 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 15:46:13.883100 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-8938035a-2125-44b5-a86e-b2b9b5d62cd8 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:46:13.888880 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-8938035a-2125-44b5-a86e-b2b9b5d62cd8 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:46:13.896265 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-8938035a-2125-44b5-a86e-b2b9b5d62cd8 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:46:13.896711 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-8938035a-2125-44b5-a86e-b2b9b5d62cd8 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:46:13.897484 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-8938035a-2125-44b5-a86e-b2b9b5d62cd8 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:46:13.897915 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-8938035a-2125-44b5-a86e-b2b9b5d62cd8 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:46:14.030281 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-8938035a-2125-44b5-a86e-b2b9b5d62cd8 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:46:14.042421 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-8938035a-2125-44b5-a86e-b2b9b5d62cd8 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:46:14.044647 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-8938035a-2125-44b5-a86e-b2b9b5d62cd8 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:46:14.047401 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-8938035a-2125-44b5-a86e-b2b9b5d62cd8 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672" status: 200 len: 1754 microversion: 2.20 time: 0.168877 Oct 27 15:46:14.048270 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 268/618] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Oct 27 15:46:13 2021] GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672 => generated 1754 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 15:46:14.048404 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-8a745601-63e7-4051-9c04-7533426339a6 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:46:14.049031 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-8a745601-63e7-4051-9c04-7533426339a6 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] [instance: a79303e6-05ad-4901-96b7-ce845b4016f4] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:46:14.056822 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-8a745601-63e7-4051-9c04-7533426339a6 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:46:14.057317 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-8a745601-63e7-4051-9c04-7533426339a6 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:46:14.058088 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-8a745601-63e7-4051-9c04-7533426339a6 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:46:14.058691 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-8a745601-63e7-4051-9c04-7533426339a6 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:46:14.197132 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-8a745601-63e7-4051-9c04-7533426339a6 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c757a383a434a4c9b1b928087af8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8818377e744d4f6ba65560705c191f0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:46:14.204424 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-8a745601-63e7-4051-9c04-7533426339a6 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] 10.222.0.64 "GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4" status: 200 len: 1266 microversion: 2.1 time: 0.160799 Oct 27 15:46:14.204986 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 351/619] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:46:14 2021] GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4 => generated 1266 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 15:46:14.280363 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-d558f26d-ed45-4439-a35c-fa5bc2eb7935 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:46:14.280887 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-d558f26d-ed45-4439-a35c-fa5bc2eb7935 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: 62c89161-c119-48b2-839d-712db798ff96] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:46:14.287529 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-d558f26d-ed45-4439-a35c-fa5bc2eb7935 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:46:14.287998 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-d558f26d-ed45-4439-a35c-fa5bc2eb7935 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:46:14.288773 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-d558f26d-ed45-4439-a35c-fa5bc2eb7935 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:46:14.289206 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-d558f26d-ed45-4439-a35c-fa5bc2eb7935 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:46:14.413865 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-d558f26d-ed45-4439-a35c-fa5bc2eb7935 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96b599f8890b4281a7e311cf37a039e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d7fcab5d3f465793d650f16c6ea8de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:46:14.421556 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-d558f26d-ed45-4439-a35c-fa5bc2eb7935 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96" status: 200 len: 1555 microversion: 2.1 time: 0.144895 Oct 27 15:46:14.422124 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 269/620] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:46:14 2021] GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96 => generated 1555 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 15:46:15.067606 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-3a1973db-7808-4e1d-94bf-7fdca37328c0 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:46:15.068369 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-3a1973db-7808-4e1d-94bf-7fdca37328c0 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:46:15.075614 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-3a1973db-7808-4e1d-94bf-7fdca37328c0 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:46:15.076346 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-3a1973db-7808-4e1d-94bf-7fdca37328c0 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:46:15.077122 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-3a1973db-7808-4e1d-94bf-7fdca37328c0 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:46:15.077611 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-3a1973db-7808-4e1d-94bf-7fdca37328c0 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:46:15.210072 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-3a1973db-7808-4e1d-94bf-7fdca37328c0 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:46:15.219087 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-3a1973db-7808-4e1d-94bf-7fdca37328c0 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:46:15.220629 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-3a1973db-7808-4e1d-94bf-7fdca37328c0 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:46:15.221588 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-c2d2f7dc-6894-4f3b-96ec-46a9853fe646 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:46:15.222059 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-3a1973db-7808-4e1d-94bf-7fdca37328c0 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672" status: 200 len: 1754 microversion: 2.20 time: 0.159192 Oct 27 15:46:15.222193 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-c2d2f7dc-6894-4f3b-96ec-46a9853fe646 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] [instance: a79303e6-05ad-4901-96b7-ce845b4016f4] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:46:15.222374 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 352/621] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Oct 27 15:46:15 2021] GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672 => generated 1754 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 15:46:15.229726 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-c2d2f7dc-6894-4f3b-96ec-46a9853fe646 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:46:15.230162 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-c2d2f7dc-6894-4f3b-96ec-46a9853fe646 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:46:15.230927 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-c2d2f7dc-6894-4f3b-96ec-46a9853fe646 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:46:15.231348 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-c2d2f7dc-6894-4f3b-96ec-46a9853fe646 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:46:15.353869 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-c2d2f7dc-6894-4f3b-96ec-46a9853fe646 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c757a383a434a4c9b1b928087af8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8818377e744d4f6ba65560705c191f0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:46:15.360985 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-c2d2f7dc-6894-4f3b-96ec-46a9853fe646 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] 10.222.0.64 "GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4" status: 200 len: 1266 microversion: 2.1 time: 0.143060 Oct 27 15:46:15.361536 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 270/622] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:46:15 2021] GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4 => generated 1266 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 15:46:15.439043 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-17ed7e64-ea17-40bd-8dd9-e1b14d463e8f tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:46:15.439654 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-17ed7e64-ea17-40bd-8dd9-e1b14d463e8f tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: 62c89161-c119-48b2-839d-712db798ff96] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:46:15.446396 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-17ed7e64-ea17-40bd-8dd9-e1b14d463e8f tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:46:15.446842 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-17ed7e64-ea17-40bd-8dd9-e1b14d463e8f tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:46:15.447603 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-17ed7e64-ea17-40bd-8dd9-e1b14d463e8f tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:46:15.448072 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-17ed7e64-ea17-40bd-8dd9-e1b14d463e8f tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:46:15.568237 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-17ed7e64-ea17-40bd-8dd9-e1b14d463e8f tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96b599f8890b4281a7e311cf37a039e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d7fcab5d3f465793d650f16c6ea8de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:46:15.576415 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-17ed7e64-ea17-40bd-8dd9-e1b14d463e8f tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96" status: 200 len: 1555 microversion: 2.1 time: 0.140968 Oct 27 15:46:15.576975 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 353/623] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:46:15 2021] GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96 => generated 1555 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 15:46:16.240763 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-a56c75a4-836f-4c28-be35-087e56fd4581 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:46:16.241367 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-a56c75a4-836f-4c28-be35-087e56fd4581 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:46:16.247718 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-a56c75a4-836f-4c28-be35-087e56fd4581 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:46:16.248193 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-a56c75a4-836f-4c28-be35-087e56fd4581 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:46:16.248985 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-a56c75a4-836f-4c28-be35-087e56fd4581 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:46:16.249416 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-a56c75a4-836f-4c28-be35-087e56fd4581 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:46:16.371333 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-a56c75a4-836f-4c28-be35-087e56fd4581 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:46:16.378618 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-43c8728b-8bd4-4130-a03b-1f2a04f54add tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:46:16.380605 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-a56c75a4-836f-4c28-be35-087e56fd4581 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:46:16.380832 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-43c8728b-8bd4-4130-a03b-1f2a04f54add tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] [instance: a79303e6-05ad-4901-96b7-ce845b4016f4] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:46:16.382124 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-a56c75a4-836f-4c28-be35-087e56fd4581 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:46:16.383283 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-a56c75a4-836f-4c28-be35-087e56fd4581 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672" status: 200 len: 1754 microversion: 2.20 time: 0.146290 Oct 27 15:46:16.383837 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 271/624] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Oct 27 15:46:16 2021] GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672 => generated 1754 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 15:46:16.387831 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-43c8728b-8bd4-4130-a03b-1f2a04f54add tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:46:16.388307 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-43c8728b-8bd4-4130-a03b-1f2a04f54add tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:46:16.389176 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-43c8728b-8bd4-4130-a03b-1f2a04f54add tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:46:16.389610 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-43c8728b-8bd4-4130-a03b-1f2a04f54add tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:46:16.515762 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-43c8728b-8bd4-4130-a03b-1f2a04f54add tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c757a383a434a4c9b1b928087af8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8818377e744d4f6ba65560705c191f0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:46:16.523351 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-43c8728b-8bd4-4130-a03b-1f2a04f54add tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] 10.222.0.64 "GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4" status: 200 len: 1266 microversion: 2.1 time: 0.149447 Oct 27 15:46:16.523936 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 354/625] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:46:16 2021] GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4 => generated 1266 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 15:46:16.593967 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-04830c99-0170-4d0b-8224-a587bec6869c tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:46:16.594651 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-04830c99-0170-4d0b-8224-a587bec6869c tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: 62c89161-c119-48b2-839d-712db798ff96] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:46:16.600850 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-04830c99-0170-4d0b-8224-a587bec6869c tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:46:16.601295 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-04830c99-0170-4d0b-8224-a587bec6869c tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:46:16.602068 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-04830c99-0170-4d0b-8224-a587bec6869c tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:46:16.602504 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-04830c99-0170-4d0b-8224-a587bec6869c tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:46:16.730473 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-04830c99-0170-4d0b-8224-a587bec6869c tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96b599f8890b4281a7e311cf37a039e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d7fcab5d3f465793d650f16c6ea8de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:46:16.738173 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-04830c99-0170-4d0b-8224-a587bec6869c tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96" status: 200 len: 1561 microversion: 2.1 time: 0.147927 Oct 27 15:46:16.738773 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 272/626] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:46:16 2021] GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96 => generated 1561 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 15:46:16.803148 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-33eed238-3259-4cbc-8f34-f2385482039a tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:46:16.803622 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-33eed238-3259-4cbc-8f34-f2385482039a tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: 62c89161-c119-48b2-839d-712db798ff96] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:46:16.809463 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-33eed238-3259-4cbc-8f34-f2385482039a tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:46:16.809908 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-33eed238-3259-4cbc-8f34-f2385482039a tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:46:16.810697 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-33eed238-3259-4cbc-8f34-f2385482039a tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:46:16.811123 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-33eed238-3259-4cbc-8f34-f2385482039a tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:46:16.886608 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.objects.instance [None req-33eed238-3259-4cbc-8f34-f2385482039a tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lazy-loading 'services' on Instance uuid 62c89161-c119-48b2-839d-712db798ff96 {{(pid=122224) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 27 15:46:16.953956 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-33eed238-3259-4cbc-8f34-f2385482039a tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "DELETE /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments/1a159978-aec1-4494-8cf3-0edd45b0ae39" status: 202 len: 0 microversion: 2.1 time: 0.155039 Oct 27 15:46:16.954702 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 355/627] 10.222.0.64 () {58 vars in 1415 bytes} [Wed Oct 27 15:46:16 2021] DELETE /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments/1a159978-aec1-4494-8cf3-0edd45b0ae39 => generated 0 bytes in 157 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 15:46:16.964254 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-90d852ee-e8c1-46db-8c66-95d6c8a20a92 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:46:16.965303 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-90d852ee-e8c1-46db-8c66-95d6c8a20a92 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: 62c89161-c119-48b2-839d-712db798ff96] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:46:16.971168 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-90d852ee-e8c1-46db-8c66-95d6c8a20a92 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:46:16.971680 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-90d852ee-e8c1-46db-8c66-95d6c8a20a92 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:46:16.973094 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-90d852ee-e8c1-46db-8c66-95d6c8a20a92 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:46:16.973729 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-90d852ee-e8c1-46db-8c66-95d6c8a20a92 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:46:17.005586 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-90d852ee-e8c1-46db-8c66-95d6c8a20a92 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045846 Oct 27 15:46:17.006141 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 273/628] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Oct 27 15:46:16 2021] GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 15:46:17.402720 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-51a01849-72ea-4264-a25c-f9157d9a6227 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:46:17.403398 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-51a01849-72ea-4264-a25c-f9157d9a6227 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:46:17.409862 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-51a01849-72ea-4264-a25c-f9157d9a6227 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:46:17.411285 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-51a01849-72ea-4264-a25c-f9157d9a6227 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:46:17.412227 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-51a01849-72ea-4264-a25c-f9157d9a6227 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:46:17.412668 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-51a01849-72ea-4264-a25c-f9157d9a6227 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:46:17.533708 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-51a01849-72ea-4264-a25c-f9157d9a6227 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:46:17.539878 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-b0dd1360-7d07-44bc-a3fe-3cc140847fee tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:46:17.541129 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-b0dd1360-7d07-44bc-a3fe-3cc140847fee tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] [instance: a79303e6-05ad-4901-96b7-ce845b4016f4] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:46:17.542627 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-51a01849-72ea-4264-a25c-f9157d9a6227 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:46:17.544203 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-51a01849-72ea-4264-a25c-f9157d9a6227 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:46:17.545362 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-51a01849-72ea-4264-a25c-f9157d9a6227 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672" status: 200 len: 1754 microversion: 2.20 time: 0.146787 Oct 27 15:46:17.546115 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 356/629] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Oct 27 15:46:17 2021] GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672 => generated 1754 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 15:46:17.547460 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-b0dd1360-7d07-44bc-a3fe-3cc140847fee tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:46:17.548018 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-b0dd1360-7d07-44bc-a3fe-3cc140847fee tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:46:17.548791 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-b0dd1360-7d07-44bc-a3fe-3cc140847fee tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:46:17.549219 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-b0dd1360-7d07-44bc-a3fe-3cc140847fee tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:46:17.674355 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-b0dd1360-7d07-44bc-a3fe-3cc140847fee tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c757a383a434a4c9b1b928087af8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8818377e744d4f6ba65560705c191f0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:46:17.682242 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-b0dd1360-7d07-44bc-a3fe-3cc140847fee tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] 10.222.0.64 "GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4" status: 200 len: 1266 microversion: 2.1 time: 0.145964 Oct 27 15:46:17.682811 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 274/630] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:46:17 2021] GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4 => generated 1266 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 15:46:18.017205 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-c14052f0-c253-45b1-849a-d31f32d71822 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:46:18.018168 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-c14052f0-c253-45b1-849a-d31f32d71822 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: 62c89161-c119-48b2-839d-712db798ff96] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:46:18.024897 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-c14052f0-c253-45b1-849a-d31f32d71822 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:46:18.025341 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-c14052f0-c253-45b1-849a-d31f32d71822 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:46:18.026107 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-c14052f0-c253-45b1-849a-d31f32d71822 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:46:18.026545 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-c14052f0-c253-45b1-849a-d31f32d71822 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:46:18.055284 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-c14052f0-c253-45b1-849a-d31f32d71822 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042006 Oct 27 15:46:18.055822 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 357/631] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Oct 27 15:46:18 2021] GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 15:46:18.563581 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-e938c32b-7c5b-4691-84ee-ee697ccd094f tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:46:18.564139 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-e938c32b-7c5b-4691-84ee-ee697ccd094f tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:46:18.570546 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-e938c32b-7c5b-4691-84ee-ee697ccd094f tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:46:18.570989 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-e938c32b-7c5b-4691-84ee-ee697ccd094f tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:46:18.571754 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-e938c32b-7c5b-4691-84ee-ee697ccd094f tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:46:18.572213 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-e938c32b-7c5b-4691-84ee-ee697ccd094f tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:46:18.694532 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-e938c32b-7c5b-4691-84ee-ee697ccd094f tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:46:18.698133 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-1cd7660b-df8d-456b-a106-4ac6153b7496 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:46:18.698746 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-1cd7660b-df8d-456b-a106-4ac6153b7496 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] [instance: a79303e6-05ad-4901-96b7-ce845b4016f4] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:46:18.703055 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-e938c32b-7c5b-4691-84ee-ee697ccd094f tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:46:18.704586 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-e938c32b-7c5b-4691-84ee-ee697ccd094f tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:46:18.705201 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-1cd7660b-df8d-456b-a106-4ac6153b7496 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:46:18.705644 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-1cd7660b-df8d-456b-a106-4ac6153b7496 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:46:18.705762 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-e938c32b-7c5b-4691-84ee-ee697ccd094f tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672" status: 200 len: 1754 microversion: 2.20 time: 0.146276 Oct 27 15:46:18.706302 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 275/632] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Oct 27 15:46:18 2021] GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672 => generated 1754 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 15:46:18.706415 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-1cd7660b-df8d-456b-a106-4ac6153b7496 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:46:18.706841 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-1cd7660b-df8d-456b-a106-4ac6153b7496 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:46:18.826857 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-1cd7660b-df8d-456b-a106-4ac6153b7496 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c757a383a434a4c9b1b928087af8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8818377e744d4f6ba65560705c191f0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:46:18.834349 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-1cd7660b-df8d-456b-a106-4ac6153b7496 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] 10.222.0.64 "GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4" status: 200 len: 1266 microversion: 2.1 time: 0.139804 Oct 27 15:46:18.834910 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 358/633] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:46:18 2021] GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4 => generated 1266 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 15:46:19.067310 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-d725791b-6f5b-4762-8a1d-d7d9957449ba tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:46:19.068281 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-d725791b-6f5b-4762-8a1d-d7d9957449ba tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: 62c89161-c119-48b2-839d-712db798ff96] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:46:19.074169 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-d725791b-6f5b-4762-8a1d-d7d9957449ba tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:46:19.074660 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-d725791b-6f5b-4762-8a1d-d7d9957449ba tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:46:19.075378 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-d725791b-6f5b-4762-8a1d-d7d9957449ba tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:46:19.075806 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-d725791b-6f5b-4762-8a1d-d7d9957449ba tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:46:19.104807 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-d725791b-6f5b-4762-8a1d-d7d9957449ba tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041829 Oct 27 15:46:19.105367 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 276/634] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Oct 27 15:46:19 2021] GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 15:46:19.726315 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-cdba1282-c936-4b74-afb6-256a97db0270 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:46:19.726961 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-cdba1282-c936-4b74-afb6-256a97db0270 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:46:19.733523 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-cdba1282-c936-4b74-afb6-256a97db0270 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:46:19.733973 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-cdba1282-c936-4b74-afb6-256a97db0270 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:46:19.734764 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-cdba1282-c936-4b74-afb6-256a97db0270 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:46:19.735194 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-cdba1282-c936-4b74-afb6-256a97db0270 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:46:19.850895 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-23cb67df-51ff-4e6d-81d9-ce58e763a306 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:46:19.851506 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-23cb67df-51ff-4e6d-81d9-ce58e763a306 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] [instance: a79303e6-05ad-4901-96b7-ce845b4016f4] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:46:19.858036 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-23cb67df-51ff-4e6d-81d9-ce58e763a306 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:46:19.858497 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-23cb67df-51ff-4e6d-81d9-ce58e763a306 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:46:19.859303 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-23cb67df-51ff-4e6d-81d9-ce58e763a306 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:46:19.859736 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-23cb67df-51ff-4e6d-81d9-ce58e763a306 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:46:19.860137 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-cdba1282-c936-4b74-afb6-256a97db0270 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:46:19.868975 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-cdba1282-c936-4b74-afb6-256a97db0270 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:46:19.870478 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-cdba1282-c936-4b74-afb6-256a97db0270 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:46:19.871629 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-cdba1282-c936-4b74-afb6-256a97db0270 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672" status: 200 len: 1754 microversion: 2.20 time: 0.150539 Oct 27 15:46:19.872216 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 359/635] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Oct 27 15:46:19 2021] GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672 => generated 1754 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 15:46:19.986458 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-23cb67df-51ff-4e6d-81d9-ce58e763a306 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c757a383a434a4c9b1b928087af8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8818377e744d4f6ba65560705c191f0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:46:19.993950 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-23cb67df-51ff-4e6d-81d9-ce58e763a306 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] 10.222.0.64 "GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4" status: 200 len: 1266 microversion: 2.1 time: 0.147360 Oct 27 15:46:19.994512 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 277/636] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:46:19 2021] GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4 => generated 1266 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 15:46:20.116568 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-6b175e05-55f2-44fa-a9a0-ac211e35f98b tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:46:20.117525 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-6b175e05-55f2-44fa-a9a0-ac211e35f98b tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: 62c89161-c119-48b2-839d-712db798ff96] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:46:20.123532 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-6b175e05-55f2-44fa-a9a0-ac211e35f98b tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:46:20.124011 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-6b175e05-55f2-44fa-a9a0-ac211e35f98b tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:46:20.124777 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-6b175e05-55f2-44fa-a9a0-ac211e35f98b tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:46:20.125206 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-6b175e05-55f2-44fa-a9a0-ac211e35f98b tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:46:20.155090 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-6b175e05-55f2-44fa-a9a0-ac211e35f98b tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042558 Oct 27 15:46:20.155649 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 360/637] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Oct 27 15:46:20 2021] GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 15:46:20.890393 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-cdf48291-b55e-466d-a7a9-ba10c0d071e9 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:46:20.890987 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-cdf48291-b55e-466d-a7a9-ba10c0d071e9 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:46:20.897278 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-cdf48291-b55e-466d-a7a9-ba10c0d071e9 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:46:20.897725 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-cdf48291-b55e-466d-a7a9-ba10c0d071e9 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:46:20.898504 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-cdf48291-b55e-466d-a7a9-ba10c0d071e9 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:46:20.898939 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-cdf48291-b55e-466d-a7a9-ba10c0d071e9 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:46:21.010791 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-342f8fcb-75e6-4ed5-ad5a-394a092e8cba tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:46:21.011374 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-342f8fcb-75e6-4ed5-ad5a-394a092e8cba tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] [instance: a79303e6-05ad-4901-96b7-ce845b4016f4] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:46:21.017549 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-342f8fcb-75e6-4ed5-ad5a-394a092e8cba tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:46:21.017992 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-342f8fcb-75e6-4ed5-ad5a-394a092e8cba tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:46:21.018748 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-342f8fcb-75e6-4ed5-ad5a-394a092e8cba tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:46:21.019176 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-342f8fcb-75e6-4ed5-ad5a-394a092e8cba tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:46:21.022087 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-cdf48291-b55e-466d-a7a9-ba10c0d071e9 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:46:21.030105 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-cdf48291-b55e-466d-a7a9-ba10c0d071e9 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:46:21.031617 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-cdf48291-b55e-466d-a7a9-ba10c0d071e9 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:46:21.032780 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-cdf48291-b55e-466d-a7a9-ba10c0d071e9 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672" status: 200 len: 1754 microversion: 2.20 time: 0.146151 Oct 27 15:46:21.033323 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 278/638] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Oct 27 15:46:20 2021] GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672 => generated 1754 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 15:46:21.151981 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-342f8fcb-75e6-4ed5-ad5a-394a092e8cba tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c757a383a434a4c9b1b928087af8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8818377e744d4f6ba65560705c191f0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:46:21.159166 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-342f8fcb-75e6-4ed5-ad5a-394a092e8cba tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] 10.222.0.64 "GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4" status: 200 len: 1266 microversion: 2.1 time: 0.152042 Oct 27 15:46:21.159736 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 361/639] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:46:21 2021] GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4 => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 15:46:21.166906 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-aaa493e7-af92-4e11-9e2d-9dde7375e921 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:46:21.167803 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-aaa493e7-af92-4e11-9e2d-9dde7375e921 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: 62c89161-c119-48b2-839d-712db798ff96] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:46:21.173536 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-aaa493e7-af92-4e11-9e2d-9dde7375e921 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:46:21.173976 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-aaa493e7-af92-4e11-9e2d-9dde7375e921 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:46:21.174727 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-aaa493e7-af92-4e11-9e2d-9dde7375e921 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:46:21.175153 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-aaa493e7-af92-4e11-9e2d-9dde7375e921 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:46:21.204870 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-aaa493e7-af92-4e11-9e2d-9dde7375e921 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041659 Oct 27 15:46:21.205423 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 279/640] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Oct 27 15:46:21 2021] GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 15:46:22.051416 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-e547fb8b-99da-4cd8-8aab-e83164d7eedb tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:46:22.051954 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-e547fb8b-99da-4cd8-8aab-e83164d7eedb tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:46:22.057885 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-e547fb8b-99da-4cd8-8aab-e83164d7eedb tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:46:22.058322 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-e547fb8b-99da-4cd8-8aab-e83164d7eedb tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:46:22.059072 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-e547fb8b-99da-4cd8-8aab-e83164d7eedb tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:46:22.059498 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-e547fb8b-99da-4cd8-8aab-e83164d7eedb tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:46:22.175672 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-5c677bb1-1010-4981-90f6-fd167ad0b44b tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:46:22.176360 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-5c677bb1-1010-4981-90f6-fd167ad0b44b tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] [instance: a79303e6-05ad-4901-96b7-ce845b4016f4] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:46:22.180827 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-e547fb8b-99da-4cd8-8aab-e83164d7eedb tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:46:22.182545 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-5c677bb1-1010-4981-90f6-fd167ad0b44b tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:46:22.182983 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-5c677bb1-1010-4981-90f6-fd167ad0b44b tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:46:22.183740 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-5c677bb1-1010-4981-90f6-fd167ad0b44b tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:46:22.184195 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-5c677bb1-1010-4981-90f6-fd167ad0b44b tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:46:22.189108 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-e547fb8b-99da-4cd8-8aab-e83164d7eedb tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:46:22.190641 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-e547fb8b-99da-4cd8-8aab-e83164d7eedb tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:46:22.192694 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-e547fb8b-99da-4cd8-8aab-e83164d7eedb tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672" status: 200 len: 1754 microversion: 2.20 time: 0.145117 Oct 27 15:46:22.193258 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 362/641] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Oct 27 15:46:22 2021] GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672 => generated 1754 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 15:46:22.216723 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-4b3c3fbb-db09-4a82-981b-07884e8e00cb tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:46:22.217628 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-4b3c3fbb-db09-4a82-981b-07884e8e00cb tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: 62c89161-c119-48b2-839d-712db798ff96] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:46:22.223990 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-4b3c3fbb-db09-4a82-981b-07884e8e00cb tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:46:22.224436 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-4b3c3fbb-db09-4a82-981b-07884e8e00cb tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:46:22.225207 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-4b3c3fbb-db09-4a82-981b-07884e8e00cb tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:46:22.225637 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-4b3c3fbb-db09-4a82-981b-07884e8e00cb tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:46:22.254586 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-4b3c3fbb-db09-4a82-981b-07884e8e00cb tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041445 Oct 27 15:46:22.255241 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 363/642] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Oct 27 15:46:22 2021] GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 15:46:22.303837 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-5c677bb1-1010-4981-90f6-fd167ad0b44b tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c757a383a434a4c9b1b928087af8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8818377e744d4f6ba65560705c191f0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:46:22.310926 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-5c677bb1-1010-4981-90f6-fd167ad0b44b tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] 10.222.0.64 "GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4" status: 200 len: 1266 microversion: 2.1 time: 0.138883 Oct 27 15:46:22.311484 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 280/643] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:46:22 2021] GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4 => generated 1266 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 15:46:23.211183 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-d9874d08-1e4c-4221-8e68-1dc51b1ce2cd tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:46:23.211786 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-d9874d08-1e4c-4221-8e68-1dc51b1ce2cd tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:46:23.218020 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-d9874d08-1e4c-4221-8e68-1dc51b1ce2cd tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:46:23.218463 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-d9874d08-1e4c-4221-8e68-1dc51b1ce2cd tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:46:23.219231 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-d9874d08-1e4c-4221-8e68-1dc51b1ce2cd tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:46:23.219693 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-d9874d08-1e4c-4221-8e68-1dc51b1ce2cd tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:46:23.266099 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-fbcf96b8-d8dd-4d85-af7f-2403c2158fbf tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:46:23.267004 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-fbcf96b8-d8dd-4d85-af7f-2403c2158fbf tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: 62c89161-c119-48b2-839d-712db798ff96] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:46:23.274219 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-fbcf96b8-d8dd-4d85-af7f-2403c2158fbf tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:46:23.274664 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-fbcf96b8-d8dd-4d85-af7f-2403c2158fbf tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:46:23.275451 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-fbcf96b8-d8dd-4d85-af7f-2403c2158fbf tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:46:23.275911 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-fbcf96b8-d8dd-4d85-af7f-2403c2158fbf tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:46:23.306232 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-fbcf96b8-d8dd-4d85-af7f-2403c2158fbf tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043832 Oct 27 15:46:23.306806 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 281/644] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Oct 27 15:46:23 2021] GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 15:46:23.327338 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-a8a5288f-c261-4200-8589-192377c9adad tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:46:23.327968 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-a8a5288f-c261-4200-8589-192377c9adad tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] [instance: a79303e6-05ad-4901-96b7-ce845b4016f4] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:46:23.334271 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-a8a5288f-c261-4200-8589-192377c9adad tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:46:23.334716 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-a8a5288f-c261-4200-8589-192377c9adad tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:46:23.335485 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-a8a5288f-c261-4200-8589-192377c9adad tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:46:23.335945 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-a8a5288f-c261-4200-8589-192377c9adad tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:46:23.349422 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-d9874d08-1e4c-4221-8e68-1dc51b1ce2cd tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:46:23.358186 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-d9874d08-1e4c-4221-8e68-1dc51b1ce2cd tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:46:23.359730 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-d9874d08-1e4c-4221-8e68-1dc51b1ce2cd tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:46:23.360917 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-d9874d08-1e4c-4221-8e68-1dc51b1ce2cd tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672" status: 200 len: 1754 microversion: 2.20 time: 0.154165 Oct 27 15:46:23.361471 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 364/645] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Oct 27 15:46:23 2021] GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672 => generated 1754 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 15:46:23.465545 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-a8a5288f-c261-4200-8589-192377c9adad tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c757a383a434a4c9b1b928087af8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8818377e744d4f6ba65560705c191f0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:46:23.473789 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-a8a5288f-c261-4200-8589-192377c9adad tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] 10.222.0.64 "GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4" status: 200 len: 1266 microversion: 2.1 time: 0.149089 Oct 27 15:46:23.474559 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 282/646] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:46:23 2021] GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4 => generated 1266 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 15:46:24.317903 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-7245d50f-bf02-4533-8b63-aab0f24bdb55 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:46:24.318810 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-7245d50f-bf02-4533-8b63-aab0f24bdb55 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: 62c89161-c119-48b2-839d-712db798ff96] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:46:24.325136 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-7245d50f-bf02-4533-8b63-aab0f24bdb55 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:46:24.325580 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-7245d50f-bf02-4533-8b63-aab0f24bdb55 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:46:24.326347 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-7245d50f-bf02-4533-8b63-aab0f24bdb55 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:46:24.326777 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-7245d50f-bf02-4533-8b63-aab0f24bdb55 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:46:24.356554 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-7245d50f-bf02-4533-8b63-aab0f24bdb55 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043070 Oct 27 15:46:24.357118 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 365/647] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Oct 27 15:46:24 2021] GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 15:46:24.380067 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-ffe814ab-ad62-40c0-b174-4f4532f675d3 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:46:24.380671 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-ffe814ab-ad62-40c0-b174-4f4532f675d3 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:46:24.386904 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-ffe814ab-ad62-40c0-b174-4f4532f675d3 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:46:24.387287 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-ffe814ab-ad62-40c0-b174-4f4532f675d3 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:46:24.388090 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-ffe814ab-ad62-40c0-b174-4f4532f675d3 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:46:24.388540 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-ffe814ab-ad62-40c0-b174-4f4532f675d3 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:46:24.491102 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-592f2ef7-5e1f-4c4e-a5af-de656a4f0498 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:46:24.491733 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-592f2ef7-5e1f-4c4e-a5af-de656a4f0498 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] [instance: a79303e6-05ad-4901-96b7-ce845b4016f4] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:46:24.497968 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-592f2ef7-5e1f-4c4e-a5af-de656a4f0498 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:46:24.498396 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-592f2ef7-5e1f-4c4e-a5af-de656a4f0498 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:46:24.499172 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-592f2ef7-5e1f-4c4e-a5af-de656a4f0498 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:46:24.499605 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-592f2ef7-5e1f-4c4e-a5af-de656a4f0498 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:46:24.510867 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-ffe814ab-ad62-40c0-b174-4f4532f675d3 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:46:24.519008 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-ffe814ab-ad62-40c0-b174-4f4532f675d3 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:46:24.520699 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-ffe814ab-ad62-40c0-b174-4f4532f675d3 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:46:24.521894 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-ffe814ab-ad62-40c0-b174-4f4532f675d3 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672" status: 200 len: 1754 microversion: 2.20 time: 0.146143 Oct 27 15:46:24.522463 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 283/648] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Oct 27 15:46:24 2021] GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672 => generated 1754 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 15:46:24.625908 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-592f2ef7-5e1f-4c4e-a5af-de656a4f0498 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c757a383a434a4c9b1b928087af8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8818377e744d4f6ba65560705c191f0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:46:24.633969 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-592f2ef7-5e1f-4c4e-a5af-de656a4f0498 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] 10.222.0.64 "GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4" status: 200 len: 1266 microversion: 2.1 time: 0.147058 Oct 27 15:46:24.634571 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 366/649] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:46:24 2021] GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4 => generated 1266 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 15:46:25.368911 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-513a2dcd-d0f7-4477-87fc-5f08bb778b23 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:46:25.369807 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-513a2dcd-d0f7-4477-87fc-5f08bb778b23 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: 62c89161-c119-48b2-839d-712db798ff96] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:46:25.375624 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-513a2dcd-d0f7-4477-87fc-5f08bb778b23 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:46:25.376094 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-513a2dcd-d0f7-4477-87fc-5f08bb778b23 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:46:25.376844 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-513a2dcd-d0f7-4477-87fc-5f08bb778b23 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:46:25.377268 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-513a2dcd-d0f7-4477-87fc-5f08bb778b23 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:46:25.406231 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-513a2dcd-d0f7-4477-87fc-5f08bb778b23 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040996 Oct 27 15:46:25.406889 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 284/650] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Oct 27 15:46:25 2021] GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 15:46:25.540715 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-0224bb87-7e9f-4f8c-b283-7ec14169bc5f tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:46:25.550512 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-0224bb87-7e9f-4f8c-b283-7ec14169bc5f tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:46:25.550512 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-0224bb87-7e9f-4f8c-b283-7ec14169bc5f tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:46:25.550512 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-0224bb87-7e9f-4f8c-b283-7ec14169bc5f tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:46:25.550512 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-0224bb87-7e9f-4f8c-b283-7ec14169bc5f tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:46:25.551021 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-0224bb87-7e9f-4f8c-b283-7ec14169bc5f tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:46:25.650642 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-abbf3957-75b9-424e-843d-b9fdba44b360 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:46:25.651250 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-abbf3957-75b9-424e-843d-b9fdba44b360 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] [instance: a79303e6-05ad-4901-96b7-ce845b4016f4] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:46:25.656873 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-abbf3957-75b9-424e-843d-b9fdba44b360 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:46:25.657320 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-abbf3957-75b9-424e-843d-b9fdba44b360 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:46:25.658086 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-abbf3957-75b9-424e-843d-b9fdba44b360 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:46:25.658523 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-abbf3957-75b9-424e-843d-b9fdba44b360 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:46:25.669126 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-0224bb87-7e9f-4f8c-b283-7ec14169bc5f tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:46:25.677484 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-0224bb87-7e9f-4f8c-b283-7ec14169bc5f tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:46:25.678982 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-0224bb87-7e9f-4f8c-b283-7ec14169bc5f tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:46:25.680155 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-0224bb87-7e9f-4f8c-b283-7ec14169bc5f tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672" status: 200 len: 1754 microversion: 2.20 time: 0.143135 Oct 27 15:46:25.680719 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 367/651] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Oct 27 15:46:25 2021] GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672 => generated 1754 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 15:46:25.780518 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-abbf3957-75b9-424e-843d-b9fdba44b360 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c757a383a434a4c9b1b928087af8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8818377e744d4f6ba65560705c191f0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:46:25.788340 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-abbf3957-75b9-424e-843d-b9fdba44b360 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] 10.222.0.64 "GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4" status: 200 len: 1266 microversion: 2.1 time: 0.141320 Oct 27 15:46:25.788901 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 285/652] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:46:25 2021] GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4 => generated 1266 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 15:46:26.418294 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-8e7d82af-cd98-431c-8e93-915349ff0b85 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:46:26.419193 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-8e7d82af-cd98-431c-8e93-915349ff0b85 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: 62c89161-c119-48b2-839d-712db798ff96] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:46:26.425275 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-8e7d82af-cd98-431c-8e93-915349ff0b85 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:46:26.426247 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-8e7d82af-cd98-431c-8e93-915349ff0b85 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:46:26.427007 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-8e7d82af-cd98-431c-8e93-915349ff0b85 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:46:26.427428 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-8e7d82af-cd98-431c-8e93-915349ff0b85 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:46:26.456178 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-8e7d82af-cd98-431c-8e93-915349ff0b85 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041603 Oct 27 15:46:26.456729 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 368/653] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Oct 27 15:46:26 2021] GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 15:46:26.698579 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-94805810-8f49-4491-a9c1-8c48bec6eabe tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:46:26.699188 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-94805810-8f49-4491-a9c1-8c48bec6eabe tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:46:26.705419 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-94805810-8f49-4491-a9c1-8c48bec6eabe tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:46:26.705868 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-94805810-8f49-4491-a9c1-8c48bec6eabe tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:46:26.706643 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-94805810-8f49-4491-a9c1-8c48bec6eabe tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:46:26.707242 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-94805810-8f49-4491-a9c1-8c48bec6eabe tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:46:26.805531 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-fcb14b83-af3c-409d-9e7b-b62111d96de3 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:46:26.806125 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-fcb14b83-af3c-409d-9e7b-b62111d96de3 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] [instance: a79303e6-05ad-4901-96b7-ce845b4016f4] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:46:26.812967 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-fcb14b83-af3c-409d-9e7b-b62111d96de3 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:46:26.813402 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-fcb14b83-af3c-409d-9e7b-b62111d96de3 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:46:26.814166 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-fcb14b83-af3c-409d-9e7b-b62111d96de3 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:46:26.814617 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-fcb14b83-af3c-409d-9e7b-b62111d96de3 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:46:26.843333 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-94805810-8f49-4491-a9c1-8c48bec6eabe tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:46:26.856467 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-94805810-8f49-4491-a9c1-8c48bec6eabe tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:46:26.858103 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-94805810-8f49-4491-a9c1-8c48bec6eabe tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:46:26.859344 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-94805810-8f49-4491-a9c1-8c48bec6eabe tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672" status: 200 len: 1754 microversion: 2.20 time: 0.164638 Oct 27 15:46:26.860164 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 286/654] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Oct 27 15:46:26 2021] GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672 => generated 1754 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 15:46:26.961481 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-fcb14b83-af3c-409d-9e7b-b62111d96de3 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c757a383a434a4c9b1b928087af8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8818377e744d4f6ba65560705c191f0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:46:26.968928 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-fcb14b83-af3c-409d-9e7b-b62111d96de3 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] 10.222.0.64 "GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4" status: 200 len: 1266 microversion: 2.1 time: 0.167092 Oct 27 15:46:26.972044 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 369/655] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:46:26 2021] GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4 => generated 1266 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 15:46:27.468344 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-41f4b3b9-7fb9-4d4d-a967-a060a1b964e9 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:46:27.469246 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-41f4b3b9-7fb9-4d4d-a967-a060a1b964e9 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: 62c89161-c119-48b2-839d-712db798ff96] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:46:27.475706 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-41f4b3b9-7fb9-4d4d-a967-a060a1b964e9 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:46:27.476174 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-41f4b3b9-7fb9-4d4d-a967-a060a1b964e9 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:46:27.476932 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-41f4b3b9-7fb9-4d4d-a967-a060a1b964e9 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:46:27.477359 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-41f4b3b9-7fb9-4d4d-a967-a060a1b964e9 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:46:27.506128 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-41f4b3b9-7fb9-4d4d-a967-a060a1b964e9 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041500 Oct 27 15:46:27.506679 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 287/656] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Oct 27 15:46:27 2021] GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 15:46:27.878399 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-1489d87c-30f2-485c-a063-c1d06e9dc001 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:46:27.879959 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-1489d87c-30f2-485c-a063-c1d06e9dc001 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:46:27.886305 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-1489d87c-30f2-485c-a063-c1d06e9dc001 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:46:27.886751 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-1489d87c-30f2-485c-a063-c1d06e9dc001 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:46:27.887541 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-1489d87c-30f2-485c-a063-c1d06e9dc001 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:46:27.888012 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-1489d87c-30f2-485c-a063-c1d06e9dc001 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:46:27.986281 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-0cdf200e-8f18-4d50-aa09-70498acc6bda tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:46:27.986886 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-0cdf200e-8f18-4d50-aa09-70498acc6bda tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] [instance: a79303e6-05ad-4901-96b7-ce845b4016f4] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:46:27.993438 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-0cdf200e-8f18-4d50-aa09-70498acc6bda tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:46:27.993883 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-0cdf200e-8f18-4d50-aa09-70498acc6bda tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:46:27.994651 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-0cdf200e-8f18-4d50-aa09-70498acc6bda tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:46:27.995086 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-0cdf200e-8f18-4d50-aa09-70498acc6bda tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:46:28.009803 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-1489d87c-30f2-485c-a063-c1d06e9dc001 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:46:28.018096 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-1489d87c-30f2-485c-a063-c1d06e9dc001 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:46:28.020175 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-1489d87c-30f2-485c-a063-c1d06e9dc001 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:46:28.021350 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-1489d87c-30f2-485c-a063-c1d06e9dc001 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672" status: 200 len: 1754 microversion: 2.20 time: 0.146621 Oct 27 15:46:28.021913 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 370/657] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Oct 27 15:46:27 2021] GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672 => generated 1754 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 15:46:28.118170 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-0cdf200e-8f18-4d50-aa09-70498acc6bda tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c757a383a434a4c9b1b928087af8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8818377e744d4f6ba65560705c191f0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:46:28.127254 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-0cdf200e-8f18-4d50-aa09-70498acc6bda tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] 10.222.0.64 "GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4" status: 200 len: 1266 microversion: 2.1 time: 0.144596 Oct 27 15:46:28.127837 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 288/658] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:46:27 2021] GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4 => generated 1266 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 15:46:28.517641 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-b18627d9-3685-41f9-ade2-7768dbe8e4bf tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:46:28.518578 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-b18627d9-3685-41f9-ade2-7768dbe8e4bf tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: 62c89161-c119-48b2-839d-712db798ff96] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:46:28.524665 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-b18627d9-3685-41f9-ade2-7768dbe8e4bf tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:46:28.525111 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-b18627d9-3685-41f9-ade2-7768dbe8e4bf tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:46:28.525901 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-b18627d9-3685-41f9-ade2-7768dbe8e4bf tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:46:28.526332 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-b18627d9-3685-41f9-ade2-7768dbe8e4bf tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:46:28.555431 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-b18627d9-3685-41f9-ade2-7768dbe8e4bf tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041524 Oct 27 15:46:28.556019 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 371/659] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Oct 27 15:46:28 2021] GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 15:46:29.039661 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-8e3637ff-c718-49d5-a3a0-23b4c2533695 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:46:29.040287 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-8e3637ff-c718-49d5-a3a0-23b4c2533695 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:46:29.046368 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-8e3637ff-c718-49d5-a3a0-23b4c2533695 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:46:29.046803 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-8e3637ff-c718-49d5-a3a0-23b4c2533695 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:46:29.047558 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-8e3637ff-c718-49d5-a3a0-23b4c2533695 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:46:29.048026 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-8e3637ff-c718-49d5-a3a0-23b4c2533695 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:46:29.145225 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-94a170f0-9e54-468f-a8cb-d7b0925296c6 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:46:29.145862 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-94a170f0-9e54-468f-a8cb-d7b0925296c6 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] [instance: a79303e6-05ad-4901-96b7-ce845b4016f4] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:46:29.153317 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-94a170f0-9e54-468f-a8cb-d7b0925296c6 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:46:29.153769 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-94a170f0-9e54-468f-a8cb-d7b0925296c6 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:46:29.154553 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-94a170f0-9e54-468f-a8cb-d7b0925296c6 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:46:29.154989 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-94a170f0-9e54-468f-a8cb-d7b0925296c6 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:46:29.171110 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-8e3637ff-c718-49d5-a3a0-23b4c2533695 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:46:29.180068 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-8e3637ff-c718-49d5-a3a0-23b4c2533695 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:46:29.181571 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-8e3637ff-c718-49d5-a3a0-23b4c2533695 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:46:29.182724 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-8e3637ff-c718-49d5-a3a0-23b4c2533695 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672" status: 200 len: 1754 microversion: 2.20 time: 0.146870 Oct 27 15:46:29.183285 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 289/660] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Oct 27 15:46:29 2021] GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672 => generated 1754 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 15:46:29.275451 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-94a170f0-9e54-468f-a8cb-d7b0925296c6 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c757a383a434a4c9b1b928087af8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8818377e744d4f6ba65560705c191f0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:46:29.282608 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-94a170f0-9e54-468f-a8cb-d7b0925296c6 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] 10.222.0.64 "GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4" status: 200 len: 1266 microversion: 2.1 time: 0.141747 Oct 27 15:46:29.283163 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 372/661] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:46:29 2021] GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4 => generated 1266 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 15:46:29.566468 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-f9214a50-c23d-47e7-a51c-240fe8ed7db9 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:46:29.567385 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-f9214a50-c23d-47e7-a51c-240fe8ed7db9 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: 62c89161-c119-48b2-839d-712db798ff96] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:46:29.573257 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-f9214a50-c23d-47e7-a51c-240fe8ed7db9 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:46:29.573700 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-f9214a50-c23d-47e7-a51c-240fe8ed7db9 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:46:29.574462 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-f9214a50-c23d-47e7-a51c-240fe8ed7db9 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:46:29.574890 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-f9214a50-c23d-47e7-a51c-240fe8ed7db9 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:46:29.609086 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-f9214a50-c23d-47e7-a51c-240fe8ed7db9 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046697 Oct 27 15:46:29.609662 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 290/662] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Oct 27 15:46:29 2021] GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 15:46:30.201213 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-54c5f2ec-fb1d-4379-a08c-a8372082723e tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:46:30.201821 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-54c5f2ec-fb1d-4379-a08c-a8372082723e tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:46:30.208540 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-54c5f2ec-fb1d-4379-a08c-a8372082723e tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:46:30.208982 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-54c5f2ec-fb1d-4379-a08c-a8372082723e tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:46:30.209743 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-54c5f2ec-fb1d-4379-a08c-a8372082723e tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:46:30.210174 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-54c5f2ec-fb1d-4379-a08c-a8372082723e tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:46:30.298074 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-fd08e9b3-125e-4ca7-9cfc-0558db1fbca6 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:46:30.298668 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-fd08e9b3-125e-4ca7-9cfc-0558db1fbca6 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] [instance: a79303e6-05ad-4901-96b7-ce845b4016f4] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:46:30.305406 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-fd08e9b3-125e-4ca7-9cfc-0558db1fbca6 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:46:30.305846 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-fd08e9b3-125e-4ca7-9cfc-0558db1fbca6 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:46:30.306600 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-fd08e9b3-125e-4ca7-9cfc-0558db1fbca6 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:46:30.307027 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-fd08e9b3-125e-4ca7-9cfc-0558db1fbca6 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:46:30.333376 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-54c5f2ec-fb1d-4379-a08c-a8372082723e tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:46:30.341741 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-54c5f2ec-fb1d-4379-a08c-a8372082723e tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:46:30.343349 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-54c5f2ec-fb1d-4379-a08c-a8372082723e tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:46:30.344541 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-54c5f2ec-fb1d-4379-a08c-a8372082723e tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672" status: 200 len: 1754 microversion: 2.20 time: 0.147063 Oct 27 15:46:30.345101 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 373/663] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Oct 27 15:46:30 2021] GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672 => generated 1754 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 15:46:30.431111 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-fd08e9b3-125e-4ca7-9cfc-0558db1fbca6 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c757a383a434a4c9b1b928087af8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8818377e744d4f6ba65560705c191f0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:46:30.438331 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-fd08e9b3-125e-4ca7-9cfc-0558db1fbca6 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] 10.222.0.64 "GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4" status: 200 len: 1266 microversion: 2.1 time: 0.143821 Oct 27 15:46:30.438910 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 291/664] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:46:30 2021] GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4 => generated 1266 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 15:46:30.620520 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-7bb7c4ff-4cd4-40db-bc0d-e52151a26e17 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:46:30.621338 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-7bb7c4ff-4cd4-40db-bc0d-e52151a26e17 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: 62c89161-c119-48b2-839d-712db798ff96] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:46:30.627227 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-7bb7c4ff-4cd4-40db-bc0d-e52151a26e17 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:46:30.627669 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-7bb7c4ff-4cd4-40db-bc0d-e52151a26e17 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:46:30.629034 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-7bb7c4ff-4cd4-40db-bc0d-e52151a26e17 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:46:30.629649 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-7bb7c4ff-4cd4-40db-bc0d-e52151a26e17 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:46:30.658057 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-7bb7c4ff-4cd4-40db-bc0d-e52151a26e17 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041396 Oct 27 15:46:30.658602 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 374/665] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Oct 27 15:46:30 2021] GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 15:46:31.363070 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-0e23cdb2-f2c1-4610-85cb-977a745be9ef tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:46:31.363672 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-0e23cdb2-f2c1-4610-85cb-977a745be9ef tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:46:31.369846 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-0e23cdb2-f2c1-4610-85cb-977a745be9ef tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:46:31.370290 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-0e23cdb2-f2c1-4610-85cb-977a745be9ef tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:46:31.371054 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-0e23cdb2-f2c1-4610-85cb-977a745be9ef tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:46:31.371486 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-0e23cdb2-f2c1-4610-85cb-977a745be9ef tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:46:31.455878 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-5e90d373-0e0c-4217-a0e9-07e94c5485aa tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:46:31.456554 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-5e90d373-0e0c-4217-a0e9-07e94c5485aa tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] [instance: a79303e6-05ad-4901-96b7-ce845b4016f4] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:46:31.463295 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-5e90d373-0e0c-4217-a0e9-07e94c5485aa tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:46:31.463744 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-5e90d373-0e0c-4217-a0e9-07e94c5485aa tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:46:31.464563 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-5e90d373-0e0c-4217-a0e9-07e94c5485aa tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:46:31.464999 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-5e90d373-0e0c-4217-a0e9-07e94c5485aa tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:46:31.492639 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-0e23cdb2-f2c1-4610-85cb-977a745be9ef tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:46:31.500910 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-0e23cdb2-f2c1-4610-85cb-977a745be9ef tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:46:31.502412 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-0e23cdb2-f2c1-4610-85cb-977a745be9ef tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:46:31.503638 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-0e23cdb2-f2c1-4610-85cb-977a745be9ef tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672" status: 200 len: 1754 microversion: 2.20 time: 0.144377 Oct 27 15:46:31.504716 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 292/666] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Oct 27 15:46:31 2021] GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672 => generated 1754 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 15:46:31.584450 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-5e90d373-0e0c-4217-a0e9-07e94c5485aa tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c757a383a434a4c9b1b928087af8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8818377e744d4f6ba65560705c191f0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:46:31.591705 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-5e90d373-0e0c-4217-a0e9-07e94c5485aa tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] 10.222.0.64 "GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4" status: 200 len: 1266 microversion: 2.1 time: 0.139542 Oct 27 15:46:31.592300 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 375/667] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:46:31 2021] GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4 => generated 1266 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 15:46:31.669515 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-175dbb19-156f-40c1-aeca-42355e9336dc tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:46:31.670327 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-175dbb19-156f-40c1-aeca-42355e9336dc tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: 62c89161-c119-48b2-839d-712db798ff96] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:46:31.676700 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-175dbb19-156f-40c1-aeca-42355e9336dc tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:46:31.677139 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-175dbb19-156f-40c1-aeca-42355e9336dc tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:46:31.677895 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-175dbb19-156f-40c1-aeca-42355e9336dc tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:46:31.678322 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-175dbb19-156f-40c1-aeca-42355e9336dc tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:46:31.706662 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-175dbb19-156f-40c1-aeca-42355e9336dc tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040952 Oct 27 15:46:31.707204 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 293/668] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Oct 27 15:46:31 2021] GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 15:46:32.522335 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-a72a3a8a-9a29-4b8e-8c62-bc773f5c55e6 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:46:32.522934 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-a72a3a8a-9a29-4b8e-8c62-bc773f5c55e6 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:46:32.529050 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-a72a3a8a-9a29-4b8e-8c62-bc773f5c55e6 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:46:32.529489 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-a72a3a8a-9a29-4b8e-8c62-bc773f5c55e6 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:46:32.530242 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-a72a3a8a-9a29-4b8e-8c62-bc773f5c55e6 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:46:32.530671 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-a72a3a8a-9a29-4b8e-8c62-bc773f5c55e6 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:46:32.609203 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-78fd120b-1829-4694-abc5-378c64858032 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:46:32.609611 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-78fd120b-1829-4694-abc5-378c64858032 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] [instance: a79303e6-05ad-4901-96b7-ce845b4016f4] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:46:32.616087 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-78fd120b-1829-4694-abc5-378c64858032 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:46:32.616534 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-78fd120b-1829-4694-abc5-378c64858032 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:46:32.617313 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-78fd120b-1829-4694-abc5-378c64858032 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:46:32.617728 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-78fd120b-1829-4694-abc5-378c64858032 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:46:32.650571 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-a72a3a8a-9a29-4b8e-8c62-bc773f5c55e6 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:46:32.658696 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-a72a3a8a-9a29-4b8e-8c62-bc773f5c55e6 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:46:32.660241 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-a72a3a8a-9a29-4b8e-8c62-bc773f5c55e6 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:46:32.662173 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-a72a3a8a-9a29-4b8e-8c62-bc773f5c55e6 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672" status: 200 len: 1754 microversion: 2.20 time: 0.144138 Oct 27 15:46:32.662739 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 376/669] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Oct 27 15:46:32 2021] GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672 => generated 1754 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 15:46:32.717810 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-6d48299e-cc91-4932-873d-c95680c5d0a8 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:46:32.718718 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-6d48299e-cc91-4932-873d-c95680c5d0a8 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: 62c89161-c119-48b2-839d-712db798ff96] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:46:32.724814 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-6d48299e-cc91-4932-873d-c95680c5d0a8 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:46:32.725265 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-6d48299e-cc91-4932-873d-c95680c5d0a8 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:46:32.726035 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-6d48299e-cc91-4932-873d-c95680c5d0a8 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:46:32.726471 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-6d48299e-cc91-4932-873d-c95680c5d0a8 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:46:32.738883 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-78fd120b-1829-4694-abc5-378c64858032 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c757a383a434a4c9b1b928087af8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8818377e744d4f6ba65560705c191f0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:46:32.746133 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-78fd120b-1829-4694-abc5-378c64858032 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] 10.222.0.64 "GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4" status: 200 len: 1266 microversion: 2.1 time: 0.141179 Oct 27 15:46:32.746694 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 294/670] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:46:32 2021] GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4 => generated 1266 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 15:46:32.757099 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-6d48299e-cc91-4932-873d-c95680c5d0a8 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042953 Oct 27 15:46:32.757655 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 377/671] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Oct 27 15:46:32 2021] GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 15:46:33.680319 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-b46e7c79-e389-4443-9230-cc7cc5865683 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:46:33.680953 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-b46e7c79-e389-4443-9230-cc7cc5865683 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:46:33.687033 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-b46e7c79-e389-4443-9230-cc7cc5865683 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:46:33.687487 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-b46e7c79-e389-4443-9230-cc7cc5865683 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:46:33.688264 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-b46e7c79-e389-4443-9230-cc7cc5865683 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:46:33.688696 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-b46e7c79-e389-4443-9230-cc7cc5865683 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:46:33.762600 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-25ff8709-d10a-47a8-ba93-75abf91bb5ee tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:46:33.763943 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-25ff8709-d10a-47a8-ba93-75abf91bb5ee tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] [instance: a79303e6-05ad-4901-96b7-ce845b4016f4] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:46:33.770749 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-25ff8709-d10a-47a8-ba93-75abf91bb5ee tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:46:33.771357 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-25ff8709-d10a-47a8-ba93-75abf91bb5ee tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:46:33.772688 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-25ff8709-d10a-47a8-ba93-75abf91bb5ee tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:46:33.773184 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-25ff8709-d10a-47a8-ba93-75abf91bb5ee tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:46:33.814272 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-b46e7c79-e389-4443-9230-cc7cc5865683 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:46:33.822656 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-b46e7c79-e389-4443-9230-cc7cc5865683 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:46:33.824185 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-b46e7c79-e389-4443-9230-cc7cc5865683 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:46:33.825342 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-b46e7c79-e389-4443-9230-cc7cc5865683 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672" status: 200 len: 1754 microversion: 2.20 time: 0.148912 Oct 27 15:46:33.825894 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 295/672] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Oct 27 15:46:33 2021] GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672 => generated 1754 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 15:46:33.830236 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-854de2c5-4293-4116-8e32-e9d68723466c tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:46:33.831124 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-854de2c5-4293-4116-8e32-e9d68723466c tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: 62c89161-c119-48b2-839d-712db798ff96] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:46:33.837477 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-854de2c5-4293-4116-8e32-e9d68723466c tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:46:33.837921 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-854de2c5-4293-4116-8e32-e9d68723466c tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:46:33.838712 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-854de2c5-4293-4116-8e32-e9d68723466c tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:46:33.839142 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-854de2c5-4293-4116-8e32-e9d68723466c tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:46:33.872991 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-854de2c5-4293-4116-8e32-e9d68723466c tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046021 Oct 27 15:46:33.873564 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 296/673] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Oct 27 15:46:33 2021] GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 15:46:33.901644 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-25ff8709-d10a-47a8-ba93-75abf91bb5ee tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c757a383a434a4c9b1b928087af8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8818377e744d4f6ba65560705c191f0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:46:33.909337 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-25ff8709-d10a-47a8-ba93-75abf91bb5ee tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] 10.222.0.64 "GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4" status: 200 len: 1266 microversion: 2.1 time: 0.150367 Oct 27 15:46:33.909912 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 378/674] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:46:33 2021] GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4 => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 15:46:34.843978 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-ee0d635e-8ac4-4c6f-b765-74fe463f358e tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:46:34.844609 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-ee0d635e-8ac4-4c6f-b765-74fe463f358e tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:46:34.851272 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-ee0d635e-8ac4-4c6f-b765-74fe463f358e tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:46:34.851718 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-ee0d635e-8ac4-4c6f-b765-74fe463f358e tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:46:34.852515 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-ee0d635e-8ac4-4c6f-b765-74fe463f358e tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:46:34.852977 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-ee0d635e-8ac4-4c6f-b765-74fe463f358e tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:46:34.884931 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-e5ae0c4a-0d90-41aa-a75c-48c3b8b9eeb9 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:46:34.885935 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-e5ae0c4a-0d90-41aa-a75c-48c3b8b9eeb9 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: 62c89161-c119-48b2-839d-712db798ff96] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:46:34.892267 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-e5ae0c4a-0d90-41aa-a75c-48c3b8b9eeb9 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:46:34.892710 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-e5ae0c4a-0d90-41aa-a75c-48c3b8b9eeb9 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:46:34.893478 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-e5ae0c4a-0d90-41aa-a75c-48c3b8b9eeb9 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:46:34.893909 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-e5ae0c4a-0d90-41aa-a75c-48c3b8b9eeb9 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:46:34.924683 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-e5ae0c4a-0d90-41aa-a75c-48c3b8b9eeb9 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043976 Oct 27 15:46:34.925294 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 379/675] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Oct 27 15:46:34 2021] GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 15:46:34.930059 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-b31e4b98-6b10-45bf-a99b-2aa6561f9bfb tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:46:34.930674 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-b31e4b98-6b10-45bf-a99b-2aa6561f9bfb tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] [instance: a79303e6-05ad-4901-96b7-ce845b4016f4] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:46:34.936836 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-b31e4b98-6b10-45bf-a99b-2aa6561f9bfb tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:46:34.937279 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-b31e4b98-6b10-45bf-a99b-2aa6561f9bfb tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:46:34.938043 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-b31e4b98-6b10-45bf-a99b-2aa6561f9bfb tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:46:34.938504 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-b31e4b98-6b10-45bf-a99b-2aa6561f9bfb tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:46:34.977094 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-ee0d635e-8ac4-4c6f-b765-74fe463f358e tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:46:34.985341 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-ee0d635e-8ac4-4c6f-b765-74fe463f358e tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:46:34.986974 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-ee0d635e-8ac4-4c6f-b765-74fe463f358e tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:46:34.988161 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-ee0d635e-8ac4-4c6f-b765-74fe463f358e tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672" status: 200 len: 1754 microversion: 2.20 time: 0.147974 Oct 27 15:46:34.996620 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 297/676] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Oct 27 15:46:34 2021] GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672 => generated 1754 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 15:46:35.060239 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-b31e4b98-6b10-45bf-a99b-2aa6561f9bfb tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c757a383a434a4c9b1b928087af8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8818377e744d4f6ba65560705c191f0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:46:35.067342 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-b31e4b98-6b10-45bf-a99b-2aa6561f9bfb tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] 10.222.0.64 "GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4" status: 200 len: 1266 microversion: 2.1 time: 0.141124 Oct 27 15:46:35.067950 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 380/677] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:46:34 2021] GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4 => generated 1266 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 15:46:35.936272 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-20040691-17bc-4987-a711-aac389bfeb0a tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:46:35.937169 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-20040691-17bc-4987-a711-aac389bfeb0a tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: 62c89161-c119-48b2-839d-712db798ff96] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:46:35.943208 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-20040691-17bc-4987-a711-aac389bfeb0a tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:46:35.943641 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-20040691-17bc-4987-a711-aac389bfeb0a tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:46:35.945476 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-20040691-17bc-4987-a711-aac389bfeb0a tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:46:35.945903 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-20040691-17bc-4987-a711-aac389bfeb0a tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:46:35.974280 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-20040691-17bc-4987-a711-aac389bfeb0a tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041755 Oct 27 15:46:35.974830 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 298/678] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Oct 27 15:46:35 2021] GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 15:46:36.006323 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-4f5f9dde-9cf0-4109-bdb6-add9f3d3385b tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:46:36.006982 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-4f5f9dde-9cf0-4109-bdb6-add9f3d3385b tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:46:36.013067 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-4f5f9dde-9cf0-4109-bdb6-add9f3d3385b tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:46:36.013509 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-4f5f9dde-9cf0-4109-bdb6-add9f3d3385b tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:46:36.014277 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-4f5f9dde-9cf0-4109-bdb6-add9f3d3385b tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:46:36.014709 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-4f5f9dde-9cf0-4109-bdb6-add9f3d3385b tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:46:36.084198 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-55e2922a-9a03-47b5-a347-7bed353ca0b0 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:46:36.086044 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-55e2922a-9a03-47b5-a347-7bed353ca0b0 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] [instance: a79303e6-05ad-4901-96b7-ce845b4016f4] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:46:36.092113 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-55e2922a-9a03-47b5-a347-7bed353ca0b0 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:46:36.093179 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-55e2922a-9a03-47b5-a347-7bed353ca0b0 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:46:36.093346 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-55e2922a-9a03-47b5-a347-7bed353ca0b0 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:46:36.093780 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-55e2922a-9a03-47b5-a347-7bed353ca0b0 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:46:36.137911 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-4f5f9dde-9cf0-4109-bdb6-add9f3d3385b tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:46:36.147449 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-4f5f9dde-9cf0-4109-bdb6-add9f3d3385b tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:46:36.149201 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-4f5f9dde-9cf0-4109-bdb6-add9f3d3385b tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:46:36.150683 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-4f5f9dde-9cf0-4109-bdb6-add9f3d3385b tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672" status: 200 len: 1754 microversion: 2.20 time: 0.148359 Oct 27 15:46:36.151370 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 381/679] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Oct 27 15:46:36 2021] GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672 => generated 1754 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 15:46:36.218615 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-55e2922a-9a03-47b5-a347-7bed353ca0b0 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c757a383a434a4c9b1b928087af8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8818377e744d4f6ba65560705c191f0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:46:36.227107 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-55e2922a-9a03-47b5-a347-7bed353ca0b0 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] 10.222.0.64 "GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4" status: 200 len: 1266 microversion: 2.1 time: 0.146470 Oct 27 15:46:36.227675 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 299/680] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:46:36 2021] GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4 => generated 1266 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 15:46:36.986232 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-8fa33ca7-1ad2-47ed-931f-ae82cd3fe022 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:46:36.987127 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-8fa33ca7-1ad2-47ed-931f-ae82cd3fe022 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: 62c89161-c119-48b2-839d-712db798ff96] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:46:36.993345 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-8fa33ca7-1ad2-47ed-931f-ae82cd3fe022 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:46:36.993781 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-8fa33ca7-1ad2-47ed-931f-ae82cd3fe022 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:46:36.994537 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-8fa33ca7-1ad2-47ed-931f-ae82cd3fe022 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:46:36.994961 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-8fa33ca7-1ad2-47ed-931f-ae82cd3fe022 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:46:37.024156 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-8fa33ca7-1ad2-47ed-931f-ae82cd3fe022 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041649 Oct 27 15:46:37.024789 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 382/681] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Oct 27 15:46:36 2021] GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 15:46:37.168819 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-b3f952b2-ac92-4d72-b134-169414cdc79a tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:46:37.169468 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-b3f952b2-ac92-4d72-b134-169414cdc79a tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:46:37.175682 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-b3f952b2-ac92-4d72-b134-169414cdc79a tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:46:37.176163 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-b3f952b2-ac92-4d72-b134-169414cdc79a tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:46:37.176934 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-b3f952b2-ac92-4d72-b134-169414cdc79a tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:46:37.177364 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-b3f952b2-ac92-4d72-b134-169414cdc79a tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:46:37.245271 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-28bf726f-016e-49bf-8502-31a1d1e46519 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:46:37.245804 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-28bf726f-016e-49bf-8502-31a1d1e46519 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] [instance: a79303e6-05ad-4901-96b7-ce845b4016f4] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:46:37.251577 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-28bf726f-016e-49bf-8502-31a1d1e46519 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:46:37.252054 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-28bf726f-016e-49bf-8502-31a1d1e46519 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:46:37.252823 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-28bf726f-016e-49bf-8502-31a1d1e46519 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:46:37.253248 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-28bf726f-016e-49bf-8502-31a1d1e46519 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:46:37.315527 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-b3f952b2-ac92-4d72-b134-169414cdc79a tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:46:37.324960 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-b3f952b2-ac92-4d72-b134-169414cdc79a tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:46:37.326468 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-b3f952b2-ac92-4d72-b134-169414cdc79a tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:46:37.327636 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-b3f952b2-ac92-4d72-b134-169414cdc79a tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672" status: 200 len: 1754 microversion: 2.20 time: 0.162580 Oct 27 15:46:37.328221 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 300/682] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Oct 27 15:46:37 2021] GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672 => generated 1754 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 15:46:37.384550 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-28bf726f-016e-49bf-8502-31a1d1e46519 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c757a383a434a4c9b1b928087af8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8818377e744d4f6ba65560705c191f0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:46:37.391772 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-28bf726f-016e-49bf-8502-31a1d1e46519 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] 10.222.0.64 "GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4" status: 200 len: 1266 microversion: 2.1 time: 0.150248 Oct 27 15:46:37.392384 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 383/683] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:46:37 2021] GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4 => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 15:46:38.035409 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-b4458005-a5e5-4e83-b6aa-e99bc639134e tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:46:38.036354 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-b4458005-a5e5-4e83-b6aa-e99bc639134e tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: 62c89161-c119-48b2-839d-712db798ff96] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:46:38.042748 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-b4458005-a5e5-4e83-b6aa-e99bc639134e tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:46:38.043184 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-b4458005-a5e5-4e83-b6aa-e99bc639134e tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:46:38.043962 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-b4458005-a5e5-4e83-b6aa-e99bc639134e tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:46:38.044391 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-b4458005-a5e5-4e83-b6aa-e99bc639134e tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:46:38.072937 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-b4458005-a5e5-4e83-b6aa-e99bc639134e tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041287 Oct 27 15:46:38.073485 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 301/684] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Oct 27 15:46:38 2021] GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 15:46:38.346617 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-2a434243-755b-4f12-9889-94000eb520fb tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:46:38.347588 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-2a434243-755b-4f12-9889-94000eb520fb tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:46:38.354778 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-2a434243-755b-4f12-9889-94000eb520fb tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:46:38.355226 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-2a434243-755b-4f12-9889-94000eb520fb tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:46:38.356043 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-2a434243-755b-4f12-9889-94000eb520fb tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:46:38.356482 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-2a434243-755b-4f12-9889-94000eb520fb tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:46:38.411580 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-3208e4a7-1b91-4cb2-8b19-231dd31adb76 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:46:38.412211 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-3208e4a7-1b91-4cb2-8b19-231dd31adb76 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] [instance: a79303e6-05ad-4901-96b7-ce845b4016f4] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:46:38.418916 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-3208e4a7-1b91-4cb2-8b19-231dd31adb76 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:46:38.419362 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-3208e4a7-1b91-4cb2-8b19-231dd31adb76 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:46:38.420157 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-3208e4a7-1b91-4cb2-8b19-231dd31adb76 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:46:38.420588 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-3208e4a7-1b91-4cb2-8b19-231dd31adb76 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:46:38.481975 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-2a434243-755b-4f12-9889-94000eb520fb tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:46:38.487599 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-2a434243-755b-4f12-9889-94000eb520fb tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:46:38.489217 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-2a434243-755b-4f12-9889-94000eb520fb tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:46:38.490470 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-2a434243-755b-4f12-9889-94000eb520fb tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672" status: 200 len: 1754 microversion: 2.20 time: 0.147966 Oct 27 15:46:38.491443 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 384/685] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Oct 27 15:46:38 2021] GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672 => generated 1754 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 15:46:38.545381 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-3208e4a7-1b91-4cb2-8b19-231dd31adb76 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c757a383a434a4c9b1b928087af8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8818377e744d4f6ba65560705c191f0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:46:38.552627 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-3208e4a7-1b91-4cb2-8b19-231dd31adb76 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] 10.222.0.64 "GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4" status: 200 len: 1266 microversion: 2.1 time: 0.144720 Oct 27 15:46:38.553185 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 302/686] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:46:38 2021] GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4 => generated 1266 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 15:46:39.084848 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-18efc83e-e904-4643-aaa4-170adb4ff467 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:46:39.085840 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-18efc83e-e904-4643-aaa4-170adb4ff467 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: 62c89161-c119-48b2-839d-712db798ff96] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:46:39.091814 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-18efc83e-e904-4643-aaa4-170adb4ff467 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:46:39.092301 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-18efc83e-e904-4643-aaa4-170adb4ff467 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:46:39.093075 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-18efc83e-e904-4643-aaa4-170adb4ff467 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:46:39.093535 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-18efc83e-e904-4643-aaa4-170adb4ff467 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:46:39.123103 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-18efc83e-e904-4643-aaa4-170adb4ff467 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042443 Oct 27 15:46:39.123745 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 385/687] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Oct 27 15:46:39 2021] GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 15:46:39.509261 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-54e20c73-4c3a-4d3f-93ac-9b2cb518ef75 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:46:39.509868 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-54e20c73-4c3a-4d3f-93ac-9b2cb518ef75 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:46:39.516122 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-54e20c73-4c3a-4d3f-93ac-9b2cb518ef75 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:46:39.516569 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-54e20c73-4c3a-4d3f-93ac-9b2cb518ef75 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:46:39.517333 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-54e20c73-4c3a-4d3f-93ac-9b2cb518ef75 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:46:39.517762 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-54e20c73-4c3a-4d3f-93ac-9b2cb518ef75 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:46:39.571317 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-f9d7bf1b-75db-4156-b5ea-3a91fbd65695 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:46:39.571971 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-f9d7bf1b-75db-4156-b5ea-3a91fbd65695 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] [instance: a79303e6-05ad-4901-96b7-ce845b4016f4] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:46:39.578530 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-f9d7bf1b-75db-4156-b5ea-3a91fbd65695 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:46:39.578975 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-f9d7bf1b-75db-4156-b5ea-3a91fbd65695 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:46:39.579749 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-f9d7bf1b-75db-4156-b5ea-3a91fbd65695 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:46:39.580235 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-f9d7bf1b-75db-4156-b5ea-3a91fbd65695 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:46:39.643041 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-54e20c73-4c3a-4d3f-93ac-9b2cb518ef75 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:46:39.651392 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-54e20c73-4c3a-4d3f-93ac-9b2cb518ef75 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:46:39.652916 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-54e20c73-4c3a-4d3f-93ac-9b2cb518ef75 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:46:39.654077 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-54e20c73-4c3a-4d3f-93ac-9b2cb518ef75 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672" status: 200 len: 1754 microversion: 2.20 time: 0.149118 Oct 27 15:46:39.654634 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 303/688] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Oct 27 15:46:39 2021] GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672 => generated 1754 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 15:46:39.701953 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-f9d7bf1b-75db-4156-b5ea-3a91fbd65695 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c757a383a434a4c9b1b928087af8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8818377e744d4f6ba65560705c191f0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:46:39.709083 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-f9d7bf1b-75db-4156-b5ea-3a91fbd65695 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] 10.222.0.64 "GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4" status: 200 len: 1266 microversion: 2.1 time: 0.142814 Oct 27 15:46:39.709742 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 386/689] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:46:39 2021] GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4 => generated 1266 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 15:46:40.134763 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-37f0b5c2-2558-46df-bcc7-468aa4e6c891 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:46:40.135691 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-37f0b5c2-2558-46df-bcc7-468aa4e6c891 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: 62c89161-c119-48b2-839d-712db798ff96] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:46:40.141829 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-37f0b5c2-2558-46df-bcc7-468aa4e6c891 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:46:40.142558 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-37f0b5c2-2558-46df-bcc7-468aa4e6c891 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:46:40.143046 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-37f0b5c2-2558-46df-bcc7-468aa4e6c891 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:46:40.143477 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-37f0b5c2-2558-46df-bcc7-468aa4e6c891 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:46:40.173462 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-37f0b5c2-2558-46df-bcc7-468aa4e6c891 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042351 Oct 27 15:46:40.173931 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 304/690] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Oct 27 15:46:40 2021] GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 15:46:40.673308 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-174833d9-3372-49b6-b2ab-3e50ca50e379 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:46:40.673908 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-174833d9-3372-49b6-b2ab-3e50ca50e379 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:46:40.680232 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-174833d9-3372-49b6-b2ab-3e50ca50e379 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:46:40.680676 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-174833d9-3372-49b6-b2ab-3e50ca50e379 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:46:40.681470 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-174833d9-3372-49b6-b2ab-3e50ca50e379 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:46:40.681897 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-174833d9-3372-49b6-b2ab-3e50ca50e379 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:46:40.726263 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-4b2d091a-b001-413d-bf1a-ae987e5cedb5 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:46:40.726857 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-4b2d091a-b001-413d-bf1a-ae987e5cedb5 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] [instance: a79303e6-05ad-4901-96b7-ce845b4016f4] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:46:40.732912 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-4b2d091a-b001-413d-bf1a-ae987e5cedb5 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:46:40.733352 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-4b2d091a-b001-413d-bf1a-ae987e5cedb5 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:46:40.734103 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-4b2d091a-b001-413d-bf1a-ae987e5cedb5 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:46:40.734524 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-4b2d091a-b001-413d-bf1a-ae987e5cedb5 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:46:40.811247 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-174833d9-3372-49b6-b2ab-3e50ca50e379 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:46:40.819982 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-174833d9-3372-49b6-b2ab-3e50ca50e379 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:46:40.821506 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-174833d9-3372-49b6-b2ab-3e50ca50e379 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:46:40.822649 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-174833d9-3372-49b6-b2ab-3e50ca50e379 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672" status: 200 len: 1754 microversion: 2.20 time: 0.153344 Oct 27 15:46:40.823201 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 387/691] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Oct 27 15:46:40 2021] GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672 => generated 1754 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 15:46:40.856702 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-4b2d091a-b001-413d-bf1a-ae987e5cedb5 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c757a383a434a4c9b1b928087af8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8818377e744d4f6ba65560705c191f0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:46:40.864515 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-4b2d091a-b001-413d-bf1a-ae987e5cedb5 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] 10.222.0.64 "GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4" status: 200 len: 1266 microversion: 2.1 time: 0.142805 Oct 27 15:46:40.865082 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 305/692] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:46:40 2021] GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4 => generated 1266 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 15:46:41.185668 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-0b2ddfbf-0dcd-47e2-bacb-59c6ae19b3fb tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:46:41.186763 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-0b2ddfbf-0dcd-47e2-bacb-59c6ae19b3fb tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: 62c89161-c119-48b2-839d-712db798ff96] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:46:41.192724 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-0b2ddfbf-0dcd-47e2-bacb-59c6ae19b3fb tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:46:41.193164 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-0b2ddfbf-0dcd-47e2-bacb-59c6ae19b3fb tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:46:41.195162 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-0b2ddfbf-0dcd-47e2-bacb-59c6ae19b3fb tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:46:41.195601 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-0b2ddfbf-0dcd-47e2-bacb-59c6ae19b3fb tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:46:41.224676 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-0b2ddfbf-0dcd-47e2-bacb-59c6ae19b3fb tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043159 Oct 27 15:46:41.225399 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 388/693] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Oct 27 15:46:41 2021] GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 15:46:41.842179 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-60e130ea-4b01-4144-904e-b27a1b7bc618 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:46:41.842695 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-60e130ea-4b01-4144-904e-b27a1b7bc618 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:46:41.848710 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-60e130ea-4b01-4144-904e-b27a1b7bc618 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:46:41.849148 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-60e130ea-4b01-4144-904e-b27a1b7bc618 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:46:41.850390 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-60e130ea-4b01-4144-904e-b27a1b7bc618 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:46:41.850820 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-60e130ea-4b01-4144-904e-b27a1b7bc618 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:46:41.881384 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-d56eb484-c808-4571-9204-cdf4854dcc7c tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:46:41.882077 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-d56eb484-c808-4571-9204-cdf4854dcc7c tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] [instance: a79303e6-05ad-4901-96b7-ce845b4016f4] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:46:41.888756 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-d56eb484-c808-4571-9204-cdf4854dcc7c tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:46:41.889203 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-d56eb484-c808-4571-9204-cdf4854dcc7c tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:46:41.889976 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-d56eb484-c808-4571-9204-cdf4854dcc7c tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:46:41.890412 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-d56eb484-c808-4571-9204-cdf4854dcc7c tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:46:41.977340 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-60e130ea-4b01-4144-904e-b27a1b7bc618 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:46:41.985606 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-60e130ea-4b01-4144-904e-b27a1b7bc618 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:46:41.987092 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-60e130ea-4b01-4144-904e-b27a1b7bc618 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:46:41.988353 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-60e130ea-4b01-4144-904e-b27a1b7bc618 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672" status: 200 len: 1754 microversion: 2.20 time: 0.151449 Oct 27 15:46:41.988904 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 306/694] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Oct 27 15:46:41 2021] GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672 => generated 1754 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 15:46:42.012221 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-d56eb484-c808-4571-9204-cdf4854dcc7c tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c757a383a434a4c9b1b928087af8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8818377e744d4f6ba65560705c191f0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:46:42.019244 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-d56eb484-c808-4571-9204-cdf4854dcc7c tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] 10.222.0.64 "GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4" status: 200 len: 1266 microversion: 2.1 time: 0.141534 Oct 27 15:46:42.019796 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 389/695] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:46:41 2021] GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4 => generated 1266 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 15:46:42.236440 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-0dab6f1f-7cd2-4fb3-88ec-ed9a2e935b80 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:46:42.237334 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-0dab6f1f-7cd2-4fb3-88ec-ed9a2e935b80 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: 62c89161-c119-48b2-839d-712db798ff96] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:46:42.243186 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-0dab6f1f-7cd2-4fb3-88ec-ed9a2e935b80 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:46:42.243624 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-0dab6f1f-7cd2-4fb3-88ec-ed9a2e935b80 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:46:42.244403 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-0dab6f1f-7cd2-4fb3-88ec-ed9a2e935b80 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:46:42.244830 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-0dab6f1f-7cd2-4fb3-88ec-ed9a2e935b80 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:46:42.273748 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-0dab6f1f-7cd2-4fb3-88ec-ed9a2e935b80 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041310 Oct 27 15:46:42.274297 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 307/696] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Oct 27 15:46:42 2021] GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 15:46:43.006285 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-0681f9ba-1e6b-4a08-9c39-91e7a0b07e71 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:46:43.007041 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-0681f9ba-1e6b-4a08-9c39-91e7a0b07e71 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:46:43.013166 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-0681f9ba-1e6b-4a08-9c39-91e7a0b07e71 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:46:43.013608 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-0681f9ba-1e6b-4a08-9c39-91e7a0b07e71 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:46:43.014372 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-0681f9ba-1e6b-4a08-9c39-91e7a0b07e71 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:46:43.014805 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-0681f9ba-1e6b-4a08-9c39-91e7a0b07e71 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:46:43.038827 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-4faecaf1-5884-4c6c-a38d-31c895fee385 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:46:43.039547 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-4faecaf1-5884-4c6c-a38d-31c895fee385 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] [instance: a79303e6-05ad-4901-96b7-ce845b4016f4] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:46:43.045750 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-4faecaf1-5884-4c6c-a38d-31c895fee385 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:46:43.046264 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-4faecaf1-5884-4c6c-a38d-31c895fee385 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:46:43.047095 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-4faecaf1-5884-4c6c-a38d-31c895fee385 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:46:43.047607 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-4faecaf1-5884-4c6c-a38d-31c895fee385 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:46:43.135879 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-0681f9ba-1e6b-4a08-9c39-91e7a0b07e71 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:46:43.144362 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-0681f9ba-1e6b-4a08-9c39-91e7a0b07e71 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:46:43.145861 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-0681f9ba-1e6b-4a08-9c39-91e7a0b07e71 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:46:43.147323 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-0681f9ba-1e6b-4a08-9c39-91e7a0b07e71 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672" status: 200 len: 1754 microversion: 2.20 time: 0.144503 Oct 27 15:46:43.147713 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 390/697] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Oct 27 15:46:43 2021] GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672 => generated 1754 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 15:46:43.169710 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-4faecaf1-5884-4c6c-a38d-31c895fee385 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c757a383a434a4c9b1b928087af8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8818377e744d4f6ba65560705c191f0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:46:43.176763 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-4faecaf1-5884-4c6c-a38d-31c895fee385 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] 10.222.0.64 "GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4" status: 200 len: 1266 microversion: 2.1 time: 0.143240 Oct 27 15:46:43.177317 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 308/698] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:46:43 2021] GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4 => generated 1266 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 15:46:43.285100 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-c157ad4c-60a0-4311-891b-256f0ecf4949 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:46:43.286038 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-c157ad4c-60a0-4311-891b-256f0ecf4949 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: 62c89161-c119-48b2-839d-712db798ff96] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:46:43.292800 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-c157ad4c-60a0-4311-891b-256f0ecf4949 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:46:43.293266 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-c157ad4c-60a0-4311-891b-256f0ecf4949 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:46:43.294027 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-c157ad4c-60a0-4311-891b-256f0ecf4949 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:46:43.294455 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-c157ad4c-60a0-4311-891b-256f0ecf4949 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:46:43.323660 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-c157ad4c-60a0-4311-891b-256f0ecf4949 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042315 Oct 27 15:46:43.324239 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 391/699] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Oct 27 15:46:43 2021] GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 15:46:44.167184 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-b9a4243d-feca-4efb-b720-f034332b9e8a tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:46:44.167778 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-b9a4243d-feca-4efb-b720-f034332b9e8a tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:46:44.174387 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-b9a4243d-feca-4efb-b720-f034332b9e8a tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:46:44.174759 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-b9a4243d-feca-4efb-b720-f034332b9e8a tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:46:44.175510 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-b9a4243d-feca-4efb-b720-f034332b9e8a tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:46:44.175977 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-b9a4243d-feca-4efb-b720-f034332b9e8a tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:46:44.194882 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-8dbbbe46-d3aa-4103-b5e7-0dbafc544c4b tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:46:44.195490 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-8dbbbe46-d3aa-4103-b5e7-0dbafc544c4b tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] [instance: a79303e6-05ad-4901-96b7-ce845b4016f4] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:46:44.202987 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-8dbbbe46-d3aa-4103-b5e7-0dbafc544c4b tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:46:44.204590 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-8dbbbe46-d3aa-4103-b5e7-0dbafc544c4b tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:46:44.204590 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-8dbbbe46-d3aa-4103-b5e7-0dbafc544c4b tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:46:44.204793 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-8dbbbe46-d3aa-4103-b5e7-0dbafc544c4b tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:46:44.330445 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-b9a4243d-feca-4efb-b720-f034332b9e8a tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:46:44.339110 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-b9a4243d-feca-4efb-b720-f034332b9e8a tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:46:44.340641 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-b9a4243d-feca-4efb-b720-f034332b9e8a tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:46:44.341789 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-b9a4243d-feca-4efb-b720-f034332b9e8a tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672" status: 200 len: 1754 microversion: 2.20 time: 0.180593 Oct 27 15:46:44.342354 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 309/700] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Oct 27 15:46:44 2021] GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672 => generated 1754 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 15:46:44.347878 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-8739239d-378c-4b3e-8b0e-3ba62f92a355 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:46:44.348954 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-8739239d-378c-4b3e-8b0e-3ba62f92a355 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: 62c89161-c119-48b2-839d-712db798ff96] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:46:44.350014 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-8dbbbe46-d3aa-4103-b5e7-0dbafc544c4b tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c757a383a434a4c9b1b928087af8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8818377e744d4f6ba65560705c191f0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:46:44.359246 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-8dbbbe46-d3aa-4103-b5e7-0dbafc544c4b tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] 10.222.0.64 "GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4" status: 200 len: 1266 microversion: 2.1 time: 0.168853 Oct 27 15:46:44.359828 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 392/701] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:46:44 2021] GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4 => generated 1266 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 15:46:44.366288 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-8739239d-378c-4b3e-8b0e-3ba62f92a355 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:46:44.366764 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-8739239d-378c-4b3e-8b0e-3ba62f92a355 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:46:44.367538 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-8739239d-378c-4b3e-8b0e-3ba62f92a355 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:46:44.367994 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-8739239d-378c-4b3e-8b0e-3ba62f92a355 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:46:44.402276 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-8739239d-378c-4b3e-8b0e-3ba62f92a355 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058655 Oct 27 15:46:44.403243 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 310/702] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Oct 27 15:46:44 2021] GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 15:46:45.361510 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-76f0bb32-65ee-4712-a979-23aed2011417 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:46:45.362138 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-76f0bb32-65ee-4712-a979-23aed2011417 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:46:45.368402 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-76f0bb32-65ee-4712-a979-23aed2011417 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:46:45.368844 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-76f0bb32-65ee-4712-a979-23aed2011417 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:46:45.369606 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-76f0bb32-65ee-4712-a979-23aed2011417 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:46:45.370038 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-76f0bb32-65ee-4712-a979-23aed2011417 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:46:45.377960 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-3820cb71-eab8-45ec-bf85-d73bb30df8d3 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:46:45.378555 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-3820cb71-eab8-45ec-bf85-d73bb30df8d3 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] [instance: a79303e6-05ad-4901-96b7-ce845b4016f4] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:46:45.385619 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-3820cb71-eab8-45ec-bf85-d73bb30df8d3 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:46:45.386055 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-3820cb71-eab8-45ec-bf85-d73bb30df8d3 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:46:45.386807 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-3820cb71-eab8-45ec-bf85-d73bb30df8d3 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:46:45.387233 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-3820cb71-eab8-45ec-bf85-d73bb30df8d3 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:46:45.507438 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-76f0bb32-65ee-4712-a979-23aed2011417 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:46:45.510653 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-3820cb71-eab8-45ec-bf85-d73bb30df8d3 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c757a383a434a4c9b1b928087af8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8818377e744d4f6ba65560705c191f0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:46:45.516642 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-76f0bb32-65ee-4712-a979-23aed2011417 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:46:45.517742 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-3820cb71-eab8-45ec-bf85-d73bb30df8d3 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] 10.222.0.64 "GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4" status: 200 len: 1266 microversion: 2.1 time: 0.143486 Oct 27 15:46:45.518249 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-76f0bb32-65ee-4712-a979-23aed2011417 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:46:45.518453 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 311/703] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:46:45 2021] GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4 => generated 1266 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 15:46:45.519395 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-76f0bb32-65ee-4712-a979-23aed2011417 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672" status: 200 len: 1754 microversion: 2.20 time: 0.161643 Oct 27 15:46:45.520220 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 393/704] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Oct 27 15:46:45 2021] GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672 => generated 1754 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 15:46:45.523629 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-e52ff853-fe75-4f1a-a64d-10a2f3debbed tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:46:45.524666 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-e52ff853-fe75-4f1a-a64d-10a2f3debbed tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: 62c89161-c119-48b2-839d-712db798ff96] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:46:45.530192 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-e52ff853-fe75-4f1a-a64d-10a2f3debbed tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:46:45.530637 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-e52ff853-fe75-4f1a-a64d-10a2f3debbed tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:46:45.531397 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-e52ff853-fe75-4f1a-a64d-10a2f3debbed tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:46:45.531828 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-e52ff853-fe75-4f1a-a64d-10a2f3debbed tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:46:45.559840 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-e52ff853-fe75-4f1a-a64d-10a2f3debbed tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040575 Oct 27 15:46:45.560413 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 312/705] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Oct 27 15:46:45 2021] GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 15:46:46.534149 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-57a708b6-4e50-44b9-917c-9f43f000b374 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:46:46.534753 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-57a708b6-4e50-44b9-917c-9f43f000b374 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] [instance: a79303e6-05ad-4901-96b7-ce845b4016f4] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:46:46.539579 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-e4b1bd1e-ffdd-4529-8c6e-90e2bd067ccf tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:46:46.540344 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-e4b1bd1e-ffdd-4529-8c6e-90e2bd067ccf tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:46:46.541738 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-57a708b6-4e50-44b9-917c-9f43f000b374 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:46:46.542282 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-57a708b6-4e50-44b9-917c-9f43f000b374 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:46:46.543002 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-57a708b6-4e50-44b9-917c-9f43f000b374 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:46:46.543444 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-57a708b6-4e50-44b9-917c-9f43f000b374 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:46:46.546896 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-e4b1bd1e-ffdd-4529-8c6e-90e2bd067ccf tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:46:46.547415 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-e4b1bd1e-ffdd-4529-8c6e-90e2bd067ccf tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:46:46.548226 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-e4b1bd1e-ffdd-4529-8c6e-90e2bd067ccf tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:46:46.548654 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-e4b1bd1e-ffdd-4529-8c6e-90e2bd067ccf tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:46:46.665395 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-57a708b6-4e50-44b9-917c-9f43f000b374 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c757a383a434a4c9b1b928087af8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8818377e744d4f6ba65560705c191f0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:46:46.675765 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-e4b1bd1e-ffdd-4529-8c6e-90e2bd067ccf tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:46:46.677901 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-57a708b6-4e50-44b9-917c-9f43f000b374 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] 10.222.0.64 "GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4" status: 200 len: 1266 microversion: 2.1 time: 0.142519 Oct 27 15:46:46.679635 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 394/706] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:46:46 2021] GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4 => generated 1266 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 15:46:46.684065 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-888de374-1299-4c7b-8440-b608fdaf9d34 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:46:46.684954 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-888de374-1299-4c7b-8440-b608fdaf9d34 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: 62c89161-c119-48b2-839d-712db798ff96] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:46:46.691257 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-888de374-1299-4c7b-8440-b608fdaf9d34 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:46:46.691694 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-888de374-1299-4c7b-8440-b608fdaf9d34 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:46:46.692480 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-888de374-1299-4c7b-8440-b608fdaf9d34 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:46:46.692911 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-888de374-1299-4c7b-8440-b608fdaf9d34 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:46:46.699573 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-e4b1bd1e-ffdd-4529-8c6e-90e2bd067ccf tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:46:46.701497 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-e4b1bd1e-ffdd-4529-8c6e-90e2bd067ccf tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:46:46.702900 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-e4b1bd1e-ffdd-4529-8c6e-90e2bd067ccf tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672" status: 200 len: 1754 microversion: 2.20 time: 0.168756 Oct 27 15:46:46.710230 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 313/707] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Oct 27 15:46:46 2021] GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672 => generated 1754 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 15:46:46.726413 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-888de374-1299-4c7b-8440-b608fdaf9d34 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045858 Oct 27 15:46:46.726967 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 395/708] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Oct 27 15:46:46 2021] GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 15:46:47.695452 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-fdf34dd1-28fc-403c-a778-5bc17d51fc5a tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:46:47.697405 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-fdf34dd1-28fc-403c-a778-5bc17d51fc5a tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] [instance: a79303e6-05ad-4901-96b7-ce845b4016f4] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:46:47.704026 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-fdf34dd1-28fc-403c-a778-5bc17d51fc5a tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:46:47.704497 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-fdf34dd1-28fc-403c-a778-5bc17d51fc5a tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:46:47.705268 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-fdf34dd1-28fc-403c-a778-5bc17d51fc5a tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:46:47.705695 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-fdf34dd1-28fc-403c-a778-5bc17d51fc5a tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:46:47.721473 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-7a685c97-dcf0-4b6d-af9a-e6a8f63ee915 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:46:47.722470 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-7a685c97-dcf0-4b6d-af9a-e6a8f63ee915 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:46:47.729099 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-7a685c97-dcf0-4b6d-af9a-e6a8f63ee915 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:46:47.729547 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-7a685c97-dcf0-4b6d-af9a-e6a8f63ee915 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:46:47.730319 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-7a685c97-dcf0-4b6d-af9a-e6a8f63ee915 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:46:47.730750 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-7a685c97-dcf0-4b6d-af9a-e6a8f63ee915 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:46:47.831435 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-fdf34dd1-28fc-403c-a778-5bc17d51fc5a tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c757a383a434a4c9b1b928087af8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8818377e744d4f6ba65560705c191f0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:46:47.839644 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-fdf34dd1-28fc-403c-a778-5bc17d51fc5a tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] 10.222.0.64 "GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4" status: 200 len: 1266 microversion: 2.1 time: 0.148445 Oct 27 15:46:47.840267 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 314/709] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:46:47 2021] GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4 => generated 1266 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 15:46:47.844599 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-5080e3d0-9a29-4ffe-abf1-e286c3d654ca tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:46:47.845483 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-5080e3d0-9a29-4ffe-abf1-e286c3d654ca tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: 62c89161-c119-48b2-839d-712db798ff96] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:46:47.851704 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-5080e3d0-9a29-4ffe-abf1-e286c3d654ca tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:46:47.852168 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-5080e3d0-9a29-4ffe-abf1-e286c3d654ca tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:46:47.852926 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-5080e3d0-9a29-4ffe-abf1-e286c3d654ca tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:46:47.853349 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-5080e3d0-9a29-4ffe-abf1-e286c3d654ca tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:46:47.874774 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-7a685c97-dcf0-4b6d-af9a-e6a8f63ee915 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:46:47.883621 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-7a685c97-dcf0-4b6d-af9a-e6a8f63ee915 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:46:47.884258 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-5080e3d0-9a29-4ffe-abf1-e286c3d654ca tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042957 Oct 27 15:46:47.887980 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 315/710] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Oct 27 15:46:47 2021] GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 15:46:47.888116 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-7a685c97-dcf0-4b6d-af9a-e6a8f63ee915 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:46:47.888116 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-7a685c97-dcf0-4b6d-af9a-e6a8f63ee915 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672" status: 200 len: 1754 microversion: 2.20 time: 0.168868 Oct 27 15:46:47.888116 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 396/711] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Oct 27 15:46:47 2021] GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672 => generated 1754 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 15:46:48.857294 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-2a60979f-dcd2-40a6-91b5-87175388df97 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:46:48.857876 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-2a60979f-dcd2-40a6-91b5-87175388df97 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] [instance: a79303e6-05ad-4901-96b7-ce845b4016f4] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:46:48.864016 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-2a60979f-dcd2-40a6-91b5-87175388df97 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:46:48.864459 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-2a60979f-dcd2-40a6-91b5-87175388df97 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:46:48.865233 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-2a60979f-dcd2-40a6-91b5-87175388df97 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:46:48.865985 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-2a60979f-dcd2-40a6-91b5-87175388df97 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:46:48.898657 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-81ed00eb-4962-49f9-b899-3353f45f3a2f tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:46:48.900444 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-81ed00eb-4962-49f9-b899-3353f45f3a2f tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: 62c89161-c119-48b2-839d-712db798ff96] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:46:48.907796 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-81ed00eb-4962-49f9-b899-3353f45f3a2f tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:46:48.908598 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-81ed00eb-4962-49f9-b899-3353f45f3a2f tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:46:48.909830 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-81ed00eb-4962-49f9-b899-3353f45f3a2f tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:46:48.910467 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-81ed00eb-4962-49f9-b899-3353f45f3a2f tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:46:48.945783 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-81ed00eb-4962-49f9-b899-3353f45f3a2f tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053042 Oct 27 15:46:48.946572 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 397/712] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Oct 27 15:46:48 2021] GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 15:46:48.953291 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-667cb721-55f5-4581-8b35-c600b122ed9d tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:46:48.953886 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-667cb721-55f5-4581-8b35-c600b122ed9d tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:46:48.959647 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-667cb721-55f5-4581-8b35-c600b122ed9d tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:46:48.960298 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-667cb721-55f5-4581-8b35-c600b122ed9d tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:46:48.961059 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-667cb721-55f5-4581-8b35-c600b122ed9d tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:46:48.961495 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-667cb721-55f5-4581-8b35-c600b122ed9d tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:46:48.997935 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-2a60979f-dcd2-40a6-91b5-87175388df97 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c757a383a434a4c9b1b928087af8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8818377e744d4f6ba65560705c191f0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:46:49.009857 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-2a60979f-dcd2-40a6-91b5-87175388df97 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] 10.222.0.64 "GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4" status: 200 len: 1266 microversion: 2.1 time: 0.156272 Oct 27 15:46:49.010868 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 316/713] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:46:48 2021] GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4 => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 15:46:49.094715 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-667cb721-55f5-4581-8b35-c600b122ed9d tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:46:49.104192 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-667cb721-55f5-4581-8b35-c600b122ed9d tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:46:49.105678 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-667cb721-55f5-4581-8b35-c600b122ed9d tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:46:49.106849 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-667cb721-55f5-4581-8b35-c600b122ed9d tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672" status: 200 len: 1754 microversion: 2.20 time: 0.159021 Oct 27 15:46:49.107448 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 398/714] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Oct 27 15:46:48 2021] GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672 => generated 1754 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 15:46:49.960968 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-bc22f389-b5fc-43d9-a162-82d4c6d8c7ce tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:46:49.961864 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-bc22f389-b5fc-43d9-a162-82d4c6d8c7ce tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: 62c89161-c119-48b2-839d-712db798ff96] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:46:49.968139 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-bc22f389-b5fc-43d9-a162-82d4c6d8c7ce tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:46:49.968584 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-bc22f389-b5fc-43d9-a162-82d4c6d8c7ce tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:46:49.969348 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-bc22f389-b5fc-43d9-a162-82d4c6d8c7ce tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:46:49.969775 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-bc22f389-b5fc-43d9-a162-82d4c6d8c7ce tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:46:49.999084 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-bc22f389-b5fc-43d9-a162-82d4c6d8c7ce tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042580 Oct 27 15:46:49.999630 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 317/715] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Oct 27 15:46:49 2021] GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 15:46:50.034405 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-f1700bc4-3733-436d-906c-d0fee9e228af tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:46:50.035007 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-f1700bc4-3733-436d-906c-d0fee9e228af tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] [instance: a79303e6-05ad-4901-96b7-ce845b4016f4] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:46:50.041458 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-f1700bc4-3733-436d-906c-d0fee9e228af tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:46:50.041902 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-f1700bc4-3733-436d-906c-d0fee9e228af tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:46:50.042662 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-f1700bc4-3733-436d-906c-d0fee9e228af tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:46:50.043094 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-f1700bc4-3733-436d-906c-d0fee9e228af tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:46:50.126196 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-4358ef14-e8a7-47e7-8049-dd18096bf586 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:46:50.126842 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-4358ef14-e8a7-47e7-8049-dd18096bf586 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:46:50.134030 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-4358ef14-e8a7-47e7-8049-dd18096bf586 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:46:50.134484 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-4358ef14-e8a7-47e7-8049-dd18096bf586 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:46:50.135253 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-4358ef14-e8a7-47e7-8049-dd18096bf586 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:46:50.135685 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-4358ef14-e8a7-47e7-8049-dd18096bf586 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:46:50.161967 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-f1700bc4-3733-436d-906c-d0fee9e228af tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c757a383a434a4c9b1b928087af8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8818377e744d4f6ba65560705c191f0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:46:50.169349 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-f1700bc4-3733-436d-906c-d0fee9e228af tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] 10.222.0.64 "GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4" status: 200 len: 1266 microversion: 2.1 time: 0.138480 Oct 27 15:46:50.169855 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 399/716] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:46:50 2021] GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4 => generated 1266 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 15:46:50.255637 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-4358ef14-e8a7-47e7-8049-dd18096bf586 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:46:50.264353 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-4358ef14-e8a7-47e7-8049-dd18096bf586 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:46:50.265853 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-4358ef14-e8a7-47e7-8049-dd18096bf586 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:46:50.266989 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-4358ef14-e8a7-47e7-8049-dd18096bf586 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672" status: 200 len: 1754 microversion: 2.20 time: 0.144677 Oct 27 15:46:50.267545 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 318/717] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Oct 27 15:46:50 2021] GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672 => generated 1754 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 15:46:51.010657 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-8fc59358-b109-42ce-913f-5e67523da097 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:46:51.011558 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-8fc59358-b109-42ce-913f-5e67523da097 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: 62c89161-c119-48b2-839d-712db798ff96] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:46:51.017365 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-8fc59358-b109-42ce-913f-5e67523da097 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:46:51.017809 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-8fc59358-b109-42ce-913f-5e67523da097 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:46:51.018569 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-8fc59358-b109-42ce-913f-5e67523da097 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:46:51.018998 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-8fc59358-b109-42ce-913f-5e67523da097 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:46:51.050045 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-8fc59358-b109-42ce-913f-5e67523da097 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043156 Oct 27 15:46:51.050716 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 400/718] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Oct 27 15:46:51 2021] GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 15:46:51.186781 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-bb2a7614-18aa-4781-8912-5f8fe4ff0f8a tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:46:51.187482 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-bb2a7614-18aa-4781-8912-5f8fe4ff0f8a tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] [instance: a79303e6-05ad-4901-96b7-ce845b4016f4] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:46:51.193791 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-bb2a7614-18aa-4781-8912-5f8fe4ff0f8a tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:46:51.194490 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-bb2a7614-18aa-4781-8912-5f8fe4ff0f8a tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:46:51.195300 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-bb2a7614-18aa-4781-8912-5f8fe4ff0f8a tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:46:51.195739 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-bb2a7614-18aa-4781-8912-5f8fe4ff0f8a tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:46:51.284872 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-9f1b0952-f809-42a9-a5c0-b2fc9b0d7f6e tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:46:51.285503 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-9f1b0952-f809-42a9-a5c0-b2fc9b0d7f6e tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:46:51.291876 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-9f1b0952-f809-42a9-a5c0-b2fc9b0d7f6e tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:46:51.292334 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-9f1b0952-f809-42a9-a5c0-b2fc9b0d7f6e tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:46:51.293108 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-9f1b0952-f809-42a9-a5c0-b2fc9b0d7f6e tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:46:51.293538 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-9f1b0952-f809-42a9-a5c0-b2fc9b0d7f6e tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:46:51.322443 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-bb2a7614-18aa-4781-8912-5f8fe4ff0f8a tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c757a383a434a4c9b1b928087af8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8818377e744d4f6ba65560705c191f0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:46:51.329919 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-bb2a7614-18aa-4781-8912-5f8fe4ff0f8a tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] 10.222.0.64 "GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4" status: 200 len: 1266 microversion: 2.1 time: 0.147054 Oct 27 15:46:51.330499 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 319/719] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:46:51 2021] GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4 => generated 1266 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 15:46:51.417025 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-9f1b0952-f809-42a9-a5c0-b2fc9b0d7f6e tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:46:51.425045 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-9f1b0952-f809-42a9-a5c0-b2fc9b0d7f6e tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:46:51.426546 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-9f1b0952-f809-42a9-a5c0-b2fc9b0d7f6e tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:46:51.427688 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-9f1b0952-f809-42a9-a5c0-b2fc9b0d7f6e tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672" status: 200 len: 1754 microversion: 2.20 time: 0.146539 Oct 27 15:46:51.428344 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 401/720] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Oct 27 15:46:51 2021] GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672 => generated 1754 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 15:46:52.061413 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-21f814bb-6528-4e1f-8ac0-c46330b444a2 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:46:52.062235 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-21f814bb-6528-4e1f-8ac0-c46330b444a2 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: 62c89161-c119-48b2-839d-712db798ff96] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:46:52.068043 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-21f814bb-6528-4e1f-8ac0-c46330b444a2 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:46:52.068486 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-21f814bb-6528-4e1f-8ac0-c46330b444a2 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:46:52.069362 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-21f814bb-6528-4e1f-8ac0-c46330b444a2 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:46:52.069796 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-21f814bb-6528-4e1f-8ac0-c46330b444a2 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:46:52.097034 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-21f814bb-6528-4e1f-8ac0-c46330b444a2 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039505 Oct 27 15:46:52.097824 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 320/721] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Oct 27 15:46:52 2021] GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 15:46:52.346928 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-87c9f9d1-4bc0-4224-ba99-f201222e686d tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:46:52.347709 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-87c9f9d1-4bc0-4224-ba99-f201222e686d tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] [instance: a79303e6-05ad-4901-96b7-ce845b4016f4] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:46:52.354186 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-87c9f9d1-4bc0-4224-ba99-f201222e686d tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:46:52.354635 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-87c9f9d1-4bc0-4224-ba99-f201222e686d tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:46:52.355403 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-87c9f9d1-4bc0-4224-ba99-f201222e686d tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:46:52.355840 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-87c9f9d1-4bc0-4224-ba99-f201222e686d tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:46:52.445999 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-6fff3b0e-1279-4559-ba9d-c8a0f86fb618 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:46:52.446598 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-6fff3b0e-1279-4559-ba9d-c8a0f86fb618 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:46:52.454152 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-6fff3b0e-1279-4559-ba9d-c8a0f86fb618 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:46:52.454594 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-6fff3b0e-1279-4559-ba9d-c8a0f86fb618 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:46:52.455357 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-6fff3b0e-1279-4559-ba9d-c8a0f86fb618 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:46:52.455782 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-6fff3b0e-1279-4559-ba9d-c8a0f86fb618 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:46:52.477530 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-87c9f9d1-4bc0-4224-ba99-f201222e686d tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c757a383a434a4c9b1b928087af8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8818377e744d4f6ba65560705c191f0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:46:52.484702 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-87c9f9d1-4bc0-4224-ba99-f201222e686d tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] 10.222.0.64 "GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4" status: 200 len: 1266 microversion: 2.1 time: 0.141690 Oct 27 15:46:52.485273 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 402/722] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:46:52 2021] GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4 => generated 1266 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 15:46:52.579075 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-6fff3b0e-1279-4559-ba9d-c8a0f86fb618 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:46:52.587712 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-6fff3b0e-1279-4559-ba9d-c8a0f86fb618 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:46:52.589247 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-6fff3b0e-1279-4559-ba9d-c8a0f86fb618 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:46:52.590397 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-6fff3b0e-1279-4559-ba9d-c8a0f86fb618 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672" status: 200 len: 1754 microversion: 2.20 time: 0.148114 Oct 27 15:46:52.590953 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 321/723] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Oct 27 15:46:52 2021] GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672 => generated 1754 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 15:46:53.109322 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-76f09274-97c1-4139-bec4-1739fc293f5c tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:46:53.110174 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-76f09274-97c1-4139-bec4-1739fc293f5c tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: 62c89161-c119-48b2-839d-712db798ff96] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:46:53.116129 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-76f09274-97c1-4139-bec4-1739fc293f5c tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:46:53.116571 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-76f09274-97c1-4139-bec4-1739fc293f5c tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:46:53.117328 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-76f09274-97c1-4139-bec4-1739fc293f5c tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:46:53.118579 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-76f09274-97c1-4139-bec4-1739fc293f5c tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:46:53.150241 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-76f09274-97c1-4139-bec4-1739fc293f5c tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044768 Oct 27 15:46:53.150804 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 403/724] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Oct 27 15:46:53 2021] GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 15:46:53.501620 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-7649ced8-7a96-44cb-b253-7a93540a67b9 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:46:53.502263 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-7649ced8-7a96-44cb-b253-7a93540a67b9 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] [instance: a79303e6-05ad-4901-96b7-ce845b4016f4] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:46:53.508446 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-7649ced8-7a96-44cb-b253-7a93540a67b9 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:46:53.508882 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-7649ced8-7a96-44cb-b253-7a93540a67b9 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:46:53.509640 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-7649ced8-7a96-44cb-b253-7a93540a67b9 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:46:53.510075 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-7649ced8-7a96-44cb-b253-7a93540a67b9 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:46:53.609111 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-24656ead-29e0-4ec4-8fd7-bcdf7f10bde1 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:46:53.609738 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-24656ead-29e0-4ec4-8fd7-bcdf7f10bde1 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:46:53.615938 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-24656ead-29e0-4ec4-8fd7-bcdf7f10bde1 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:46:53.616381 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-24656ead-29e0-4ec4-8fd7-bcdf7f10bde1 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:46:53.617153 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-24656ead-29e0-4ec4-8fd7-bcdf7f10bde1 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:46:53.618261 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-24656ead-29e0-4ec4-8fd7-bcdf7f10bde1 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:46:53.629075 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-7649ced8-7a96-44cb-b253-7a93540a67b9 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c757a383a434a4c9b1b928087af8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8818377e744d4f6ba65560705c191f0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:46:53.636725 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-7649ced8-7a96-44cb-b253-7a93540a67b9 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] 10.222.0.64 "GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4" status: 200 len: 1266 microversion: 2.1 time: 0.138714 Oct 27 15:46:53.637310 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 322/725] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:46:53 2021] GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4 => generated 1266 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 15:46:53.736493 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-24656ead-29e0-4ec4-8fd7-bcdf7f10bde1 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:46:53.745161 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-24656ead-29e0-4ec4-8fd7-bcdf7f10bde1 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:46:53.746664 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-24656ead-29e0-4ec4-8fd7-bcdf7f10bde1 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:46:53.747814 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-24656ead-29e0-4ec4-8fd7-bcdf7f10bde1 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672" status: 200 len: 1754 microversion: 2.20 time: 0.142469 Oct 27 15:46:53.748389 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 404/726] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Oct 27 15:46:53 2021] GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672 => generated 1754 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 15:46:54.161388 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-1a48ea60-25fd-4936-9d34-554e4ec9efb4 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:46:54.162291 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-1a48ea60-25fd-4936-9d34-554e4ec9efb4 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: 62c89161-c119-48b2-839d-712db798ff96] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:46:54.168722 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-1a48ea60-25fd-4936-9d34-554e4ec9efb4 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:46:54.169162 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-1a48ea60-25fd-4936-9d34-554e4ec9efb4 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:46:54.169917 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-1a48ea60-25fd-4936-9d34-554e4ec9efb4 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:46:54.170350 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-1a48ea60-25fd-4936-9d34-554e4ec9efb4 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:46:54.198605 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-1a48ea60-25fd-4936-9d34-554e4ec9efb4 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040948 Oct 27 15:46:54.199158 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 323/727] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Oct 27 15:46:54 2021] GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 15:46:54.653889 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-1b9434f3-1d55-4698-ad65-c10cd60e5420 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:46:54.654497 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-1b9434f3-1d55-4698-ad65-c10cd60e5420 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] [instance: a79303e6-05ad-4901-96b7-ce845b4016f4] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:46:54.660696 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-1b9434f3-1d55-4698-ad65-c10cd60e5420 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:46:54.661144 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-1b9434f3-1d55-4698-ad65-c10cd60e5420 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:46:54.661922 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-1b9434f3-1d55-4698-ad65-c10cd60e5420 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:46:54.662387 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-1b9434f3-1d55-4698-ad65-c10cd60e5420 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:46:54.766467 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-b728054c-9827-4755-927f-b2984467ad13 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:46:54.767136 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-b728054c-9827-4755-927f-b2984467ad13 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:46:54.774389 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-b728054c-9827-4755-927f-b2984467ad13 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:46:54.775489 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-b728054c-9827-4755-927f-b2984467ad13 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:46:54.776291 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-b728054c-9827-4755-927f-b2984467ad13 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:46:54.776727 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-b728054c-9827-4755-927f-b2984467ad13 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:46:54.785488 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-1b9434f3-1d55-4698-ad65-c10cd60e5420 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c757a383a434a4c9b1b928087af8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8818377e744d4f6ba65560705c191f0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:46:54.793554 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-1b9434f3-1d55-4698-ad65-c10cd60e5420 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] 10.222.0.64 "GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4" status: 200 len: 1266 microversion: 2.1 time: 0.143336 Oct 27 15:46:54.794127 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 405/728] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:46:54 2021] GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4 => generated 1266 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 15:46:54.902133 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-b728054c-9827-4755-927f-b2984467ad13 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:46:54.910471 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-b728054c-9827-4755-927f-b2984467ad13 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:46:54.911917 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-b728054c-9827-4755-927f-b2984467ad13 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:46:54.913063 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-b728054c-9827-4755-927f-b2984467ad13 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672" status: 200 len: 1754 microversion: 2.20 time: 0.150387 Oct 27 15:46:54.913624 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 324/729] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Oct 27 15:46:54 2021] GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672 => generated 1754 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 15:46:55.209996 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-a92058ea-026a-4f72-b251-a8cf95954609 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:46:55.210893 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-a92058ea-026a-4f72-b251-a8cf95954609 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: 62c89161-c119-48b2-839d-712db798ff96] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:46:55.217289 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-a92058ea-026a-4f72-b251-a8cf95954609 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:46:55.217731 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-a92058ea-026a-4f72-b251-a8cf95954609 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:46:55.218485 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-a92058ea-026a-4f72-b251-a8cf95954609 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:46:55.218911 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-a92058ea-026a-4f72-b251-a8cf95954609 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:46:55.247030 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-a92058ea-026a-4f72-b251-a8cf95954609 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040939 Oct 27 15:46:55.247570 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 406/730] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Oct 27 15:46:55 2021] GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 15:46:55.810820 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-11ecb889-4148-480b-9775-5267380c92b9 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:46:55.811414 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-11ecb889-4148-480b-9775-5267380c92b9 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] [instance: a79303e6-05ad-4901-96b7-ce845b4016f4] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:46:55.817191 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-11ecb889-4148-480b-9775-5267380c92b9 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:46:55.817629 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-11ecb889-4148-480b-9775-5267380c92b9 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:46:55.818377 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-11ecb889-4148-480b-9775-5267380c92b9 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:46:55.818808 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-11ecb889-4148-480b-9775-5267380c92b9 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:46:55.932248 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-14b89279-6b36-4886-ae34-a164653b1de2 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:46:55.933288 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-14b89279-6b36-4886-ae34-a164653b1de2 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:46:55.938993 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-14b89279-6b36-4886-ae34-a164653b1de2 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:46:55.939443 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-14b89279-6b36-4886-ae34-a164653b1de2 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:46:55.940253 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-14b89279-6b36-4886-ae34-a164653b1de2 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:46:55.940696 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-14b89279-6b36-4886-ae34-a164653b1de2 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:46:55.944000 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-11ecb889-4148-480b-9775-5267380c92b9 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c757a383a434a4c9b1b928087af8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8818377e744d4f6ba65560705c191f0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:46:55.951759 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-11ecb889-4148-480b-9775-5267380c92b9 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] 10.222.0.64 "GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4" status: 200 len: 1266 microversion: 2.1 time: 0.144752 Oct 27 15:46:55.952365 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 325/731] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:46:55 2021] GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4 => generated 1266 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 15:46:56.060950 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-14b89279-6b36-4886-ae34-a164653b1de2 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:46:56.069260 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-14b89279-6b36-4886-ae34-a164653b1de2 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:46:56.070854 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-14b89279-6b36-4886-ae34-a164653b1de2 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:46:56.072193 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-14b89279-6b36-4886-ae34-a164653b1de2 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672" status: 200 len: 1754 microversion: 2.20 time: 0.144137 Oct 27 15:46:56.072628 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 407/732] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Oct 27 15:46:55 2021] GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672 => generated 1754 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 15:46:56.257677 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-3bd6b352-bd8a-4d55-b071-cfbd2eb36e55 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:46:56.259265 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-3bd6b352-bd8a-4d55-b071-cfbd2eb36e55 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: 62c89161-c119-48b2-839d-712db798ff96] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:46:56.265010 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-3bd6b352-bd8a-4d55-b071-cfbd2eb36e55 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:46:56.265445 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-3bd6b352-bd8a-4d55-b071-cfbd2eb36e55 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:46:56.266192 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-3bd6b352-bd8a-4d55-b071-cfbd2eb36e55 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:46:56.266613 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-3bd6b352-bd8a-4d55-b071-cfbd2eb36e55 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:46:56.295540 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-3bd6b352-bd8a-4d55-b071-cfbd2eb36e55 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041761 Oct 27 15:46:56.296115 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 326/733] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Oct 27 15:46:56 2021] GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 15:46:56.967499 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-b4262b72-813d-4c36-ab8e-122cb12a1a4b tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:46:56.968161 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-b4262b72-813d-4c36-ab8e-122cb12a1a4b tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] [instance: a79303e6-05ad-4901-96b7-ce845b4016f4] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:46:56.974603 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-b4262b72-813d-4c36-ab8e-122cb12a1a4b tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:46:56.975146 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-b4262b72-813d-4c36-ab8e-122cb12a1a4b tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:46:56.975947 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-b4262b72-813d-4c36-ab8e-122cb12a1a4b tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:46:56.976382 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-b4262b72-813d-4c36-ab8e-122cb12a1a4b tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:46:57.090965 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-f766e894-2bc6-47eb-96a4-3f803d7df54f tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:46:57.091596 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-f766e894-2bc6-47eb-96a4-3f803d7df54f tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:46:57.096610 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-b4262b72-813d-4c36-ab8e-122cb12a1a4b tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c757a383a434a4c9b1b928087af8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8818377e744d4f6ba65560705c191f0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:46:57.097990 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-f766e894-2bc6-47eb-96a4-3f803d7df54f tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:46:57.098429 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-f766e894-2bc6-47eb-96a4-3f803d7df54f tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:46:57.099190 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-f766e894-2bc6-47eb-96a4-3f803d7df54f tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:46:57.099617 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-f766e894-2bc6-47eb-96a4-3f803d7df54f tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:46:57.104510 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-b4262b72-813d-4c36-ab8e-122cb12a1a4b tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] 10.222.0.64 "GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4" status: 200 len: 1266 microversion: 2.1 time: 0.140265 Oct 27 15:46:57.107704 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 408/734] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:46:56 2021] GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4 => generated 1266 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 15:46:57.226282 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-f766e894-2bc6-47eb-96a4-3f803d7df54f tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:46:57.235139 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-f766e894-2bc6-47eb-96a4-3f803d7df54f tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:46:57.236671 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-f766e894-2bc6-47eb-96a4-3f803d7df54f tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:46:57.237822 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-f766e894-2bc6-47eb-96a4-3f803d7df54f tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672" status: 200 len: 1754 microversion: 2.20 time: 0.151155 Oct 27 15:46:57.238373 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 327/735] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Oct 27 15:46:57 2021] GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672 => generated 1754 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 15:46:57.306302 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-6f1975e7-d187-428a-b803-7a0984965e11 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:46:57.307313 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-6f1975e7-d187-428a-b803-7a0984965e11 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: 62c89161-c119-48b2-839d-712db798ff96] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:46:57.313103 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-6f1975e7-d187-428a-b803-7a0984965e11 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:46:57.313543 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-6f1975e7-d187-428a-b803-7a0984965e11 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:46:57.314304 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-6f1975e7-d187-428a-b803-7a0984965e11 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:46:57.314735 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-6f1975e7-d187-428a-b803-7a0984965e11 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:46:57.343013 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-6f1975e7-d187-428a-b803-7a0984965e11 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040455 Oct 27 15:46:57.343562 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 409/736] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Oct 27 15:46:57 2021] GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 15:46:58.121899 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-c8c861ec-f2d9-4ec7-b1e4-e26b95738710 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:46:58.122570 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-c8c861ec-f2d9-4ec7-b1e4-e26b95738710 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] [instance: a79303e6-05ad-4901-96b7-ce845b4016f4] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:46:58.129113 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-c8c861ec-f2d9-4ec7-b1e4-e26b95738710 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:46:58.129560 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-c8c861ec-f2d9-4ec7-b1e4-e26b95738710 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:46:58.130362 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-c8c861ec-f2d9-4ec7-b1e4-e26b95738710 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:46:58.130797 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-c8c861ec-f2d9-4ec7-b1e4-e26b95738710 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:46:58.255966 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-d92b32f0-7dcd-4183-9405-dfe578f35c88 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:46:58.256604 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-d92b32f0-7dcd-4183-9405-dfe578f35c88 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:46:58.258654 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-c8c861ec-f2d9-4ec7-b1e4-e26b95738710 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c757a383a434a4c9b1b928087af8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8818377e744d4f6ba65560705c191f0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:46:58.264120 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-d92b32f0-7dcd-4183-9405-dfe578f35c88 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:46:58.264565 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-d92b32f0-7dcd-4183-9405-dfe578f35c88 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:46:58.265321 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-d92b32f0-7dcd-4183-9405-dfe578f35c88 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:46:58.265745 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-d92b32f0-7dcd-4183-9405-dfe578f35c88 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:46:58.266656 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-c8c861ec-f2d9-4ec7-b1e4-e26b95738710 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] 10.222.0.64 "GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4" status: 200 len: 1266 microversion: 2.1 time: 0.149178 Oct 27 15:46:58.267220 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 328/737] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:46:58 2021] GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4 => generated 1266 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 15:46:58.354760 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-395feec4-8a56-4175-b75b-869e1e360381 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:46:58.355745 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-395feec4-8a56-4175-b75b-869e1e360381 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: 62c89161-c119-48b2-839d-712db798ff96] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:46:58.361555 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-395feec4-8a56-4175-b75b-869e1e360381 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:46:58.362004 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-395feec4-8a56-4175-b75b-869e1e360381 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:46:58.362773 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-395feec4-8a56-4175-b75b-869e1e360381 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:46:58.363403 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-395feec4-8a56-4175-b75b-869e1e360381 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:46:58.392990 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-395feec4-8a56-4175-b75b-869e1e360381 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042459 Oct 27 15:46:58.393554 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 329/738] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Oct 27 15:46:58 2021] GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 15:46:58.394408 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-d92b32f0-7dcd-4183-9405-dfe578f35c88 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:46:58.402557 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-d92b32f0-7dcd-4183-9405-dfe578f35c88 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:46:58.404082 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-d92b32f0-7dcd-4183-9405-dfe578f35c88 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:46:58.405229 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-d92b32f0-7dcd-4183-9405-dfe578f35c88 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672" status: 200 len: 1754 microversion: 2.20 time: 0.153024 Oct 27 15:46:58.405771 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 410/739] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Oct 27 15:46:58 2021] GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672 => generated 1754 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 15:46:59.286006 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-d35325cf-272b-431a-b7e3-682e841a2a22 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:46:59.286615 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-d35325cf-272b-431a-b7e3-682e841a2a22 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] [instance: a79303e6-05ad-4901-96b7-ce845b4016f4] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:46:59.293137 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-d35325cf-272b-431a-b7e3-682e841a2a22 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:46:59.293587 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-d35325cf-272b-431a-b7e3-682e841a2a22 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:46:59.294353 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-d35325cf-272b-431a-b7e3-682e841a2a22 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:46:59.294787 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-d35325cf-272b-431a-b7e3-682e841a2a22 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:46:59.405057 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-a89ff7d7-a9e2-4d69-a1cc-f8b8e36184f5 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:46:59.406041 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-a89ff7d7-a9e2-4d69-a1cc-f8b8e36184f5 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: 62c89161-c119-48b2-839d-712db798ff96] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:46:59.412532 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-a89ff7d7-a9e2-4d69-a1cc-f8b8e36184f5 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:46:59.412923 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-a89ff7d7-a9e2-4d69-a1cc-f8b8e36184f5 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:46:59.413698 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-a89ff7d7-a9e2-4d69-a1cc-f8b8e36184f5 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:46:59.414155 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-a89ff7d7-a9e2-4d69-a1cc-f8b8e36184f5 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:46:59.417284 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-d35325cf-272b-431a-b7e3-682e841a2a22 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c757a383a434a4c9b1b928087af8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8818377e744d4f6ba65560705c191f0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:46:59.424569 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-d35325cf-272b-431a-b7e3-682e841a2a22 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] 10.222.0.64 "GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4" status: 200 len: 1266 microversion: 2.1 time: 0.142256 Oct 27 15:46:59.425235 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 330/740] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:46:59 2021] GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4 => generated 1266 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 15:46:59.429698 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-bdb45dd0-6867-497a-b212-60b763e33364 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:46:59.430368 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-bdb45dd0-6867-497a-b212-60b763e33364 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:46:59.436574 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-bdb45dd0-6867-497a-b212-60b763e33364 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:46:59.437110 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-bdb45dd0-6867-497a-b212-60b763e33364 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:46:59.437938 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-bdb45dd0-6867-497a-b212-60b763e33364 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:46:59.438440 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-bdb45dd0-6867-497a-b212-60b763e33364 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:46:59.445566 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-a89ff7d7-a9e2-4d69-a1cc-f8b8e36184f5 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044889 Oct 27 15:46:59.446131 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 411/741] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Oct 27 15:46:59 2021] GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 15:46:59.559145 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-bdb45dd0-6867-497a-b212-60b763e33364 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:46:59.567165 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-bdb45dd0-6867-497a-b212-60b763e33364 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:46:59.568679 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-bdb45dd0-6867-497a-b212-60b763e33364 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:46:59.569806 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-bdb45dd0-6867-497a-b212-60b763e33364 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672" status: 200 len: 1754 microversion: 2.20 time: 0.143678 Oct 27 15:46:59.570351 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 331/742] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Oct 27 15:46:59 2021] GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672 => generated 1754 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 15:47:00.442022 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-5b1806ee-11cd-4c22-b6e2-7a996d43c444 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:47:00.442635 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-5b1806ee-11cd-4c22-b6e2-7a996d43c444 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] [instance: a79303e6-05ad-4901-96b7-ce845b4016f4] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:47:00.448902 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-5b1806ee-11cd-4c22-b6e2-7a996d43c444 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:47:00.449373 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-5b1806ee-11cd-4c22-b6e2-7a996d43c444 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:47:00.450262 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-5b1806ee-11cd-4c22-b6e2-7a996d43c444 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:47:00.450698 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-5b1806ee-11cd-4c22-b6e2-7a996d43c444 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:47:00.457439 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-cb9f6886-a001-437b-aae9-d076082f4659 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:47:00.458352 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-cb9f6886-a001-437b-aae9-d076082f4659 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: 62c89161-c119-48b2-839d-712db798ff96] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:47:00.464299 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-cb9f6886-a001-437b-aae9-d076082f4659 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:47:00.464748 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-cb9f6886-a001-437b-aae9-d076082f4659 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:47:00.466268 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-cb9f6886-a001-437b-aae9-d076082f4659 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:47:00.466466 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-cb9f6886-a001-437b-aae9-d076082f4659 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:47:00.496026 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-cb9f6886-a001-437b-aae9-d076082f4659 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042214 Oct 27 15:47:00.496695 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 332/743] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Oct 27 15:47:00 2021] GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 15:47:00.573525 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-5b1806ee-11cd-4c22-b6e2-7a996d43c444 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c757a383a434a4c9b1b928087af8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8818377e744d4f6ba65560705c191f0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:47:00.581232 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-5b1806ee-11cd-4c22-b6e2-7a996d43c444 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] 10.222.0.64 "GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4" status: 200 len: 1266 microversion: 2.1 time: 0.142754 Oct 27 15:47:00.581796 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 412/744] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:47:00 2021] GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4 => generated 1266 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 15:47:00.588380 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-d4b19294-3bf3-4f98-9a96-b5932aec0fc4 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:47:00.589029 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-d4b19294-3bf3-4f98-9a96-b5932aec0fc4 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:47:00.596113 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-d4b19294-3bf3-4f98-9a96-b5932aec0fc4 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:47:00.596551 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-d4b19294-3bf3-4f98-9a96-b5932aec0fc4 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:47:00.597556 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-d4b19294-3bf3-4f98-9a96-b5932aec0fc4 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:47:00.597979 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-d4b19294-3bf3-4f98-9a96-b5932aec0fc4 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:47:00.720189 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-d4b19294-3bf3-4f98-9a96-b5932aec0fc4 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:47:00.728551 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-d4b19294-3bf3-4f98-9a96-b5932aec0fc4 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:47:00.730039 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-d4b19294-3bf3-4f98-9a96-b5932aec0fc4 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:47:00.731207 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-d4b19294-3bf3-4f98-9a96-b5932aec0fc4 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672" status: 200 len: 1754 microversion: 2.20 time: 0.146481 Oct 27 15:47:00.731760 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 333/745] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Oct 27 15:47:00 2021] GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672 => generated 1754 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 15:47:01.507346 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-d57f4bf1-b315-4de4-904c-b365e918b8ff tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:47:01.508284 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-d57f4bf1-b315-4de4-904c-b365e918b8ff tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: 62c89161-c119-48b2-839d-712db798ff96] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:47:01.515028 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-d57f4bf1-b315-4de4-904c-b365e918b8ff tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:47:01.515467 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-d57f4bf1-b315-4de4-904c-b365e918b8ff tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:47:01.516306 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-d57f4bf1-b315-4de4-904c-b365e918b8ff tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:47:01.516742 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-d57f4bf1-b315-4de4-904c-b365e918b8ff tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:47:01.546346 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-d57f4bf1-b315-4de4-904c-b365e918b8ff tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042744 Oct 27 15:47:01.546911 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 413/746] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Oct 27 15:47:01 2021] GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 15:47:01.598675 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-bf095958-c4ee-4b5e-83de-3e3f2cfae80c tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:47:01.599275 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-bf095958-c4ee-4b5e-83de-3e3f2cfae80c tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] [instance: a79303e6-05ad-4901-96b7-ce845b4016f4] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:47:01.605451 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-bf095958-c4ee-4b5e-83de-3e3f2cfae80c tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:47:01.605993 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-bf095958-c4ee-4b5e-83de-3e3f2cfae80c tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:47:01.607059 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-bf095958-c4ee-4b5e-83de-3e3f2cfae80c tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:47:01.607494 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-bf095958-c4ee-4b5e-83de-3e3f2cfae80c tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:47:01.727158 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-bf095958-c4ee-4b5e-83de-3e3f2cfae80c tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c757a383a434a4c9b1b928087af8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8818377e744d4f6ba65560705c191f0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:47:01.734398 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-bf095958-c4ee-4b5e-83de-3e3f2cfae80c tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] 10.222.0.64 "GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4" status: 200 len: 1266 microversion: 2.1 time: 0.139851 Oct 27 15:47:01.734985 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 334/747] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:47:01 2021] GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4 => generated 1266 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 15:47:01.749495 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-e03dc880-80c7-4201-bdb8-f61bfd5ff608 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:47:01.750104 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-e03dc880-80c7-4201-bdb8-f61bfd5ff608 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:47:01.755808 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-e03dc880-80c7-4201-bdb8-f61bfd5ff608 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:47:01.756296 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-e03dc880-80c7-4201-bdb8-f61bfd5ff608 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:47:01.757059 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-e03dc880-80c7-4201-bdb8-f61bfd5ff608 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:47:01.757544 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-e03dc880-80c7-4201-bdb8-f61bfd5ff608 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:47:01.882547 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-e03dc880-80c7-4201-bdb8-f61bfd5ff608 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:47:01.891512 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-e03dc880-80c7-4201-bdb8-f61bfd5ff608 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:47:01.893023 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-e03dc880-80c7-4201-bdb8-f61bfd5ff608 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:47:01.894164 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-e03dc880-80c7-4201-bdb8-f61bfd5ff608 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672" status: 200 len: 1754 microversion: 2.20 time: 0.148917 Oct 27 15:47:01.894709 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 414/748] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Oct 27 15:47:01 2021] GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672 => generated 1754 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 15:47:02.558272 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-1eacdbaa-ab23-42c0-9dd5-7e19bb2d9839 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:47:02.559934 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-1eacdbaa-ab23-42c0-9dd5-7e19bb2d9839 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: 62c89161-c119-48b2-839d-712db798ff96] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:47:02.565863 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-1eacdbaa-ab23-42c0-9dd5-7e19bb2d9839 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:47:02.566377 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-1eacdbaa-ab23-42c0-9dd5-7e19bb2d9839 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:47:02.567275 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-1eacdbaa-ab23-42c0-9dd5-7e19bb2d9839 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:47:02.567779 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-1eacdbaa-ab23-42c0-9dd5-7e19bb2d9839 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:47:02.596182 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-1eacdbaa-ab23-42c0-9dd5-7e19bb2d9839 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041941 Oct 27 15:47:02.596732 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 335/749] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Oct 27 15:47:02 2021] GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 15:47:02.750926 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-eb0139dc-cdac-4937-9f37-eadb2c754db0 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:47:02.751532 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-eb0139dc-cdac-4937-9f37-eadb2c754db0 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] [instance: a79303e6-05ad-4901-96b7-ce845b4016f4] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:47:02.757693 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-eb0139dc-cdac-4937-9f37-eadb2c754db0 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:47:02.758136 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-eb0139dc-cdac-4937-9f37-eadb2c754db0 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:47:02.758896 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-eb0139dc-cdac-4937-9f37-eadb2c754db0 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:47:02.759330 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-eb0139dc-cdac-4937-9f37-eadb2c754db0 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:47:02.881874 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-eb0139dc-cdac-4937-9f37-eadb2c754db0 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c757a383a434a4c9b1b928087af8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8818377e744d4f6ba65560705c191f0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:47:02.889382 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-eb0139dc-cdac-4937-9f37-eadb2c754db0 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] 10.222.0.64 "GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4" status: 200 len: 1266 microversion: 2.1 time: 0.142134 Oct 27 15:47:02.889983 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 415/750] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:47:02 2021] GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4 => generated 1266 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 15:47:02.912164 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-da944777-c835-4dde-8528-89dc5b711e9d tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:47:02.912771 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-da944777-c835-4dde-8528-89dc5b711e9d tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:47:02.919767 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-da944777-c835-4dde-8528-89dc5b711e9d tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:47:02.920258 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-da944777-c835-4dde-8528-89dc5b711e9d tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:47:02.921049 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-da944777-c835-4dde-8528-89dc5b711e9d tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:47:02.921501 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-da944777-c835-4dde-8528-89dc5b711e9d tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:47:03.038658 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-da944777-c835-4dde-8528-89dc5b711e9d tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:47:03.047346 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-da944777-c835-4dde-8528-89dc5b711e9d tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:47:03.048860 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-da944777-c835-4dde-8528-89dc5b711e9d tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:47:03.049997 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-da944777-c835-4dde-8528-89dc5b711e9d tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672" status: 200 len: 1754 microversion: 2.20 time: 0.141509 Oct 27 15:47:03.050537 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 336/751] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Oct 27 15:47:02 2021] GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672 => generated 1754 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 15:47:03.607788 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-9c44f012-536a-4702-b5e4-66b5c31a242b tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:47:03.608637 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-9c44f012-536a-4702-b5e4-66b5c31a242b tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: 62c89161-c119-48b2-839d-712db798ff96] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:47:03.614687 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-9c44f012-536a-4702-b5e4-66b5c31a242b tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:47:03.615290 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-9c44f012-536a-4702-b5e4-66b5c31a242b tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:47:03.616083 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-9c44f012-536a-4702-b5e4-66b5c31a242b tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:47:03.616518 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-9c44f012-536a-4702-b5e4-66b5c31a242b tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:47:03.645542 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-9c44f012-536a-4702-b5e4-66b5c31a242b tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041520 Oct 27 15:47:03.646093 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 416/752] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Oct 27 15:47:03 2021] GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 15:47:03.905921 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-e865e6e4-c0b0-46da-b2b0-0f38b9f4e366 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:47:03.906440 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-e865e6e4-c0b0-46da-b2b0-0f38b9f4e366 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] [instance: a79303e6-05ad-4901-96b7-ce845b4016f4] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:47:03.912137 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-e865e6e4-c0b0-46da-b2b0-0f38b9f4e366 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:47:03.912574 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-e865e6e4-c0b0-46da-b2b0-0f38b9f4e366 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:47:03.913317 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-e865e6e4-c0b0-46da-b2b0-0f38b9f4e366 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:47:03.913740 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-e865e6e4-c0b0-46da-b2b0-0f38b9f4e366 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:47:04.037499 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-e865e6e4-c0b0-46da-b2b0-0f38b9f4e366 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c757a383a434a4c9b1b928087af8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8818377e744d4f6ba65560705c191f0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:47:04.044786 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-e865e6e4-c0b0-46da-b2b0-0f38b9f4e366 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] 10.222.0.64 "GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4" status: 200 len: 1266 microversion: 2.1 time: 0.142802 Oct 27 15:47:04.045348 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 337/753] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:47:03 2021] GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4 => generated 1266 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 15:47:04.068502 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-3c3bb56f-6f39-4b54-9197-3320f43978bd tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:47:04.069112 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-3c3bb56f-6f39-4b54-9197-3320f43978bd tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:47:04.075817 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-3c3bb56f-6f39-4b54-9197-3320f43978bd tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:47:04.076308 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-3c3bb56f-6f39-4b54-9197-3320f43978bd tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:47:04.077081 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-3c3bb56f-6f39-4b54-9197-3320f43978bd tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:47:04.077523 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-3c3bb56f-6f39-4b54-9197-3320f43978bd tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:47:04.196842 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-3c3bb56f-6f39-4b54-9197-3320f43978bd tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:47:04.205764 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-3c3bb56f-6f39-4b54-9197-3320f43978bd tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:47:04.207251 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-3c3bb56f-6f39-4b54-9197-3320f43978bd tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:47:04.208440 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-3c3bb56f-6f39-4b54-9197-3320f43978bd tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672" status: 200 len: 1754 microversion: 2.20 time: 0.143876 Oct 27 15:47:04.208995 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 417/754] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Oct 27 15:47:04 2021] GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672 => generated 1754 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 15:47:04.657767 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-6b3f2e2f-b35e-4d88-bb08-ecbc776e6f36 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:47:04.658669 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-6b3f2e2f-b35e-4d88-bb08-ecbc776e6f36 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: 62c89161-c119-48b2-839d-712db798ff96] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:47:04.664549 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-6b3f2e2f-b35e-4d88-bb08-ecbc776e6f36 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:47:04.664985 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-6b3f2e2f-b35e-4d88-bb08-ecbc776e6f36 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:47:04.665743 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-6b3f2e2f-b35e-4d88-bb08-ecbc776e6f36 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:47:04.666168 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-6b3f2e2f-b35e-4d88-bb08-ecbc776e6f36 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:47:04.694432 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-6b3f2e2f-b35e-4d88-bb08-ecbc776e6f36 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041090 Oct 27 15:47:04.694982 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 338/755] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Oct 27 15:47:04 2021] GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 15:47:05.065294 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-3e05be23-1773-4fbc-b8da-92dd185ac213 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:47:05.066082 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-3e05be23-1773-4fbc-b8da-92dd185ac213 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] [instance: a79303e6-05ad-4901-96b7-ce845b4016f4] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:47:05.074106 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-3e05be23-1773-4fbc-b8da-92dd185ac213 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:47:05.074698 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-3e05be23-1773-4fbc-b8da-92dd185ac213 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:47:05.076269 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-3e05be23-1773-4fbc-b8da-92dd185ac213 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:47:05.076896 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-3e05be23-1773-4fbc-b8da-92dd185ac213 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:47:05.199445 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-3e05be23-1773-4fbc-b8da-92dd185ac213 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c757a383a434a4c9b1b928087af8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8818377e744d4f6ba65560705c191f0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:47:05.207155 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-3e05be23-1773-4fbc-b8da-92dd185ac213 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] 10.222.0.64 "GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4" status: 200 len: 1266 microversion: 2.1 time: 0.147060 Oct 27 15:47:05.207741 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 418/756] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:47:05 2021] GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4 => generated 1266 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 15:47:05.227158 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-c19b91f2-36b3-4e3d-bc74-7740599ac9d0 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:47:05.227840 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-c19b91f2-36b3-4e3d-bc74-7740599ac9d0 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:47:05.235195 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-c19b91f2-36b3-4e3d-bc74-7740599ac9d0 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:47:05.235633 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-c19b91f2-36b3-4e3d-bc74-7740599ac9d0 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:47:05.236671 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-c19b91f2-36b3-4e3d-bc74-7740599ac9d0 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:47:05.237226 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-c19b91f2-36b3-4e3d-bc74-7740599ac9d0 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:47:05.358752 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-c19b91f2-36b3-4e3d-bc74-7740599ac9d0 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:47:05.366854 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-c19b91f2-36b3-4e3d-bc74-7740599ac9d0 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:47:05.368371 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-c19b91f2-36b3-4e3d-bc74-7740599ac9d0 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:47:05.369517 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-c19b91f2-36b3-4e3d-bc74-7740599ac9d0 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672" status: 200 len: 1754 microversion: 2.20 time: 0.146680 Oct 27 15:47:05.370251 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 339/757] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Oct 27 15:47:05 2021] GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672 => generated 1754 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 15:47:05.705320 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-ecfd9d41-9cca-4302-aee5-2b5b7a1410ac tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:47:05.706219 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-ecfd9d41-9cca-4302-aee5-2b5b7a1410ac tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: 62c89161-c119-48b2-839d-712db798ff96] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:47:05.712770 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-ecfd9d41-9cca-4302-aee5-2b5b7a1410ac tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:47:05.713214 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-ecfd9d41-9cca-4302-aee5-2b5b7a1410ac tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:47:05.713978 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-ecfd9d41-9cca-4302-aee5-2b5b7a1410ac tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:47:05.714415 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-ecfd9d41-9cca-4302-aee5-2b5b7a1410ac tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:47:05.745999 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-ecfd9d41-9cca-4302-aee5-2b5b7a1410ac tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044333 Oct 27 15:47:05.746561 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 419/758] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Oct 27 15:47:05 2021] GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 15:47:06.224533 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-f5ed1a2c-9d1a-496a-ae2a-a0002cc6155d tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:47:06.225139 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-f5ed1a2c-9d1a-496a-ae2a-a0002cc6155d tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] [instance: a79303e6-05ad-4901-96b7-ce845b4016f4] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:47:06.231464 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-f5ed1a2c-9d1a-496a-ae2a-a0002cc6155d tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:47:06.232068 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-f5ed1a2c-9d1a-496a-ae2a-a0002cc6155d tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:47:06.233511 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-f5ed1a2c-9d1a-496a-ae2a-a0002cc6155d tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:47:06.233948 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-f5ed1a2c-9d1a-496a-ae2a-a0002cc6155d tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:47:06.350113 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-f5ed1a2c-9d1a-496a-ae2a-a0002cc6155d tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c757a383a434a4c9b1b928087af8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8818377e744d4f6ba65560705c191f0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:47:06.357175 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-f5ed1a2c-9d1a-496a-ae2a-a0002cc6155d tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] 10.222.0.64 "GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4" status: 200 len: 1266 microversion: 2.1 time: 0.136608 Oct 27 15:47:06.358597 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 340/759] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:47:06 2021] GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4 => generated 1266 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 15:47:06.388220 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-de760f06-f507-4de4-83fa-c5e1af1d45ad tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:47:06.389389 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-de760f06-f507-4de4-83fa-c5e1af1d45ad tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:47:06.395618 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-de760f06-f507-4de4-83fa-c5e1af1d45ad tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:47:06.396150 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-de760f06-f507-4de4-83fa-c5e1af1d45ad tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:47:06.396965 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-de760f06-f507-4de4-83fa-c5e1af1d45ad tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:47:06.397425 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-de760f06-f507-4de4-83fa-c5e1af1d45ad tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:47:06.523401 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-de760f06-f507-4de4-83fa-c5e1af1d45ad tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:47:06.531794 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-de760f06-f507-4de4-83fa-c5e1af1d45ad tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:47:06.533358 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-de760f06-f507-4de4-83fa-c5e1af1d45ad tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:47:06.534611 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-de760f06-f507-4de4-83fa-c5e1af1d45ad tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672" status: 200 len: 1754 microversion: 2.20 time: 0.150010 Oct 27 15:47:06.535344 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 420/760] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Oct 27 15:47:06 2021] GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672 => generated 1754 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 15:47:06.758917 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-ff67227e-c45e-47ee-8b9d-f47d9ab51cf4 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:47:06.759740 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-ff67227e-c45e-47ee-8b9d-f47d9ab51cf4 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: 62c89161-c119-48b2-839d-712db798ff96] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:47:06.765747 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-ff67227e-c45e-47ee-8b9d-f47d9ab51cf4 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:47:06.766184 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-ff67227e-c45e-47ee-8b9d-f47d9ab51cf4 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:47:06.766948 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-ff67227e-c45e-47ee-8b9d-f47d9ab51cf4 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:47:06.767377 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-ff67227e-c45e-47ee-8b9d-f47d9ab51cf4 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:47:06.796210 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-ff67227e-c45e-47ee-8b9d-f47d9ab51cf4 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041134 Oct 27 15:47:06.796758 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 341/761] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Oct 27 15:47:06 2021] GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 15:47:07.374540 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-c1f82564-6b28-4020-87ce-8f41312cdfb8 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:47:07.375143 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-c1f82564-6b28-4020-87ce-8f41312cdfb8 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] [instance: a79303e6-05ad-4901-96b7-ce845b4016f4] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:47:07.381013 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-c1f82564-6b28-4020-87ce-8f41312cdfb8 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:47:07.381461 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-c1f82564-6b28-4020-87ce-8f41312cdfb8 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:47:07.382251 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-c1f82564-6b28-4020-87ce-8f41312cdfb8 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:47:07.382683 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-c1f82564-6b28-4020-87ce-8f41312cdfb8 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:47:07.501937 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-c1f82564-6b28-4020-87ce-8f41312cdfb8 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c757a383a434a4c9b1b928087af8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8818377e744d4f6ba65560705c191f0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:47:07.509151 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-c1f82564-6b28-4020-87ce-8f41312cdfb8 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] 10.222.0.64 "GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4" status: 200 len: 1266 microversion: 2.1 time: 0.138561 Oct 27 15:47:07.509712 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 421/762] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:47:07 2021] GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4 => generated 1266 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 15:47:07.552278 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-da5974fc-c07b-450d-a611-b062c04d9f5a tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:47:07.552882 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-da5974fc-c07b-450d-a611-b062c04d9f5a tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:47:07.559047 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-da5974fc-c07b-450d-a611-b062c04d9f5a tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:47:07.559487 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-da5974fc-c07b-450d-a611-b062c04d9f5a tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:47:07.560276 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-da5974fc-c07b-450d-a611-b062c04d9f5a tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:47:07.560874 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-da5974fc-c07b-450d-a611-b062c04d9f5a tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:47:07.694092 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-da5974fc-c07b-450d-a611-b062c04d9f5a tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:47:07.703195 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-da5974fc-c07b-450d-a611-b062c04d9f5a tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:47:07.704716 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-da5974fc-c07b-450d-a611-b062c04d9f5a tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:47:07.705861 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-da5974fc-c07b-450d-a611-b062c04d9f5a tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672" status: 200 len: 1754 microversion: 2.20 time: 0.157275 Oct 27 15:47:07.706410 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 342/763] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Oct 27 15:47:07 2021] GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672 => generated 1754 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 15:47:07.806627 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-f2bf107e-3a34-498b-8852-d0c41a2497dc tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:47:07.807543 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-f2bf107e-3a34-498b-8852-d0c41a2497dc tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: 62c89161-c119-48b2-839d-712db798ff96] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:47:07.813773 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-f2bf107e-3a34-498b-8852-d0c41a2497dc tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:47:07.814212 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-f2bf107e-3a34-498b-8852-d0c41a2497dc tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:47:07.814958 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-f2bf107e-3a34-498b-8852-d0c41a2497dc tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:47:07.815383 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-f2bf107e-3a34-498b-8852-d0c41a2497dc tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:47:07.843439 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-f2bf107e-3a34-498b-8852-d0c41a2497dc tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040599 Oct 27 15:47:07.844001 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 422/764] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Oct 27 15:47:07 2021] GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 15:47:08.525054 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-f608bee4-5cec-4399-9a7d-65be3e06841f tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:47:08.525654 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-f608bee4-5cec-4399-9a7d-65be3e06841f tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] [instance: a79303e6-05ad-4901-96b7-ce845b4016f4] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:47:08.532470 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-f608bee4-5cec-4399-9a7d-65be3e06841f tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:47:08.532903 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-f608bee4-5cec-4399-9a7d-65be3e06841f tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:47:08.533657 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-f608bee4-5cec-4399-9a7d-65be3e06841f tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:47:08.534081 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-f608bee4-5cec-4399-9a7d-65be3e06841f tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:47:08.659214 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-f608bee4-5cec-4399-9a7d-65be3e06841f tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c757a383a434a4c9b1b928087af8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8818377e744d4f6ba65560705c191f0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:47:08.666747 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-f608bee4-5cec-4399-9a7d-65be3e06841f tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] 10.222.0.64 "GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4" status: 200 len: 1266 microversion: 2.1 time: 0.145323 Oct 27 15:47:08.667613 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 343/765] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:47:08 2021] GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4 => generated 1266 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 15:47:08.724171 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-2bcfd93c-150c-4bc2-afe6-63c75a51d65f tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:47:08.724780 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-2bcfd93c-150c-4bc2-afe6-63c75a51d65f tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:47:08.730924 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-2bcfd93c-150c-4bc2-afe6-63c75a51d65f tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:47:08.731369 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-2bcfd93c-150c-4bc2-afe6-63c75a51d65f tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:47:08.732175 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-2bcfd93c-150c-4bc2-afe6-63c75a51d65f tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:47:08.732652 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-2bcfd93c-150c-4bc2-afe6-63c75a51d65f tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:47:08.854166 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-2bcfd93c-150c-4bc2-afe6-63c75a51d65f tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:47:08.854748 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-e792fd1a-ec8d-4738-8dd5-61fc219a33d0 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:47:08.855688 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-e792fd1a-ec8d-4738-8dd5-61fc219a33d0 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: 62c89161-c119-48b2-839d-712db798ff96] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:47:08.861429 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-e792fd1a-ec8d-4738-8dd5-61fc219a33d0 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:47:08.861870 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-e792fd1a-ec8d-4738-8dd5-61fc219a33d0 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:47:08.862635 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-e792fd1a-ec8d-4738-8dd5-61fc219a33d0 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:47:08.863083 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-e792fd1a-ec8d-4738-8dd5-61fc219a33d0 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:47:08.865081 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-2bcfd93c-150c-4bc2-afe6-63c75a51d65f tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:47:08.866577 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-2bcfd93c-150c-4bc2-afe6-63c75a51d65f tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:47:08.867730 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-2bcfd93c-150c-4bc2-afe6-63c75a51d65f tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672" status: 200 len: 1754 microversion: 2.20 time: 0.147542 Oct 27 15:47:08.868323 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 423/766] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Oct 27 15:47:08 2021] GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672 => generated 1754 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 15:47:08.892703 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-e792fd1a-ec8d-4738-8dd5-61fc219a33d0 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041969 Oct 27 15:47:08.893258 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 344/767] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Oct 27 15:47:08 2021] GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 15:47:09.683877 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-2d2e263f-f30b-45b0-96af-df3129c52437 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:47:09.684505 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-2d2e263f-f30b-45b0-96af-df3129c52437 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] [instance: a79303e6-05ad-4901-96b7-ce845b4016f4] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:47:09.690788 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-2d2e263f-f30b-45b0-96af-df3129c52437 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:47:09.691226 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-2d2e263f-f30b-45b0-96af-df3129c52437 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:47:09.692010 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-2d2e263f-f30b-45b0-96af-df3129c52437 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:47:09.692443 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-2d2e263f-f30b-45b0-96af-df3129c52437 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:47:09.819546 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-2d2e263f-f30b-45b0-96af-df3129c52437 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c757a383a434a4c9b1b928087af8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8818377e744d4f6ba65560705c191f0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:47:09.826972 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-2d2e263f-f30b-45b0-96af-df3129c52437 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] 10.222.0.64 "GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4" status: 200 len: 1266 microversion: 2.1 time: 0.146703 Oct 27 15:47:09.827543 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 424/768] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:47:09 2021] GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4 => generated 1266 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 15:47:09.886152 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-b77ef344-c7e4-4cb2-b654-a60e4c6c00da tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:47:09.886748 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-b77ef344-c7e4-4cb2-b654-a60e4c6c00da tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:47:09.893625 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-b77ef344-c7e4-4cb2-b654-a60e4c6c00da tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:47:09.894063 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-b77ef344-c7e4-4cb2-b654-a60e4c6c00da tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:47:09.894816 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-b77ef344-c7e4-4cb2-b654-a60e4c6c00da tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:47:09.895243 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-b77ef344-c7e4-4cb2-b654-a60e4c6c00da tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:47:09.903754 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-f10971e0-60d3-4e26-ac9f-fa1f2fcf68de tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:47:09.904671 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-f10971e0-60d3-4e26-ac9f-fa1f2fcf68de tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: 62c89161-c119-48b2-839d-712db798ff96] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:47:09.911024 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-f10971e0-60d3-4e26-ac9f-fa1f2fcf68de tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:47:09.911464 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-f10971e0-60d3-4e26-ac9f-fa1f2fcf68de tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:47:09.912698 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-f10971e0-60d3-4e26-ac9f-fa1f2fcf68de tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:47:09.912698 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-f10971e0-60d3-4e26-ac9f-fa1f2fcf68de tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:47:09.943651 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-f10971e0-60d3-4e26-ac9f-fa1f2fcf68de tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043514 Oct 27 15:47:09.944242 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 425/769] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Oct 27 15:47:09 2021] GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 15:47:10.025450 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-b77ef344-c7e4-4cb2-b654-a60e4c6c00da tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:47:10.034756 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-b77ef344-c7e4-4cb2-b654-a60e4c6c00da tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:47:10.036270 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-b77ef344-c7e4-4cb2-b654-a60e4c6c00da tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:47:10.037412 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-b77ef344-c7e4-4cb2-b654-a60e4c6c00da tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672" status: 200 len: 1754 microversion: 2.20 time: 0.154996 Oct 27 15:47:10.037961 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 345/770] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Oct 27 15:47:09 2021] GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672 => generated 1754 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 15:47:10.710398 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [req-2d9afd3d-64a7-4eed-aa9d-71c3de88d643 req-e62ead33-cd63-4a43-af9a-7def1b2c7155 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a79303e6-05ad-4901-96b7-ce845b4016f4", "name": "network-vif-plugged", "status": "completed", "tag": "9cdb66cd-4ae2-4cf0-98ca-af0002156976"}]} {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 15:47:10.711983 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 27 15:47:10.711983 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: warnings.warn(msg) Oct 27 15:47:10.719821 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [req-2d9afd3d-64a7-4eed-aa9d-71c3de88d643 req-e62ead33-cd63-4a43-af9a-7def1b2c7155 service nova] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:47:10.720287 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [req-2d9afd3d-64a7-4eed-aa9d-71c3de88d643 req-e62ead33-cd63-4a43-af9a-7def1b2c7155 service nova] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:47:10.733498 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.compute.server_external_events [req-2d9afd3d-64a7-4eed-aa9d-71c3de88d643 req-e62ead33-cd63-4a43-af9a-7def1b2c7155 service nova] Creating event network-vif-plugged:9cdb66cd-4ae2-4cf0-98ca-af0002156976 for instance a79303e6-05ad-4901-96b7-ce845b4016f4 on hv-cinder-80070 Oct 27 15:47:10.738771 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [req-2d9afd3d-64a7-4eed-aa9d-71c3de88d643 req-e62ead33-cd63-4a43-af9a-7def1b2c7155 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032609 Oct 27 15:47:10.739729 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 426/771] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Oct 27 15:47:10 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 15:47:10.843352 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-d037a4db-4952-47dd-b5e2-1451f2047f4c tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:47:10.844083 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-d037a4db-4952-47dd-b5e2-1451f2047f4c tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] [instance: a79303e6-05ad-4901-96b7-ce845b4016f4] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:47:10.850357 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-d037a4db-4952-47dd-b5e2-1451f2047f4c tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:47:10.850803 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-d037a4db-4952-47dd-b5e2-1451f2047f4c tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:47:10.851570 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-d037a4db-4952-47dd-b5e2-1451f2047f4c tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:47:10.852026 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-d037a4db-4952-47dd-b5e2-1451f2047f4c tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:47:10.956083 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-790a2573-0ce9-4b98-bafb-c38d802a7761 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:47:10.958461 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-790a2573-0ce9-4b98-bafb-c38d802a7761 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: 62c89161-c119-48b2-839d-712db798ff96] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:47:10.969394 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-790a2573-0ce9-4b98-bafb-c38d802a7761 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:47:10.970458 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-790a2573-0ce9-4b98-bafb-c38d802a7761 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:47:10.971547 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-790a2573-0ce9-4b98-bafb-c38d802a7761 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:47:10.972660 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-790a2573-0ce9-4b98-bafb-c38d802a7761 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:47:11.007613 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-790a2573-0ce9-4b98-bafb-c38d802a7761 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056655 Oct 27 15:47:11.008313 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-d037a4db-4952-47dd-b5e2-1451f2047f4c tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c757a383a434a4c9b1b928087af8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8818377e744d4f6ba65560705c191f0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:47:11.012338 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 427/772] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Oct 27 15:47:10 2021] GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 15:47:11.016000 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-d037a4db-4952-47dd-b5e2-1451f2047f4c tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] 10.222.0.64 "GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4" status: 200 len: 1266 microversion: 2.1 time: 0.176148 Oct 27 15:47:11.016637 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 346/773] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:47:10 2021] GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4 => generated 1266 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 15:47:11.056034 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-fe667690-426b-4106-a643-9b54d3dd1a88 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:47:11.056636 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-fe667690-426b-4106-a643-9b54d3dd1a88 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:47:11.063558 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-fe667690-426b-4106-a643-9b54d3dd1a88 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:47:11.064037 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-fe667690-426b-4106-a643-9b54d3dd1a88 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:47:11.064783 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-fe667690-426b-4106-a643-9b54d3dd1a88 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:47:11.065208 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-fe667690-426b-4106-a643-9b54d3dd1a88 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:47:11.186177 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-fe667690-426b-4106-a643-9b54d3dd1a88 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:47:11.196796 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-fe667690-426b-4106-a643-9b54d3dd1a88 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:47:11.198308 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-fe667690-426b-4106-a643-9b54d3dd1a88 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:47:11.199468 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-fe667690-426b-4106-a643-9b54d3dd1a88 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672" status: 200 len: 1754 microversion: 2.20 time: 0.147105 Oct 27 15:47:11.200062 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 428/774] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Oct 27 15:47:11 2021] GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672 => generated 1754 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 15:47:12.020137 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-21621920-1df5-4a76-a3fe-661beacbc8ff tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:47:12.021034 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-21621920-1df5-4a76-a3fe-661beacbc8ff tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: 62c89161-c119-48b2-839d-712db798ff96] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:47:12.027175 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-21621920-1df5-4a76-a3fe-661beacbc8ff tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:47:12.027624 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-21621920-1df5-4a76-a3fe-661beacbc8ff tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:47:12.028426 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-21621920-1df5-4a76-a3fe-661beacbc8ff tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:47:12.028858 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-21621920-1df5-4a76-a3fe-661beacbc8ff tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:47:12.033443 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-4af81f82-6a2c-4eb8-8d5f-c5a4327a0f45 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:47:12.034053 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-4af81f82-6a2c-4eb8-8d5f-c5a4327a0f45 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] [instance: a79303e6-05ad-4901-96b7-ce845b4016f4] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:47:12.040431 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-4af81f82-6a2c-4eb8-8d5f-c5a4327a0f45 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:47:12.040868 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-4af81f82-6a2c-4eb8-8d5f-c5a4327a0f45 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:47:12.041632 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-4af81f82-6a2c-4eb8-8d5f-c5a4327a0f45 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:47:12.042064 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-4af81f82-6a2c-4eb8-8d5f-c5a4327a0f45 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:47:12.059021 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-21621920-1df5-4a76-a3fe-661beacbc8ff tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042712 Oct 27 15:47:12.059587 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 347/775] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Oct 27 15:47:12 2021] GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 15:47:12.172119 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-4af81f82-6a2c-4eb8-8d5f-c5a4327a0f45 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c757a383a434a4c9b1b928087af8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8818377e744d4f6ba65560705c191f0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:47:12.182714 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-4af81f82-6a2c-4eb8-8d5f-c5a4327a0f45 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] 10.222.0.64 "GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4" status: 200 len: 1266 microversion: 2.1 time: 0.153346 Oct 27 15:47:12.183748 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 429/776] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:47:12 2021] GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4 => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 15:47:12.217603 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-7e8adfb8-7462-439c-a8e7-a7cd288c458c tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:47:12.218197 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-7e8adfb8-7462-439c-a8e7-a7cd288c458c tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:47:12.224878 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-7e8adfb8-7462-439c-a8e7-a7cd288c458c tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:47:12.225316 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-7e8adfb8-7462-439c-a8e7-a7cd288c458c tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:47:12.226063 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-7e8adfb8-7462-439c-a8e7-a7cd288c458c tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:47:12.226487 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-7e8adfb8-7462-439c-a8e7-a7cd288c458c tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:47:12.347257 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-7e8adfb8-7462-439c-a8e7-a7cd288c458c tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:47:12.355253 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-7e8adfb8-7462-439c-a8e7-a7cd288c458c tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:47:12.356765 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-7e8adfb8-7462-439c-a8e7-a7cd288c458c tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:47:12.357899 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-7e8adfb8-7462-439c-a8e7-a7cd288c458c tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672" status: 200 len: 1754 microversion: 2.20 time: 0.144053 Oct 27 15:47:12.358448 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 348/777] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Oct 27 15:47:12 2021] GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672 => generated 1754 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 15:47:13.071712 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-8449cbe4-c0dc-4a11-8fb8-7f4310aa7454 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:47:13.072635 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-8449cbe4-c0dc-4a11-8fb8-7f4310aa7454 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: 62c89161-c119-48b2-839d-712db798ff96] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:47:13.079605 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-8449cbe4-c0dc-4a11-8fb8-7f4310aa7454 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:47:13.080077 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-8449cbe4-c0dc-4a11-8fb8-7f4310aa7454 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:47:13.080845 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-8449cbe4-c0dc-4a11-8fb8-7f4310aa7454 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:47:13.081279 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-8449cbe4-c0dc-4a11-8fb8-7f4310aa7454 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:47:13.109267 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-8449cbe4-c0dc-4a11-8fb8-7f4310aa7454 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041254 Oct 27 15:47:13.109824 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 430/778] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Oct 27 15:47:13 2021] GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 15:47:13.200377 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-a2007ad7-b369-417f-9485-ca281f37e555 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:47:13.201015 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-a2007ad7-b369-417f-9485-ca281f37e555 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] [instance: a79303e6-05ad-4901-96b7-ce845b4016f4] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:47:13.207487 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-a2007ad7-b369-417f-9485-ca281f37e555 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:47:13.207978 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-a2007ad7-b369-417f-9485-ca281f37e555 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:47:13.208733 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-a2007ad7-b369-417f-9485-ca281f37e555 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:47:13.209158 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-a2007ad7-b369-417f-9485-ca281f37e555 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:47:13.331511 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-a2007ad7-b369-417f-9485-ca281f37e555 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c757a383a434a4c9b1b928087af8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8818377e744d4f6ba65560705c191f0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:47:13.338922 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-a2007ad7-b369-417f-9485-ca281f37e555 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] 10.222.0.64 "GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4" status: 200 len: 1452 microversion: 2.1 time: 0.142231 Oct 27 15:47:13.339476 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 349/779] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:47:13 2021] GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4 => generated 1452 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 15:47:13.355422 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-709470c6-f502-40c4-9448-f70c5af680fe tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:47:13.356060 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-709470c6-f502-40c4-9448-f70c5af680fe tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] [instance: a79303e6-05ad-4901-96b7-ce845b4016f4] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:47:13.362435 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-709470c6-f502-40c4-9448-f70c5af680fe tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:47:13.362878 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-709470c6-f502-40c4-9448-f70c5af680fe tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:47:13.363632 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-709470c6-f502-40c4-9448-f70c5af680fe tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:47:13.364102 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-709470c6-f502-40c4-9448-f70c5af680fe tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:47:13.377086 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-766053dd-abf9-4052-9521-167c58bf06fd tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:47:13.377714 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-766053dd-abf9-4052-9521-167c58bf06fd tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:47:13.383367 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-766053dd-abf9-4052-9521-167c58bf06fd tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:47:13.383923 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-766053dd-abf9-4052-9521-167c58bf06fd tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:47:13.384568 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-766053dd-abf9-4052-9521-167c58bf06fd tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:47:13.385111 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-766053dd-abf9-4052-9521-167c58bf06fd tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:47:13.492017 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-709470c6-f502-40c4-9448-f70c5af680fe tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c757a383a434a4c9b1b928087af8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8818377e744d4f6ba65560705c191f0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:47:13.499284 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-709470c6-f502-40c4-9448-f70c5af680fe tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] 10.222.0.64 "GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4" status: 200 len: 1452 microversion: 2.1 time: 0.147483 Oct 27 15:47:13.500853 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 431/780] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:47:13 2021] GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4 => generated 1452 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 15:47:13.515035 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-766053dd-abf9-4052-9521-167c58bf06fd tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:47:13.523602 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-766053dd-abf9-4052-9521-167c58bf06fd tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:47:13.525124 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-766053dd-abf9-4052-9521-167c58bf06fd tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:47:13.526490 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-766053dd-abf9-4052-9521-167c58bf06fd tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672" status: 200 len: 1754 microversion: 2.20 time: 0.153568 Oct 27 15:47:13.527197 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 350/781] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Oct 27 15:47:13 2021] GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672 => generated 1754 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 15:47:14.122047 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-d402d13f-fa0a-4bd8-a66b-4f8ba07e7464 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:47:14.123518 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-d402d13f-fa0a-4bd8-a66b-4f8ba07e7464 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: 62c89161-c119-48b2-839d-712db798ff96] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:47:14.134903 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-d402d13f-fa0a-4bd8-a66b-4f8ba07e7464 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:47:14.135704 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-d402d13f-fa0a-4bd8-a66b-4f8ba07e7464 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:47:14.137166 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-d402d13f-fa0a-4bd8-a66b-4f8ba07e7464 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:47:14.138149 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-d402d13f-fa0a-4bd8-a66b-4f8ba07e7464 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:47:14.173159 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-d402d13f-fa0a-4bd8-a66b-4f8ba07e7464 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055696 Oct 27 15:47:14.173778 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 432/782] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Oct 27 15:47:14 2021] GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 15:47:14.546960 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-3584ef0b-00d5-440a-b232-59794a19cadd tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:47:14.547743 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-3584ef0b-00d5-440a-b232-59794a19cadd tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:47:14.553923 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-3584ef0b-00d5-440a-b232-59794a19cadd tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:47:14.554362 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-3584ef0b-00d5-440a-b232-59794a19cadd tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:47:14.555117 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-3584ef0b-00d5-440a-b232-59794a19cadd tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:47:14.555539 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-3584ef0b-00d5-440a-b232-59794a19cadd tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:47:14.682832 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-3584ef0b-00d5-440a-b232-59794a19cadd tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:47:14.692654 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-3584ef0b-00d5-440a-b232-59794a19cadd tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:47:14.694654 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-3584ef0b-00d5-440a-b232-59794a19cadd tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:47:14.696110 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-3584ef0b-00d5-440a-b232-59794a19cadd tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672" status: 200 len: 1754 microversion: 2.20 time: 0.153270 Oct 27 15:47:14.696930 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 351/783] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Oct 27 15:47:14 2021] GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672 => generated 1754 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 15:47:15.184874 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-55814f25-b33a-429a-8b8f-85508718c147 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:47:15.185926 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-55814f25-b33a-429a-8b8f-85508718c147 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: 62c89161-c119-48b2-839d-712db798ff96] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:47:15.192989 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-55814f25-b33a-429a-8b8f-85508718c147 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:47:15.193431 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-55814f25-b33a-429a-8b8f-85508718c147 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:47:15.194393 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-55814f25-b33a-429a-8b8f-85508718c147 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:47:15.194828 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-55814f25-b33a-429a-8b8f-85508718c147 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:47:15.224976 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-55814f25-b33a-429a-8b8f-85508718c147 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044024 Oct 27 15:47:15.225555 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 433/784] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Oct 27 15:47:15 2021] GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 15:47:15.557479 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [req-aa5b7419-17d7-491f-90ef-99ea005d3446 req-8e067222-3d38-4cf7-8145-67e7fd6b232d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a79303e6-05ad-4901-96b7-ce845b4016f4", "tag": "9cdb66cd-4ae2-4cf0-98ca-af0002156976"}]} {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 15:47:15.559122 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 27 15:47:15.559122 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: warnings.warn(msg) Oct 27 15:47:15.566807 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [req-aa5b7419-17d7-491f-90ef-99ea005d3446 req-8e067222-3d38-4cf7-8145-67e7fd6b232d service nova] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:47:15.567251 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [req-aa5b7419-17d7-491f-90ef-99ea005d3446 req-8e067222-3d38-4cf7-8145-67e7fd6b232d service nova] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:47:15.578712 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.compute.server_external_events [req-aa5b7419-17d7-491f-90ef-99ea005d3446 req-8e067222-3d38-4cf7-8145-67e7fd6b232d service nova] Creating event network-changed:9cdb66cd-4ae2-4cf0-98ca-af0002156976 for instance a79303e6-05ad-4901-96b7-ce845b4016f4 on hv-cinder-80070 Oct 27 15:47:15.583780 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [req-aa5b7419-17d7-491f-90ef-99ea005d3446 req-8e067222-3d38-4cf7-8145-67e7fd6b232d service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029878 Oct 27 15:47:15.584404 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 352/785] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Oct 27 15:47:15 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 15:47:15.714565 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-845fcc34-4776-4e5f-b67e-835363049d95 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:47:15.715173 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-845fcc34-4776-4e5f-b67e-835363049d95 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:47:15.721634 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-845fcc34-4776-4e5f-b67e-835363049d95 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:47:15.722343 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-845fcc34-4776-4e5f-b67e-835363049d95 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:47:15.723109 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-845fcc34-4776-4e5f-b67e-835363049d95 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:47:15.723675 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-845fcc34-4776-4e5f-b67e-835363049d95 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:47:15.931778 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-845fcc34-4776-4e5f-b67e-835363049d95 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:47:15.941156 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-845fcc34-4776-4e5f-b67e-835363049d95 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:47:15.942662 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-845fcc34-4776-4e5f-b67e-835363049d95 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:47:15.943822 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-845fcc34-4776-4e5f-b67e-835363049d95 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672" status: 200 len: 1754 microversion: 2.20 time: 0.233154 Oct 27 15:47:15.944584 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 434/786] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Oct 27 15:47:15 2021] GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672 => generated 1754 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 15:47:16.236714 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-8a6a6494-c244-473a-b5a3-4ba4e6deb79e tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:47:16.237731 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-8a6a6494-c244-473a-b5a3-4ba4e6deb79e tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: 62c89161-c119-48b2-839d-712db798ff96] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:47:16.244183 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-8a6a6494-c244-473a-b5a3-4ba4e6deb79e tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:47:16.244638 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-8a6a6494-c244-473a-b5a3-4ba4e6deb79e tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:47:16.245406 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-8a6a6494-c244-473a-b5a3-4ba4e6deb79e tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:47:16.245835 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-8a6a6494-c244-473a-b5a3-4ba4e6deb79e tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:47:16.277583 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-8a6a6494-c244-473a-b5a3-4ba4e6deb79e tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045529 Oct 27 15:47:16.278230 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 353/787] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Oct 27 15:47:16 2021] GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 15:47:16.962074 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-b60ad9a6-0317-4087-b8f2-707ddc9a1353 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:47:16.962667 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-b60ad9a6-0317-4087-b8f2-707ddc9a1353 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:47:16.969106 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-b60ad9a6-0317-4087-b8f2-707ddc9a1353 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:47:16.969547 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-b60ad9a6-0317-4087-b8f2-707ddc9a1353 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:47:16.970344 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-b60ad9a6-0317-4087-b8f2-707ddc9a1353 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:47:16.970780 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-b60ad9a6-0317-4087-b8f2-707ddc9a1353 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:47:17.104363 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-b60ad9a6-0317-4087-b8f2-707ddc9a1353 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:47:17.112842 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-b60ad9a6-0317-4087-b8f2-707ddc9a1353 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:47:17.114337 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-b60ad9a6-0317-4087-b8f2-707ddc9a1353 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:47:17.115482 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-b60ad9a6-0317-4087-b8f2-707ddc9a1353 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672" status: 200 len: 1754 microversion: 2.20 time: 0.157147 Oct 27 15:47:17.116067 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 435/788] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Oct 27 15:47:16 2021] GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672 => generated 1754 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 15:47:17.289650 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-bb864fc5-a72d-4697-a712-05e38b57909b tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:47:17.290568 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-bb864fc5-a72d-4697-a712-05e38b57909b tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: 62c89161-c119-48b2-839d-712db798ff96] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:47:17.297814 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-bb864fc5-a72d-4697-a712-05e38b57909b tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:47:17.298248 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-bb864fc5-a72d-4697-a712-05e38b57909b tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:47:17.299003 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-bb864fc5-a72d-4697-a712-05e38b57909b tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:47:17.299425 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-bb864fc5-a72d-4697-a712-05e38b57909b tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:47:17.327018 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-bb864fc5-a72d-4697-a712-05e38b57909b tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041163 Oct 27 15:47:17.327597 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 354/789] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Oct 27 15:47:17 2021] GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 15:47:18.133915 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-54ca5bdd-ffbd-4f54-8f74-a43e462c7d19 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:47:18.134514 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-54ca5bdd-ffbd-4f54-8f74-a43e462c7d19 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:47:18.141600 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-54ca5bdd-ffbd-4f54-8f74-a43e462c7d19 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:47:18.142041 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-54ca5bdd-ffbd-4f54-8f74-a43e462c7d19 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:47:18.142807 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-54ca5bdd-ffbd-4f54-8f74-a43e462c7d19 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:47:18.143239 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-54ca5bdd-ffbd-4f54-8f74-a43e462c7d19 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:47:18.261293 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-54ca5bdd-ffbd-4f54-8f74-a43e462c7d19 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:47:18.270103 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-54ca5bdd-ffbd-4f54-8f74-a43e462c7d19 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:47:18.271594 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-54ca5bdd-ffbd-4f54-8f74-a43e462c7d19 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:47:18.272796 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-54ca5bdd-ffbd-4f54-8f74-a43e462c7d19 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672" status: 200 len: 1754 microversion: 2.20 time: 0.142579 Oct 27 15:47:18.273385 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 436/790] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Oct 27 15:47:18 2021] GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672 => generated 1754 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 15:47:18.338130 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-f64c3ea9-8faf-4c82-993a-d9691e3eec64 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:47:18.339030 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-f64c3ea9-8faf-4c82-993a-d9691e3eec64 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: 62c89161-c119-48b2-839d-712db798ff96] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:47:18.345753 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-f64c3ea9-8faf-4c82-993a-d9691e3eec64 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:47:18.346190 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-f64c3ea9-8faf-4c82-993a-d9691e3eec64 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:47:18.347189 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-f64c3ea9-8faf-4c82-993a-d9691e3eec64 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:47:18.347614 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-f64c3ea9-8faf-4c82-993a-d9691e3eec64 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:47:18.377327 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-f64c3ea9-8faf-4c82-993a-d9691e3eec64 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042991 Oct 27 15:47:18.377878 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 355/791] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Oct 27 15:47:18 2021] GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 15:47:19.290722 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-a4e288ca-20f8-4e01-bb89-bcbf8945029a tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:47:19.291332 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-a4e288ca-20f8-4e01-bb89-bcbf8945029a tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:47:19.297500 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-a4e288ca-20f8-4e01-bb89-bcbf8945029a tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:47:19.297940 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-a4e288ca-20f8-4e01-bb89-bcbf8945029a tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:47:19.298699 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-a4e288ca-20f8-4e01-bb89-bcbf8945029a tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:47:19.299130 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-a4e288ca-20f8-4e01-bb89-bcbf8945029a tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:47:19.388866 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-f5ac18bf-30d9-4fbe-8668-a74937f87d44 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:47:19.389761 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-f5ac18bf-30d9-4fbe-8668-a74937f87d44 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: 62c89161-c119-48b2-839d-712db798ff96] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:47:19.396615 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-f5ac18bf-30d9-4fbe-8668-a74937f87d44 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:47:19.397054 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-f5ac18bf-30d9-4fbe-8668-a74937f87d44 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:47:19.397812 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-f5ac18bf-30d9-4fbe-8668-a74937f87d44 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:47:19.398274 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-f5ac18bf-30d9-4fbe-8668-a74937f87d44 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:47:19.417552 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-a4e288ca-20f8-4e01-bb89-bcbf8945029a tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:47:19.426639 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-a4e288ca-20f8-4e01-bb89-bcbf8945029a tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:47:19.428230 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-a4e288ca-20f8-4e01-bb89-bcbf8945029a tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:47:19.428356 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-f5ac18bf-30d9-4fbe-8668-a74937f87d44 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043204 Oct 27 15:47:19.428889 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 356/792] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Oct 27 15:47:19 2021] GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 15:47:19.429378 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-a4e288ca-20f8-4e01-bb89-bcbf8945029a tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672" status: 200 len: 1754 microversion: 2.20 time: 0.142381 Oct 27 15:47:19.429941 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 437/793] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Oct 27 15:47:19 2021] GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672 => generated 1754 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 15:47:20.439725 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-ae87671c-af29-4cfb-8038-e67a8084411b tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:47:20.440692 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-ae87671c-af29-4cfb-8038-e67a8084411b tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: 62c89161-c119-48b2-839d-712db798ff96] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:47:20.446909 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-ae87671c-af29-4cfb-8038-e67a8084411b tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:47:20.447353 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-ae87671c-af29-4cfb-8038-e67a8084411b tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:47:20.447764 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-456754e5-ae71-40c6-a083-6ad10307370c tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:47:20.448192 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-ae87671c-af29-4cfb-8038-e67a8084411b tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:47:20.448408 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-456754e5-ae71-40c6-a083-6ad10307370c tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:47:20.448575 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-ae87671c-af29-4cfb-8038-e67a8084411b tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:47:20.454658 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-456754e5-ae71-40c6-a083-6ad10307370c tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:47:20.455100 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-456754e5-ae71-40c6-a083-6ad10307370c tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:47:20.455879 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-456754e5-ae71-40c6-a083-6ad10307370c tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:47:20.456319 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-456754e5-ae71-40c6-a083-6ad10307370c tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:47:20.478206 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-ae87671c-af29-4cfb-8038-e67a8084411b tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042215 Oct 27 15:47:20.478777 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 357/794] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Oct 27 15:47:20 2021] GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 15:47:20.580215 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-456754e5-ae71-40c6-a083-6ad10307370c tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:47:20.588931 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-456754e5-ae71-40c6-a083-6ad10307370c tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:47:20.590451 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-456754e5-ae71-40c6-a083-6ad10307370c tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:47:20.591633 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-456754e5-ae71-40c6-a083-6ad10307370c tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672" status: 200 len: 1754 microversion: 2.20 time: 0.147585 Oct 27 15:47:20.592465 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 438/795] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Oct 27 15:47:20 2021] GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672 => generated 1754 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 15:47:21.490088 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-d9a5e9da-33cd-4a7e-bde7-2b5bbab8cb92 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:47:21.490906 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-d9a5e9da-33cd-4a7e-bde7-2b5bbab8cb92 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: 62c89161-c119-48b2-839d-712db798ff96] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:47:21.497042 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-d9a5e9da-33cd-4a7e-bde7-2b5bbab8cb92 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:47:21.497486 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-d9a5e9da-33cd-4a7e-bde7-2b5bbab8cb92 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:47:21.498243 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-d9a5e9da-33cd-4a7e-bde7-2b5bbab8cb92 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:47:21.498672 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-d9a5e9da-33cd-4a7e-bde7-2b5bbab8cb92 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:47:21.527117 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-d9a5e9da-33cd-4a7e-bde7-2b5bbab8cb92 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040938 Oct 27 15:47:21.527659 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 358/796] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Oct 27 15:47:21 2021] GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 15:47:21.610266 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-e984ee8e-3b8a-43d2-9ecd-c32d5694609b tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:47:21.610907 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-e984ee8e-3b8a-43d2-9ecd-c32d5694609b tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:47:21.617108 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-e984ee8e-3b8a-43d2-9ecd-c32d5694609b tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:47:21.617557 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-e984ee8e-3b8a-43d2-9ecd-c32d5694609b tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:47:21.618324 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-e984ee8e-3b8a-43d2-9ecd-c32d5694609b tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:47:21.618758 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-e984ee8e-3b8a-43d2-9ecd-c32d5694609b tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:47:21.737517 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-e984ee8e-3b8a-43d2-9ecd-c32d5694609b tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:47:21.745520 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-e984ee8e-3b8a-43d2-9ecd-c32d5694609b tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:47:21.746934 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-e984ee8e-3b8a-43d2-9ecd-c32d5694609b tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:47:21.748090 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-e984ee8e-3b8a-43d2-9ecd-c32d5694609b tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672" status: 200 len: 1754 microversion: 2.20 time: 0.141592 Oct 27 15:47:21.748642 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 439/797] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Oct 27 15:47:21 2021] GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672 => generated 1754 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 15:47:22.538427 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-30196104-060c-4404-bd62-9ef10ced9cfa tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:47:22.539324 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-30196104-060c-4404-bd62-9ef10ced9cfa tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: 62c89161-c119-48b2-839d-712db798ff96] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:47:22.545416 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-30196104-060c-4404-bd62-9ef10ced9cfa tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:47:22.545854 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-30196104-060c-4404-bd62-9ef10ced9cfa tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:47:22.547255 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-30196104-060c-4404-bd62-9ef10ced9cfa tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:47:22.547679 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-30196104-060c-4404-bd62-9ef10ced9cfa tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:47:22.575299 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-30196104-060c-4404-bd62-9ef10ced9cfa tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040628 Oct 27 15:47:22.575841 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 359/798] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Oct 27 15:47:22 2021] GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 15:47:22.766710 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-7161bb8d-82fd-431c-8720-a1e23071921d tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:47:22.767213 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-7161bb8d-82fd-431c-8720-a1e23071921d tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:47:22.773066 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-7161bb8d-82fd-431c-8720-a1e23071921d tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:47:22.773508 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-7161bb8d-82fd-431c-8720-a1e23071921d tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:47:22.774266 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-7161bb8d-82fd-431c-8720-a1e23071921d tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:47:22.774697 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-7161bb8d-82fd-431c-8720-a1e23071921d tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:47:22.892404 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-7161bb8d-82fd-431c-8720-a1e23071921d tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:47:22.900531 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-7161bb8d-82fd-431c-8720-a1e23071921d tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:47:22.902031 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-7161bb8d-82fd-431c-8720-a1e23071921d tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:47:22.903183 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-7161bb8d-82fd-431c-8720-a1e23071921d tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672" status: 200 len: 1754 microversion: 2.20 time: 0.140458 Oct 27 15:47:22.903751 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 440/799] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Oct 27 15:47:22 2021] GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672 => generated 1754 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 15:47:23.585685 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-7c38a410-0bc5-407d-9fb1-2d084279e475 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:47:23.586608 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-7c38a410-0bc5-407d-9fb1-2d084279e475 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: 62c89161-c119-48b2-839d-712db798ff96] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:47:23.592771 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-7c38a410-0bc5-407d-9fb1-2d084279e475 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:47:23.594197 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-7c38a410-0bc5-407d-9fb1-2d084279e475 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:47:23.595056 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-7c38a410-0bc5-407d-9fb1-2d084279e475 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:47:23.595491 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-7c38a410-0bc5-407d-9fb1-2d084279e475 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:47:23.624105 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-7c38a410-0bc5-407d-9fb1-2d084279e475 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042104 Oct 27 15:47:23.625245 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 360/800] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Oct 27 15:47:23 2021] GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 15:47:23.921734 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-72ea0b10-37e0-42a2-8ae5-09d2daeeaecb tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:47:23.922338 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-72ea0b10-37e0-42a2-8ae5-09d2daeeaecb tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:47:23.929006 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-72ea0b10-37e0-42a2-8ae5-09d2daeeaecb tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:47:23.929006 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-72ea0b10-37e0-42a2-8ae5-09d2daeeaecb tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:47:23.929762 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-72ea0b10-37e0-42a2-8ae5-09d2daeeaecb tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:47:23.930194 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-72ea0b10-37e0-42a2-8ae5-09d2daeeaecb tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:47:24.052200 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-72ea0b10-37e0-42a2-8ae5-09d2daeeaecb tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:47:24.060233 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-72ea0b10-37e0-42a2-8ae5-09d2daeeaecb tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:47:24.062227 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-72ea0b10-37e0-42a2-8ae5-09d2daeeaecb tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:47:24.063498 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-72ea0b10-37e0-42a2-8ae5-09d2daeeaecb tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672" status: 200 len: 1754 microversion: 2.20 time: 0.145561 Oct 27 15:47:24.064082 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 441/801] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Oct 27 15:47:23 2021] GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672 => generated 1754 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 15:47:24.635963 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-2477bd8f-cb59-4bfa-8b7d-b2e19296d27c tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:47:24.636855 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-2477bd8f-cb59-4bfa-8b7d-b2e19296d27c tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: 62c89161-c119-48b2-839d-712db798ff96] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:47:24.643181 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-2477bd8f-cb59-4bfa-8b7d-b2e19296d27c tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:47:24.643618 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-2477bd8f-cb59-4bfa-8b7d-b2e19296d27c tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:47:24.644390 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-2477bd8f-cb59-4bfa-8b7d-b2e19296d27c tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:47:24.644813 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-2477bd8f-cb59-4bfa-8b7d-b2e19296d27c tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:47:24.672535 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-2477bd8f-cb59-4bfa-8b7d-b2e19296d27c tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040344 Oct 27 15:47:24.673071 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 361/802] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Oct 27 15:47:24 2021] GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 15:47:25.083494 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-bd022986-ae7e-4278-84c7-483b381578fe tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:47:25.084352 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-bd022986-ae7e-4278-84c7-483b381578fe tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:47:25.091136 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-bd022986-ae7e-4278-84c7-483b381578fe tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:47:25.091581 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-bd022986-ae7e-4278-84c7-483b381578fe tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:47:25.092383 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-bd022986-ae7e-4278-84c7-483b381578fe tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:47:25.092818 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-bd022986-ae7e-4278-84c7-483b381578fe tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:47:25.213551 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-bd022986-ae7e-4278-84c7-483b381578fe tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:47:25.222641 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-bd022986-ae7e-4278-84c7-483b381578fe tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:47:25.224156 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-bd022986-ae7e-4278-84c7-483b381578fe tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:47:25.225314 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-bd022986-ae7e-4278-84c7-483b381578fe tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672" status: 200 len: 1754 microversion: 2.20 time: 0.146741 Oct 27 15:47:25.225867 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 442/803] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Oct 27 15:47:25 2021] GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672 => generated 1754 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 15:47:25.683910 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-9d9aa86e-f4e0-4598-938e-c25da9e09edc tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:47:25.684717 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-9d9aa86e-f4e0-4598-938e-c25da9e09edc tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: 62c89161-c119-48b2-839d-712db798ff96] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:47:25.691526 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-9d9aa86e-f4e0-4598-938e-c25da9e09edc tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:47:25.691994 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-9d9aa86e-f4e0-4598-938e-c25da9e09edc tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:47:25.692758 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-9d9aa86e-f4e0-4598-938e-c25da9e09edc tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:47:25.693183 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-9d9aa86e-f4e0-4598-938e-c25da9e09edc tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:47:25.724456 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-9d9aa86e-f4e0-4598-938e-c25da9e09edc tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044343 Oct 27 15:47:25.725004 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 362/804] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Oct 27 15:47:25 2021] GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 15:47:26.243011 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-e273ec69-1bc9-44f9-9546-c8299e3955a1 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:47:26.243607 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-e273ec69-1bc9-44f9-9546-c8299e3955a1 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:47:26.250054 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-e273ec69-1bc9-44f9-9546-c8299e3955a1 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:47:26.251879 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-e273ec69-1bc9-44f9-9546-c8299e3955a1 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:47:26.252678 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-e273ec69-1bc9-44f9-9546-c8299e3955a1 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:47:26.253109 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-e273ec69-1bc9-44f9-9546-c8299e3955a1 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:47:26.372545 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-e273ec69-1bc9-44f9-9546-c8299e3955a1 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:47:26.380781 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-e273ec69-1bc9-44f9-9546-c8299e3955a1 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:47:26.382276 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-e273ec69-1bc9-44f9-9546-c8299e3955a1 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:47:26.383417 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-e273ec69-1bc9-44f9-9546-c8299e3955a1 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672" status: 200 len: 1754 microversion: 2.20 time: 0.144143 Oct 27 15:47:26.384084 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 443/805] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Oct 27 15:47:26 2021] GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672 => generated 1754 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 15:47:26.736039 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-d717650b-4b4e-461a-8c21-a4aa15d447dc tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:47:26.736895 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-d717650b-4b4e-461a-8c21-a4aa15d447dc tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: 62c89161-c119-48b2-839d-712db798ff96] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:47:26.742970 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-d717650b-4b4e-461a-8c21-a4aa15d447dc tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:47:26.743410 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-d717650b-4b4e-461a-8c21-a4aa15d447dc tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:47:26.744196 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-d717650b-4b4e-461a-8c21-a4aa15d447dc tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:47:26.744625 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-d717650b-4b4e-461a-8c21-a4aa15d447dc tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:47:26.772341 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-d717650b-4b4e-461a-8c21-a4aa15d447dc tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040798 Oct 27 15:47:26.772886 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 363/806] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Oct 27 15:47:26 2021] GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 15:47:27.401676 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-5683154d-cefa-4757-8b84-f68efae79205 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:47:27.402280 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-5683154d-cefa-4757-8b84-f68efae79205 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:47:27.409321 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-5683154d-cefa-4757-8b84-f68efae79205 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:47:27.409764 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-5683154d-cefa-4757-8b84-f68efae79205 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:47:27.410529 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-5683154d-cefa-4757-8b84-f68efae79205 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:47:27.410960 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-5683154d-cefa-4757-8b84-f68efae79205 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:47:27.534589 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-5683154d-cefa-4757-8b84-f68efae79205 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:47:27.542554 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-5683154d-cefa-4757-8b84-f68efae79205 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:47:27.544052 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-5683154d-cefa-4757-8b84-f68efae79205 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:47:27.545187 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-5683154d-cefa-4757-8b84-f68efae79205 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672" status: 200 len: 1754 microversion: 2.20 time: 0.147207 Oct 27 15:47:27.545740 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 444/807] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Oct 27 15:47:27 2021] GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672 => generated 1754 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 15:47:27.784817 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-7fe7b830-f9e8-4a0b-973e-c7e2272794ba tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:47:27.785729 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-7fe7b830-f9e8-4a0b-973e-c7e2272794ba tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: 62c89161-c119-48b2-839d-712db798ff96] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:47:27.791935 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-7fe7b830-f9e8-4a0b-973e-c7e2272794ba tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:47:27.792376 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-7fe7b830-f9e8-4a0b-973e-c7e2272794ba tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:47:27.793128 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-7fe7b830-f9e8-4a0b-973e-c7e2272794ba tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:47:27.793552 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-7fe7b830-f9e8-4a0b-973e-c7e2272794ba tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:47:27.822281 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-7fe7b830-f9e8-4a0b-973e-c7e2272794ba tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042322 Oct 27 15:47:27.822818 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 364/808] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Oct 27 15:47:27 2021] GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 15:47:28.562869 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-92dfab8e-131c-4a92-a0aa-27f9d1a8af9c tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:47:28.564361 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-92dfab8e-131c-4a92-a0aa-27f9d1a8af9c tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:47:28.570786 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-92dfab8e-131c-4a92-a0aa-27f9d1a8af9c tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:47:28.571220 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-92dfab8e-131c-4a92-a0aa-27f9d1a8af9c tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:47:28.572033 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-92dfab8e-131c-4a92-a0aa-27f9d1a8af9c tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:47:28.572491 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-92dfab8e-131c-4a92-a0aa-27f9d1a8af9c tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:47:28.691773 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-92dfab8e-131c-4a92-a0aa-27f9d1a8af9c tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:47:28.699832 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-92dfab8e-131c-4a92-a0aa-27f9d1a8af9c tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:47:28.701369 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-92dfab8e-131c-4a92-a0aa-27f9d1a8af9c tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:47:28.702540 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-92dfab8e-131c-4a92-a0aa-27f9d1a8af9c tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672" status: 200 len: 1754 microversion: 2.20 time: 0.143275 Oct 27 15:47:28.703096 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 445/809] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Oct 27 15:47:28 2021] GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672 => generated 1754 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 15:47:28.833493 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-80dff337-7c9e-4898-8c8a-262e901cb662 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:47:28.834389 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-80dff337-7c9e-4898-8c8a-262e901cb662 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: 62c89161-c119-48b2-839d-712db798ff96] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:47:28.840651 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-80dff337-7c9e-4898-8c8a-262e901cb662 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:47:28.841275 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-80dff337-7c9e-4898-8c8a-262e901cb662 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:47:28.842047 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-80dff337-7c9e-4898-8c8a-262e901cb662 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:47:28.842479 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-80dff337-7c9e-4898-8c8a-262e901cb662 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:47:28.871634 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-80dff337-7c9e-4898-8c8a-262e901cb662 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041933 Oct 27 15:47:28.872224 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 365/810] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Oct 27 15:47:28 2021] GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 15:47:29.720687 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-87ed9aec-4a19-49f7-8c5e-e0b9ea4648df tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:47:29.721303 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-87ed9aec-4a19-49f7-8c5e-e0b9ea4648df tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:47:29.727692 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-87ed9aec-4a19-49f7-8c5e-e0b9ea4648df tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:47:29.728176 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-87ed9aec-4a19-49f7-8c5e-e0b9ea4648df tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:47:29.728935 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-87ed9aec-4a19-49f7-8c5e-e0b9ea4648df tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:47:29.729366 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-87ed9aec-4a19-49f7-8c5e-e0b9ea4648df tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:47:29.847614 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-87ed9aec-4a19-49f7-8c5e-e0b9ea4648df tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:47:29.855722 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-87ed9aec-4a19-49f7-8c5e-e0b9ea4648df tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:47:29.857256 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-87ed9aec-4a19-49f7-8c5e-e0b9ea4648df tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:47:29.858411 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-87ed9aec-4a19-49f7-8c5e-e0b9ea4648df tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672" status: 200 len: 1754 microversion: 2.20 time: 0.141724 Oct 27 15:47:29.858974 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 446/811] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Oct 27 15:47:29 2021] GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672 => generated 1754 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 15:47:29.882903 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-f3e60847-51f2-4b65-bb45-e64c9b8698e5 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:47:29.883806 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-f3e60847-51f2-4b65-bb45-e64c9b8698e5 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: 62c89161-c119-48b2-839d-712db798ff96] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:47:29.890006 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-f3e60847-51f2-4b65-bb45-e64c9b8698e5 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:47:29.890446 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-f3e60847-51f2-4b65-bb45-e64c9b8698e5 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:47:29.891206 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-f3e60847-51f2-4b65-bb45-e64c9b8698e5 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:47:29.892383 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-f3e60847-51f2-4b65-bb45-e64c9b8698e5 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:47:29.920734 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-f3e60847-51f2-4b65-bb45-e64c9b8698e5 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041586 Oct 27 15:47:29.921297 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 366/812] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Oct 27 15:47:29 2021] GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 15:47:30.876358 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-7e5a2df7-065a-484e-b301-056bcd732c23 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:47:30.876912 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-7e5a2df7-065a-484e-b301-056bcd732c23 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:47:30.883167 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-7e5a2df7-065a-484e-b301-056bcd732c23 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:47:30.883608 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-7e5a2df7-065a-484e-b301-056bcd732c23 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:47:30.884515 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-7e5a2df7-065a-484e-b301-056bcd732c23 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:47:30.884951 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-7e5a2df7-065a-484e-b301-056bcd732c23 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:47:30.932495 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-e7f707f0-b09d-40c0-b7f1-1d47770864f4 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:47:30.933851 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-e7f707f0-b09d-40c0-b7f1-1d47770864f4 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: 62c89161-c119-48b2-839d-712db798ff96] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:47:30.942623 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-e7f707f0-b09d-40c0-b7f1-1d47770864f4 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:47:30.943054 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-e7f707f0-b09d-40c0-b7f1-1d47770864f4 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:47:30.943814 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-e7f707f0-b09d-40c0-b7f1-1d47770864f4 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:47:30.944268 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-e7f707f0-b09d-40c0-b7f1-1d47770864f4 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:47:30.973217 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-e7f707f0-b09d-40c0-b7f1-1d47770864f4 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044594 Oct 27 15:47:30.974042 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 367/813] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Oct 27 15:47:30 2021] GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 15:47:31.012624 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-7e5a2df7-065a-484e-b301-056bcd732c23 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:47:31.021066 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-7e5a2df7-065a-484e-b301-056bcd732c23 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:47:31.022570 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-7e5a2df7-065a-484e-b301-056bcd732c23 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:47:31.023719 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-7e5a2df7-065a-484e-b301-056bcd732c23 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672" status: 200 len: 1754 microversion: 2.20 time: 0.151118 Oct 27 15:47:31.024308 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 447/814] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Oct 27 15:47:30 2021] GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672 => generated 1754 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 15:47:31.984494 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-d057d758-1b9d-4369-80b9-082dd4088466 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:47:31.985508 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-d057d758-1b9d-4369-80b9-082dd4088466 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: 62c89161-c119-48b2-839d-712db798ff96] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:47:31.991760 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-d057d758-1b9d-4369-80b9-082dd4088466 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:47:31.992251 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-d057d758-1b9d-4369-80b9-082dd4088466 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:47:31.993017 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-d057d758-1b9d-4369-80b9-082dd4088466 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:47:31.993451 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-d057d758-1b9d-4369-80b9-082dd4088466 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:47:32.024456 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-d057d758-1b9d-4369-80b9-082dd4088466 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043697 Oct 27 15:47:32.025009 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 368/815] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Oct 27 15:47:31 2021] GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 15:47:32.040689 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-64f1cf34-e369-4099-b460-2d2b483ccade tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:47:32.041313 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-64f1cf34-e369-4099-b460-2d2b483ccade tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:47:32.047456 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-64f1cf34-e369-4099-b460-2d2b483ccade tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:47:32.047932 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-64f1cf34-e369-4099-b460-2d2b483ccade tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:47:32.048693 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-64f1cf34-e369-4099-b460-2d2b483ccade tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:47:32.049128 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-64f1cf34-e369-4099-b460-2d2b483ccade tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:47:32.170314 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-64f1cf34-e369-4099-b460-2d2b483ccade tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:47:32.179051 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-64f1cf34-e369-4099-b460-2d2b483ccade tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:47:32.180579 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-64f1cf34-e369-4099-b460-2d2b483ccade tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:47:32.181727 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-64f1cf34-e369-4099-b460-2d2b483ccade tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672" status: 200 len: 1754 microversion: 2.20 time: 0.144691 Oct 27 15:47:32.182284 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 448/816] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Oct 27 15:47:32 2021] GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672 => generated 1754 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 15:47:33.036344 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-b5d0bfdd-6d3f-49cd-8ce9-167cd3a03f57 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:47:33.037244 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-b5d0bfdd-6d3f-49cd-8ce9-167cd3a03f57 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: 62c89161-c119-48b2-839d-712db798ff96] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:47:33.043445 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-b5d0bfdd-6d3f-49cd-8ce9-167cd3a03f57 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:47:33.043916 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-b5d0bfdd-6d3f-49cd-8ce9-167cd3a03f57 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:47:33.044680 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-b5d0bfdd-6d3f-49cd-8ce9-167cd3a03f57 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:47:33.045111 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-b5d0bfdd-6d3f-49cd-8ce9-167cd3a03f57 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:47:33.074185 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-b5d0bfdd-6d3f-49cd-8ce9-167cd3a03f57 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042061 Oct 27 15:47:33.074734 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 369/817] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Oct 27 15:47:33 2021] GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 15:47:33.199982 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-93d63fa3-9133-4828-9b25-07c2d2bc9c33 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:47:33.200592 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-93d63fa3-9133-4828-9b25-07c2d2bc9c33 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:47:33.206964 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-93d63fa3-9133-4828-9b25-07c2d2bc9c33 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:47:33.207411 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-93d63fa3-9133-4828-9b25-07c2d2bc9c33 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:47:33.208241 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-93d63fa3-9133-4828-9b25-07c2d2bc9c33 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:47:33.208676 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-93d63fa3-9133-4828-9b25-07c2d2bc9c33 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:47:33.326657 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-93d63fa3-9133-4828-9b25-07c2d2bc9c33 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:47:33.334684 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-93d63fa3-9133-4828-9b25-07c2d2bc9c33 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:47:33.336194 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-93d63fa3-9133-4828-9b25-07c2d2bc9c33 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:47:33.337344 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-93d63fa3-9133-4828-9b25-07c2d2bc9c33 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672" status: 200 len: 1754 microversion: 2.20 time: 0.141434 Oct 27 15:47:33.337894 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 449/818] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Oct 27 15:47:33 2021] GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672 => generated 1754 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 15:47:34.086021 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-c8dd17a9-80ac-4a0d-92dd-4b5934d71a0a tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:47:34.086919 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-c8dd17a9-80ac-4a0d-92dd-4b5934d71a0a tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: 62c89161-c119-48b2-839d-712db798ff96] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:47:34.093046 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-c8dd17a9-80ac-4a0d-92dd-4b5934d71a0a tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:47:34.093485 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-c8dd17a9-80ac-4a0d-92dd-4b5934d71a0a tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:47:34.094236 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-c8dd17a9-80ac-4a0d-92dd-4b5934d71a0a tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:47:34.095354 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-c8dd17a9-80ac-4a0d-92dd-4b5934d71a0a tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:47:34.122907 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-c8dd17a9-80ac-4a0d-92dd-4b5934d71a0a tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040669 Oct 27 15:47:34.123448 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 370/819] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Oct 27 15:47:34 2021] GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 15:47:34.355812 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-185e8125-3f7f-4d50-b295-7dc5931d7ec5 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:47:34.356437 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-185e8125-3f7f-4d50-b295-7dc5931d7ec5 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:47:34.362592 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-185e8125-3f7f-4d50-b295-7dc5931d7ec5 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:47:34.363030 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-185e8125-3f7f-4d50-b295-7dc5931d7ec5 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:47:34.363786 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-185e8125-3f7f-4d50-b295-7dc5931d7ec5 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:47:34.364242 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-185e8125-3f7f-4d50-b295-7dc5931d7ec5 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:47:34.489872 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-185e8125-3f7f-4d50-b295-7dc5931d7ec5 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:47:34.498018 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-185e8125-3f7f-4d50-b295-7dc5931d7ec5 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:47:34.499511 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-185e8125-3f7f-4d50-b295-7dc5931d7ec5 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:47:34.500687 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-185e8125-3f7f-4d50-b295-7dc5931d7ec5 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672" status: 200 len: 1754 microversion: 2.20 time: 0.148601 Oct 27 15:47:34.501247 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 450/820] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Oct 27 15:47:34 2021] GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672 => generated 1754 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 15:47:35.134625 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-9902e191-41e1-4858-a2e6-46a55ca5369d tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:47:35.135441 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-9902e191-41e1-4858-a2e6-46a55ca5369d tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: 62c89161-c119-48b2-839d-712db798ff96] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:47:35.141679 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-9902e191-41e1-4858-a2e6-46a55ca5369d tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:47:35.142115 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-9902e191-41e1-4858-a2e6-46a55ca5369d tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:47:35.143415 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-9902e191-41e1-4858-a2e6-46a55ca5369d tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:47:35.143873 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-9902e191-41e1-4858-a2e6-46a55ca5369d tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:47:35.172225 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-9902e191-41e1-4858-a2e6-46a55ca5369d tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041370 Oct 27 15:47:35.172765 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 371/821] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Oct 27 15:47:35 2021] GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 15:47:35.519669 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-8d7697e8-e24d-4196-afc2-118dfee7e0c6 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:47:35.520277 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-8d7697e8-e24d-4196-afc2-118dfee7e0c6 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:47:35.526467 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-8d7697e8-e24d-4196-afc2-118dfee7e0c6 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:47:35.526908 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-8d7697e8-e24d-4196-afc2-118dfee7e0c6 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:47:35.527670 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-8d7697e8-e24d-4196-afc2-118dfee7e0c6 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:47:35.528128 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-8d7697e8-e24d-4196-afc2-118dfee7e0c6 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:47:35.753581 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-8d7697e8-e24d-4196-afc2-118dfee7e0c6 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:47:35.761578 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-8d7697e8-e24d-4196-afc2-118dfee7e0c6 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:47:35.763069 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-8d7697e8-e24d-4196-afc2-118dfee7e0c6 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:47:35.764247 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-8d7697e8-e24d-4196-afc2-118dfee7e0c6 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672" status: 200 len: 1754 microversion: 2.20 time: 0.248787 Oct 27 15:47:35.764801 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 451/822] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Oct 27 15:47:35 2021] GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672 => generated 1754 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 15:47:36.184376 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-26acf11a-e1d3-47a1-a4fb-36e899e895c8 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:47:36.185203 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-26acf11a-e1d3-47a1-a4fb-36e899e895c8 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: 62c89161-c119-48b2-839d-712db798ff96] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:47:36.192112 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-26acf11a-e1d3-47a1-a4fb-36e899e895c8 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:47:36.192557 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-26acf11a-e1d3-47a1-a4fb-36e899e895c8 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:47:36.193317 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-26acf11a-e1d3-47a1-a4fb-36e899e895c8 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:47:36.193748 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-26acf11a-e1d3-47a1-a4fb-36e899e895c8 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:47:36.222212 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-26acf11a-e1d3-47a1-a4fb-36e899e895c8 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041674 Oct 27 15:47:36.222754 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 372/823] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Oct 27 15:47:36 2021] GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 15:47:36.782184 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-10f87b59-8847-49b5-b33b-275231eb4f58 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:47:36.782791 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-10f87b59-8847-49b5-b33b-275231eb4f58 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:47:36.789647 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-10f87b59-8847-49b5-b33b-275231eb4f58 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:47:36.790093 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-10f87b59-8847-49b5-b33b-275231eb4f58 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:47:36.790858 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-10f87b59-8847-49b5-b33b-275231eb4f58 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:47:36.791290 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-10f87b59-8847-49b5-b33b-275231eb4f58 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:47:36.912905 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-10f87b59-8847-49b5-b33b-275231eb4f58 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:47:36.921787 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-10f87b59-8847-49b5-b33b-275231eb4f58 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:47:36.923281 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-10f87b59-8847-49b5-b33b-275231eb4f58 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:47:36.924543 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-10f87b59-8847-49b5-b33b-275231eb4f58 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672" status: 200 len: 1754 microversion: 2.20 time: 0.146087 Oct 27 15:47:36.925247 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 452/824] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Oct 27 15:47:36 2021] GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672 => generated 1754 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 15:47:37.233631 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-88d0d083-ecd2-45f4-a3c6-222cb6190627 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:47:37.234540 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-88d0d083-ecd2-45f4-a3c6-222cb6190627 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: 62c89161-c119-48b2-839d-712db798ff96] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:47:37.240798 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-88d0d083-ecd2-45f4-a3c6-222cb6190627 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:47:37.241240 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-88d0d083-ecd2-45f4-a3c6-222cb6190627 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:47:37.241995 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-88d0d083-ecd2-45f4-a3c6-222cb6190627 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:47:37.242426 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-88d0d083-ecd2-45f4-a3c6-222cb6190627 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:47:37.271602 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-88d0d083-ecd2-45f4-a3c6-222cb6190627 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041833 Oct 27 15:47:37.272188 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 373/825] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Oct 27 15:47:37 2021] GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 15:47:37.942137 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-3f9a2f97-0139-4e8b-b4bb-b2016f3808b2 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:47:37.942845 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-3f9a2f97-0139-4e8b-b4bb-b2016f3808b2 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:47:37.949137 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-3f9a2f97-0139-4e8b-b4bb-b2016f3808b2 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:47:37.949585 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-3f9a2f97-0139-4e8b-b4bb-b2016f3808b2 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:47:37.950380 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-3f9a2f97-0139-4e8b-b4bb-b2016f3808b2 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:47:37.950798 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-3f9a2f97-0139-4e8b-b4bb-b2016f3808b2 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:47:38.079234 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-3f9a2f97-0139-4e8b-b4bb-b2016f3808b2 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:47:38.087424 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-3f9a2f97-0139-4e8b-b4bb-b2016f3808b2 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:47:38.088935 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-3f9a2f97-0139-4e8b-b4bb-b2016f3808b2 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:47:38.090077 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-3f9a2f97-0139-4e8b-b4bb-b2016f3808b2 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672" status: 200 len: 1754 microversion: 2.20 time: 0.151665 Oct 27 15:47:38.090638 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 453/826] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Oct 27 15:47:37 2021] GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672 => generated 1754 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 15:47:38.285518 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-7eeb2502-8081-4855-b02f-1255d0dd3524 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:47:38.286722 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-7eeb2502-8081-4855-b02f-1255d0dd3524 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: 62c89161-c119-48b2-839d-712db798ff96] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:47:38.293765 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-7eeb2502-8081-4855-b02f-1255d0dd3524 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:47:38.294152 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-7eeb2502-8081-4855-b02f-1255d0dd3524 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:47:38.294920 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-7eeb2502-8081-4855-b02f-1255d0dd3524 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:47:38.295353 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-7eeb2502-8081-4855-b02f-1255d0dd3524 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:47:38.324537 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-7eeb2502-8081-4855-b02f-1255d0dd3524 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044846 Oct 27 15:47:38.325107 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 374/827] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Oct 27 15:47:38 2021] GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 15:47:39.109101 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-0d02cf0b-5315-408a-b9ca-25a663394b79 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:47:39.109636 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-0d02cf0b-5315-408a-b9ca-25a663394b79 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:47:39.116168 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-0d02cf0b-5315-408a-b9ca-25a663394b79 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:47:39.116606 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-0d02cf0b-5315-408a-b9ca-25a663394b79 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:47:39.117375 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-0d02cf0b-5315-408a-b9ca-25a663394b79 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:47:39.117800 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-0d02cf0b-5315-408a-b9ca-25a663394b79 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:47:39.242008 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-0d02cf0b-5315-408a-b9ca-25a663394b79 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:47:39.250025 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-0d02cf0b-5315-408a-b9ca-25a663394b79 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:47:39.251502 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-0d02cf0b-5315-408a-b9ca-25a663394b79 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:47:39.252665 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-0d02cf0b-5315-408a-b9ca-25a663394b79 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672" status: 200 len: 1754 microversion: 2.20 time: 0.147514 Oct 27 15:47:39.253343 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 454/828] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Oct 27 15:47:39 2021] GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672 => generated 1754 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 15:47:39.336006 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-0c2c4af8-2c81-4e43-9285-6b952440fe2a tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:47:39.336904 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-0c2c4af8-2c81-4e43-9285-6b952440fe2a tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: 62c89161-c119-48b2-839d-712db798ff96] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:47:39.342979 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-0c2c4af8-2c81-4e43-9285-6b952440fe2a tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:47:39.343420 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-0c2c4af8-2c81-4e43-9285-6b952440fe2a tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:47:39.344204 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-0c2c4af8-2c81-4e43-9285-6b952440fe2a tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:47:39.344635 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-0c2c4af8-2c81-4e43-9285-6b952440fe2a tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:47:39.373846 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-0c2c4af8-2c81-4e43-9285-6b952440fe2a tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041619 Oct 27 15:47:39.374313 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 375/829] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Oct 27 15:47:39 2021] GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 15:47:40.271067 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-85de02c7-f9f2-4797-88d4-45b00050b87f tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:47:40.271662 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-85de02c7-f9f2-4797-88d4-45b00050b87f tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:47:40.277843 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-85de02c7-f9f2-4797-88d4-45b00050b87f tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:47:40.278285 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-85de02c7-f9f2-4797-88d4-45b00050b87f tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:47:40.279070 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-85de02c7-f9f2-4797-88d4-45b00050b87f tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:47:40.279495 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-85de02c7-f9f2-4797-88d4-45b00050b87f tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:47:40.385348 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-2afc99a9-5db0-4419-b8e9-941eb4f3d4ac tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:47:40.386346 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-2afc99a9-5db0-4419-b8e9-941eb4f3d4ac tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: 62c89161-c119-48b2-839d-712db798ff96] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:47:40.392624 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-2afc99a9-5db0-4419-b8e9-941eb4f3d4ac tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:47:40.393062 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-2afc99a9-5db0-4419-b8e9-941eb4f3d4ac tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:47:40.393813 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-2afc99a9-5db0-4419-b8e9-941eb4f3d4ac tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:47:40.395399 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-2afc99a9-5db0-4419-b8e9-941eb4f3d4ac tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:47:40.402696 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-85de02c7-f9f2-4797-88d4-45b00050b87f tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:47:40.411567 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-85de02c7-f9f2-4797-88d4-45b00050b87f tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:47:40.413370 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-85de02c7-f9f2-4797-88d4-45b00050b87f tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:47:40.414522 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-85de02c7-f9f2-4797-88d4-45b00050b87f tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672" status: 200 len: 1754 microversion: 2.20 time: 0.147827 Oct 27 15:47:40.415093 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 455/830] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Oct 27 15:47:40 2021] GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672 => generated 1754 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 15:47:40.424785 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-2afc99a9-5db0-4419-b8e9-941eb4f3d4ac tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043147 Oct 27 15:47:40.425881 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 376/831] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Oct 27 15:47:40 2021] GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 15:47:41.432238 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-4f885053-cdc7-41ce-9d6d-047ffaebe0e9 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:47:41.432843 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-4f885053-cdc7-41ce-9d6d-047ffaebe0e9 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:47:41.436748 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-bc188d7f-7542-4c5f-ab25-93a2259837f0 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:47:41.437639 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-bc188d7f-7542-4c5f-ab25-93a2259837f0 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: 62c89161-c119-48b2-839d-712db798ff96] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:47:41.438971 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-4f885053-cdc7-41ce-9d6d-047ffaebe0e9 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:47:41.439416 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-4f885053-cdc7-41ce-9d6d-047ffaebe0e9 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:47:41.440207 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-4f885053-cdc7-41ce-9d6d-047ffaebe0e9 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:47:41.440641 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-4f885053-cdc7-41ce-9d6d-047ffaebe0e9 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:47:41.444199 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-bc188d7f-7542-4c5f-ab25-93a2259837f0 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:47:41.444635 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-bc188d7f-7542-4c5f-ab25-93a2259837f0 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:47:41.445386 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-bc188d7f-7542-4c5f-ab25-93a2259837f0 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:47:41.445810 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-bc188d7f-7542-4c5f-ab25-93a2259837f0 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:47:41.476296 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-bc188d7f-7542-4c5f-ab25-93a2259837f0 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043206 Oct 27 15:47:41.476855 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 377/832] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Oct 27 15:47:41 2021] GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 15:47:41.562002 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-4f885053-cdc7-41ce-9d6d-047ffaebe0e9 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:47:41.570470 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-4f885053-cdc7-41ce-9d6d-047ffaebe0e9 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:47:41.571987 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-4f885053-cdc7-41ce-9d6d-047ffaebe0e9 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:47:41.573132 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-4f885053-cdc7-41ce-9d6d-047ffaebe0e9 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672" status: 200 len: 1754 microversion: 2.20 time: 0.144701 Oct 27 15:47:41.573684 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 456/833] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Oct 27 15:47:41 2021] GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672 => generated 1754 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 15:47:42.587497 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-18efd024-269d-4e6e-9b82-ee9f23ab2106 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:47:42.588591 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-18efd024-269d-4e6e-9b82-ee9f23ab2106 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: 62c89161-c119-48b2-839d-712db798ff96] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:47:42.593547 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-b9e5de8b-2aeb-4f4d-b846-d1802155c12b tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:47:42.594265 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-b9e5de8b-2aeb-4f4d-b846-d1802155c12b tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:47:42.594388 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-18efd024-269d-4e6e-9b82-ee9f23ab2106 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:47:42.594748 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-18efd024-269d-4e6e-9b82-ee9f23ab2106 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:47:42.595513 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-18efd024-269d-4e6e-9b82-ee9f23ab2106 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:47:42.595978 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-18efd024-269d-4e6e-9b82-ee9f23ab2106 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:47:42.600977 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-b9e5de8b-2aeb-4f4d-b846-d1802155c12b tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:47:42.601423 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-b9e5de8b-2aeb-4f4d-b846-d1802155c12b tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:47:42.602189 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-b9e5de8b-2aeb-4f4d-b846-d1802155c12b tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:47:42.602620 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-b9e5de8b-2aeb-4f4d-b846-d1802155c12b tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:47:42.625234 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-18efd024-269d-4e6e-9b82-ee9f23ab2106 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.141339 Oct 27 15:47:42.625799 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 378/834] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Oct 27 15:47:42 2021] GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments => generated 197 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 15:47:42.720773 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-b9e5de8b-2aeb-4f4d-b846-d1802155c12b tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:47:42.729795 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-b9e5de8b-2aeb-4f4d-b846-d1802155c12b tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:47:42.731269 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-b9e5de8b-2aeb-4f4d-b846-d1802155c12b tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:47:42.732436 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-b9e5de8b-2aeb-4f4d-b846-d1802155c12b tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672" status: 200 len: 1754 microversion: 2.20 time: 0.142588 Oct 27 15:47:42.732990 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 457/835] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Oct 27 15:47:42 2021] GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672 => generated 1754 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 15:47:43.636326 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-f4f57050-0899-436c-af70-4afdebece344 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:47:43.637255 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-f4f57050-0899-436c-af70-4afdebece344 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: 62c89161-c119-48b2-839d-712db798ff96] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:47:43.643367 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-f4f57050-0899-436c-af70-4afdebece344 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:47:43.643805 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-f4f57050-0899-436c-af70-4afdebece344 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:47:43.645092 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-f4f57050-0899-436c-af70-4afdebece344 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:47:43.645523 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-f4f57050-0899-436c-af70-4afdebece344 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:47:43.673974 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-f4f57050-0899-436c-af70-4afdebece344 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041420 Oct 27 15:47:43.674517 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 379/836] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Oct 27 15:47:43 2021] GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 15:47:43.852723 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-f23fe65b-45dd-49b1-a85c-8d5d965cb041 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:47:43.853457 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-f23fe65b-45dd-49b1-a85c-8d5d965cb041 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:47:43.860605 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-f23fe65b-45dd-49b1-a85c-8d5d965cb041 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:47:43.861043 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-f23fe65b-45dd-49b1-a85c-8d5d965cb041 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:47:43.861818 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-f23fe65b-45dd-49b1-a85c-8d5d965cb041 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:47:43.862247 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-f23fe65b-45dd-49b1-a85c-8d5d965cb041 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:47:44.057813 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-f23fe65b-45dd-49b1-a85c-8d5d965cb041 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:47:44.067033 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-f23fe65b-45dd-49b1-a85c-8d5d965cb041 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:47:44.068656 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-f23fe65b-45dd-49b1-a85c-8d5d965cb041 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:47:44.069852 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-f23fe65b-45dd-49b1-a85c-8d5d965cb041 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672" status: 200 len: 1754 microversion: 2.20 time: 0.322545 Oct 27 15:47:44.080228 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 458/837] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Oct 27 15:47:43 2021] GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672 => generated 1754 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 15:47:44.684513 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-72ec4221-f7fe-4736-a685-bdf4ef5d594e tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:47:44.685401 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-72ec4221-f7fe-4736-a685-bdf4ef5d594e tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: 62c89161-c119-48b2-839d-712db798ff96] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:47:44.692353 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-72ec4221-f7fe-4736-a685-bdf4ef5d594e tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:47:44.692796 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-72ec4221-f7fe-4736-a685-bdf4ef5d594e tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:47:44.693550 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-72ec4221-f7fe-4736-a685-bdf4ef5d594e tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:47:44.694007 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-72ec4221-f7fe-4736-a685-bdf4ef5d594e tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:47:44.721775 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-72ec4221-f7fe-4736-a685-bdf4ef5d594e tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040714 Oct 27 15:47:44.723314 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 380/838] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Oct 27 15:47:44 2021] GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 15:47:45.090338 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-dc81a523-cb05-452c-a1e3-59e51ba8da4c tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:47:45.091372 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-dc81a523-cb05-452c-a1e3-59e51ba8da4c tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:47:45.101831 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-dc81a523-cb05-452c-a1e3-59e51ba8da4c tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:47:45.102545 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-dc81a523-cb05-452c-a1e3-59e51ba8da4c tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:47:45.103775 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-dc81a523-cb05-452c-a1e3-59e51ba8da4c tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:47:45.104517 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-dc81a523-cb05-452c-a1e3-59e51ba8da4c tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:47:45.224139 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-dc81a523-cb05-452c-a1e3-59e51ba8da4c tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:47:45.232071 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-dc81a523-cb05-452c-a1e3-59e51ba8da4c tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:47:45.233570 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-dc81a523-cb05-452c-a1e3-59e51ba8da4c tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:47:45.234687 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-dc81a523-cb05-452c-a1e3-59e51ba8da4c tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672" status: 200 len: 1754 microversion: 2.20 time: 0.150356 Oct 27 15:47:45.235235 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 459/839] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Oct 27 15:47:45 2021] GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672 => generated 1754 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 15:47:45.527282 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 27 15:47:45.527490 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: Wed Oct 27 15:47:45 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Oct 27 15:47:45.734097 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-faa6ad05-97f4-4858-ae1c-345b18ad8dae tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:47:45.735001 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-faa6ad05-97f4-4858-ae1c-345b18ad8dae tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: 62c89161-c119-48b2-839d-712db798ff96] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:47:45.741375 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-faa6ad05-97f4-4858-ae1c-345b18ad8dae tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:47:45.741820 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-faa6ad05-97f4-4858-ae1c-345b18ad8dae tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:47:45.742619 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-faa6ad05-97f4-4858-ae1c-345b18ad8dae tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:47:45.743056 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-faa6ad05-97f4-4858-ae1c-345b18ad8dae tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:47:45.771540 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-faa6ad05-97f4-4858-ae1c-345b18ad8dae tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041258 Oct 27 15:47:45.772126 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 381/840] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Oct 27 15:47:45 2021] GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 15:47:46.252020 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-66f6a54c-b59f-4a0c-9f59-94edd3c26cc1 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:47:46.252633 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-66f6a54c-b59f-4a0c-9f59-94edd3c26cc1 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:47:46.259692 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-66f6a54c-b59f-4a0c-9f59-94edd3c26cc1 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:47:46.260179 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-66f6a54c-b59f-4a0c-9f59-94edd3c26cc1 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:47:46.260949 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-66f6a54c-b59f-4a0c-9f59-94edd3c26cc1 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:47:46.261382 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-66f6a54c-b59f-4a0c-9f59-94edd3c26cc1 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:47:46.402560 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-66f6a54c-b59f-4a0c-9f59-94edd3c26cc1 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:47:46.412498 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-66f6a54c-b59f-4a0c-9f59-94edd3c26cc1 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:47:46.414002 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-66f6a54c-b59f-4a0c-9f59-94edd3c26cc1 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:47:46.415158 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-66f6a54c-b59f-4a0c-9f59-94edd3c26cc1 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672" status: 200 len: 1754 microversion: 2.20 time: 0.167007 Oct 27 15:47:46.415708 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 460/841] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Oct 27 15:47:46 2021] GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672 => generated 1754 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 15:47:46.782965 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-67b5d8b8-97ef-4422-8628-20d821791b90 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:47:46.783919 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-67b5d8b8-97ef-4422-8628-20d821791b90 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: 62c89161-c119-48b2-839d-712db798ff96] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:47:46.790058 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-67b5d8b8-97ef-4422-8628-20d821791b90 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:47:46.790526 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-67b5d8b8-97ef-4422-8628-20d821791b90 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:47:46.791287 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-67b5d8b8-97ef-4422-8628-20d821791b90 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:47:46.791722 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-67b5d8b8-97ef-4422-8628-20d821791b90 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:47:46.821110 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-67b5d8b8-97ef-4422-8628-20d821791b90 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041921 Oct 27 15:47:46.821664 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 382/842] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Oct 27 15:47:46 2021] GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 15:47:47.434176 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-de968bd1-e0c8-4147-893a-17d402ab5a26 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:47:47.434776 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-de968bd1-e0c8-4147-893a-17d402ab5a26 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:47:47.441599 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-de968bd1-e0c8-4147-893a-17d402ab5a26 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:47:47.442067 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-de968bd1-e0c8-4147-893a-17d402ab5a26 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:47:47.442831 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-de968bd1-e0c8-4147-893a-17d402ab5a26 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:47:47.443264 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-de968bd1-e0c8-4147-893a-17d402ab5a26 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:47:47.564685 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-de968bd1-e0c8-4147-893a-17d402ab5a26 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:47:47.573415 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-de968bd1-e0c8-4147-893a-17d402ab5a26 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:47:47.574910 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-de968bd1-e0c8-4147-893a-17d402ab5a26 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:47:47.576088 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-de968bd1-e0c8-4147-893a-17d402ab5a26 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672" status: 200 len: 1754 microversion: 2.20 time: 0.145583 Oct 27 15:47:47.576646 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 461/843] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Oct 27 15:47:47 2021] GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672 => generated 1754 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 15:47:47.832259 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-50e7d588-a5fb-4c89-a0f1-158579afaf80 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:47:47.833131 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-50e7d588-a5fb-4c89-a0f1-158579afaf80 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: 62c89161-c119-48b2-839d-712db798ff96] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:47:47.839268 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-50e7d588-a5fb-4c89-a0f1-158579afaf80 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:47:47.839707 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-50e7d588-a5fb-4c89-a0f1-158579afaf80 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:47:47.840501 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-50e7d588-a5fb-4c89-a0f1-158579afaf80 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:47:47.840931 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-50e7d588-a5fb-4c89-a0f1-158579afaf80 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:47:47.869253 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-50e7d588-a5fb-4c89-a0f1-158579afaf80 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041478 Oct 27 15:47:47.869795 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 383/844] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Oct 27 15:47:47 2021] GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 15:47:48.594152 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-c35587e8-28b4-475c-9497-a4375c85acf7 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:47:48.594742 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-c35587e8-28b4-475c-9497-a4375c85acf7 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:47:48.602193 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-c35587e8-28b4-475c-9497-a4375c85acf7 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:47:48.602626 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-c35587e8-28b4-475c-9497-a4375c85acf7 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:47:48.603378 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-c35587e8-28b4-475c-9497-a4375c85acf7 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:47:48.603802 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-c35587e8-28b4-475c-9497-a4375c85acf7 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:47:48.723445 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-c35587e8-28b4-475c-9497-a4375c85acf7 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:47:48.731405 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-c35587e8-28b4-475c-9497-a4375c85acf7 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:47:48.733075 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-c35587e8-28b4-475c-9497-a4375c85acf7 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:47:48.734209 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-c35587e8-28b4-475c-9497-a4375c85acf7 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672" status: 200 len: 1754 microversion: 2.20 time: 0.143831 Oct 27 15:47:48.734758 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 462/845] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Oct 27 15:47:48 2021] GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672 => generated 1754 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 15:47:48.881316 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-51da6143-93b8-4d63-be17-a013f8817f1c tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:47:48.882211 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-51da6143-93b8-4d63-be17-a013f8817f1c tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: 62c89161-c119-48b2-839d-712db798ff96] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:47:48.888509 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-51da6143-93b8-4d63-be17-a013f8817f1c tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:47:48.888951 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-51da6143-93b8-4d63-be17-a013f8817f1c tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:47:48.889722 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-51da6143-93b8-4d63-be17-a013f8817f1c tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:47:48.890150 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-51da6143-93b8-4d63-be17-a013f8817f1c tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:47:48.918642 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-51da6143-93b8-4d63-be17-a013f8817f1c tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041692 Oct 27 15:47:48.919200 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 384/846] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Oct 27 15:47:48 2021] GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 15:47:49.752174 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-1d3d5b60-7e9a-45c5-8642-39a20c0eb9dd tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:47:49.752812 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-1d3d5b60-7e9a-45c5-8642-39a20c0eb9dd tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:47:49.759959 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-1d3d5b60-7e9a-45c5-8642-39a20c0eb9dd tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:47:49.760410 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-1d3d5b60-7e9a-45c5-8642-39a20c0eb9dd tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:47:49.761177 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-1d3d5b60-7e9a-45c5-8642-39a20c0eb9dd tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:47:49.761607 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-1d3d5b60-7e9a-45c5-8642-39a20c0eb9dd tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:47:49.880759 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-1d3d5b60-7e9a-45c5-8642-39a20c0eb9dd tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:47:49.888892 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-1d3d5b60-7e9a-45c5-8642-39a20c0eb9dd tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:47:49.890384 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-1d3d5b60-7e9a-45c5-8642-39a20c0eb9dd tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:47:49.891530 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-1d3d5b60-7e9a-45c5-8642-39a20c0eb9dd tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672" status: 200 len: 1754 microversion: 2.20 time: 0.143103 Oct 27 15:47:49.892110 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 463/847] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Oct 27 15:47:49 2021] GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672 => generated 1754 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 15:47:49.930535 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-fd7db0ad-21c4-447f-9a41-182ecb82a85b tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:47:49.931440 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-fd7db0ad-21c4-447f-9a41-182ecb82a85b tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: 62c89161-c119-48b2-839d-712db798ff96] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:47:49.937639 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-fd7db0ad-21c4-447f-9a41-182ecb82a85b tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:47:49.938296 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-fd7db0ad-21c4-447f-9a41-182ecb82a85b tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:47:49.938847 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-fd7db0ad-21c4-447f-9a41-182ecb82a85b tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:47:49.939280 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-fd7db0ad-21c4-447f-9a41-182ecb82a85b tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:47:49.967245 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-fd7db0ad-21c4-447f-9a41-182ecb82a85b tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040470 Oct 27 15:47:49.967788 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 385/848] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Oct 27 15:47:49 2021] GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 15:47:50.910022 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-12316fe6-7c47-4264-abfc-aef171371ba3 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:47:50.910605 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-12316fe6-7c47-4264-abfc-aef171371ba3 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:47:50.918271 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-12316fe6-7c47-4264-abfc-aef171371ba3 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:47:50.918400 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-12316fe6-7c47-4264-abfc-aef171371ba3 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:47:50.919166 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-12316fe6-7c47-4264-abfc-aef171371ba3 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:47:50.919596 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-12316fe6-7c47-4264-abfc-aef171371ba3 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:47:50.979173 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-62039a1b-cd97-4d68-9c4f-149aecc0c0b4 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:47:50.980109 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-62039a1b-cd97-4d68-9c4f-149aecc0c0b4 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: 62c89161-c119-48b2-839d-712db798ff96] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:47:50.986287 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-62039a1b-cd97-4d68-9c4f-149aecc0c0b4 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:47:50.986739 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-62039a1b-cd97-4d68-9c4f-149aecc0c0b4 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:47:50.987570 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-62039a1b-cd97-4d68-9c4f-149aecc0c0b4 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:47:50.988345 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-62039a1b-cd97-4d68-9c4f-149aecc0c0b4 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:47:51.020572 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-62039a1b-cd97-4d68-9c4f-149aecc0c0b4 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045193 Oct 27 15:47:51.021235 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 386/849] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Oct 27 15:47:50 2021] GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 15:47:51.043707 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-12316fe6-7c47-4264-abfc-aef171371ba3 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:47:51.051777 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-12316fe6-7c47-4264-abfc-aef171371ba3 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:47:51.053293 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-12316fe6-7c47-4264-abfc-aef171371ba3 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:47:51.054436 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-12316fe6-7c47-4264-abfc-aef171371ba3 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672" status: 200 len: 1754 microversion: 2.20 time: 0.148690 Oct 27 15:47:51.054988 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 464/850] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Oct 27 15:47:50 2021] GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672 => generated 1754 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 15:47:52.032021 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-9c37f9cf-ff11-4f31-9774-214332aea343 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:47:52.032916 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-9c37f9cf-ff11-4f31-9774-214332aea343 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: 62c89161-c119-48b2-839d-712db798ff96] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:47:52.038969 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-9c37f9cf-ff11-4f31-9774-214332aea343 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:47:52.039409 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-9c37f9cf-ff11-4f31-9774-214332aea343 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:47:52.040198 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-9c37f9cf-ff11-4f31-9774-214332aea343 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:47:52.040628 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-9c37f9cf-ff11-4f31-9774-214332aea343 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:47:52.069285 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-9c37f9cf-ff11-4f31-9774-214332aea343 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041082 Oct 27 15:47:52.069841 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 387/851] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Oct 27 15:47:52 2021] GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 15:47:52.072543 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-61edc991-073e-4aab-9f41-081dfbf46cb8 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:47:52.073142 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-61edc991-073e-4aab-9f41-081dfbf46cb8 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:47:52.078998 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-61edc991-073e-4aab-9f41-081dfbf46cb8 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:47:52.079436 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-61edc991-073e-4aab-9f41-081dfbf46cb8 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:47:52.080217 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-61edc991-073e-4aab-9f41-081dfbf46cb8 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:47:52.080642 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-61edc991-073e-4aab-9f41-081dfbf46cb8 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:47:52.199789 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-61edc991-073e-4aab-9f41-081dfbf46cb8 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:47:52.207906 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-61edc991-073e-4aab-9f41-081dfbf46cb8 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:47:52.209397 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-61edc991-073e-4aab-9f41-081dfbf46cb8 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:47:52.210541 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-61edc991-073e-4aab-9f41-081dfbf46cb8 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672" status: 200 len: 1754 microversion: 2.20 time: 0.141695 Oct 27 15:47:52.211094 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 465/852] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Oct 27 15:47:52 2021] GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672 => generated 1754 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 15:47:53.080644 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-a210688a-5c60-46d7-9689-2d7d70ee96a8 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:47:53.081655 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-a210688a-5c60-46d7-9689-2d7d70ee96a8 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: 62c89161-c119-48b2-839d-712db798ff96] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:47:53.087773 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-a210688a-5c60-46d7-9689-2d7d70ee96a8 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:47:53.088252 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-a210688a-5c60-46d7-9689-2d7d70ee96a8 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:47:53.089014 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-a210688a-5c60-46d7-9689-2d7d70ee96a8 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:47:53.089448 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-a210688a-5c60-46d7-9689-2d7d70ee96a8 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:47:53.118616 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-a210688a-5c60-46d7-9689-2d7d70ee96a8 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041767 Oct 27 15:47:53.119160 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 388/853] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Oct 27 15:47:53 2021] GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 15:47:53.228915 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-05877d3a-5e39-44db-b337-dae7e28a976e tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:47:53.229518 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-05877d3a-5e39-44db-b337-dae7e28a976e tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:47:53.235774 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-05877d3a-5e39-44db-b337-dae7e28a976e tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:47:53.236247 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-05877d3a-5e39-44db-b337-dae7e28a976e tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:47:53.237037 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-05877d3a-5e39-44db-b337-dae7e28a976e tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:47:53.237523 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-05877d3a-5e39-44db-b337-dae7e28a976e tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:47:53.354199 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-05877d3a-5e39-44db-b337-dae7e28a976e tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:47:53.362216 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-05877d3a-5e39-44db-b337-dae7e28a976e tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:47:53.363807 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-05877d3a-5e39-44db-b337-dae7e28a976e tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:47:53.364971 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-05877d3a-5e39-44db-b337-dae7e28a976e tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672" status: 200 len: 1754 microversion: 2.20 time: 0.139796 Oct 27 15:47:53.365523 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 466/854] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Oct 27 15:47:53 2021] GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672 => generated 1754 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 15:47:54.131297 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-ac00589b-7d6f-4836-a2a5-71e8cef76e8e tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:47:54.132215 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-ac00589b-7d6f-4836-a2a5-71e8cef76e8e tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: 62c89161-c119-48b2-839d-712db798ff96] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:47:54.138738 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-ac00589b-7d6f-4836-a2a5-71e8cef76e8e tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:47:54.139214 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-ac00589b-7d6f-4836-a2a5-71e8cef76e8e tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:47:54.139996 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-ac00589b-7d6f-4836-a2a5-71e8cef76e8e tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:47:54.140429 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-ac00589b-7d6f-4836-a2a5-71e8cef76e8e tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:47:54.168545 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-ac00589b-7d6f-4836-a2a5-71e8cef76e8e tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042268 Oct 27 15:47:54.169018 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 389/855] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Oct 27 15:47:54 2021] GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 15:47:54.382307 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-e4cb0f50-17e8-43a6-a917-201602bb7e64 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:47:54.382900 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-e4cb0f50-17e8-43a6-a917-201602bb7e64 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:47:54.389077 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-e4cb0f50-17e8-43a6-a917-201602bb7e64 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:47:54.389513 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-e4cb0f50-17e8-43a6-a917-201602bb7e64 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:47:54.390262 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-e4cb0f50-17e8-43a6-a917-201602bb7e64 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:47:54.390689 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-e4cb0f50-17e8-43a6-a917-201602bb7e64 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:47:54.515326 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-e4cb0f50-17e8-43a6-a917-201602bb7e64 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:47:54.525024 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-e4cb0f50-17e8-43a6-a917-201602bb7e64 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:47:54.526577 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-e4cb0f50-17e8-43a6-a917-201602bb7e64 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:47:54.527804 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-e4cb0f50-17e8-43a6-a917-201602bb7e64 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672" status: 200 len: 1754 microversion: 2.20 time: 0.149184 Oct 27 15:47:54.528356 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 467/856] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Oct 27 15:47:54 2021] GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672 => generated 1754 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 15:47:55.181101 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-975082f4-fcc9-449a-bfcc-339f8771fbdf tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:47:55.181921 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-975082f4-fcc9-449a-bfcc-339f8771fbdf tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: 62c89161-c119-48b2-839d-712db798ff96] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:47:55.187702 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-975082f4-fcc9-449a-bfcc-339f8771fbdf tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:47:55.188180 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-975082f4-fcc9-449a-bfcc-339f8771fbdf tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:47:55.188929 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-975082f4-fcc9-449a-bfcc-339f8771fbdf tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:47:55.189358 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-975082f4-fcc9-449a-bfcc-339f8771fbdf tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:47:55.217418 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-975082f4-fcc9-449a-bfcc-339f8771fbdf tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040341 Oct 27 15:47:55.217967 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 390/857] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Oct 27 15:47:55 2021] GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 15:47:55.546222 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-a800e44a-e511-46d5-bb0f-75bad04e59a3 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:47:55.546848 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-a800e44a-e511-46d5-bb0f-75bad04e59a3 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:47:55.553495 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-a800e44a-e511-46d5-bb0f-75bad04e59a3 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:47:55.553951 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-a800e44a-e511-46d5-bb0f-75bad04e59a3 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:47:55.554709 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-a800e44a-e511-46d5-bb0f-75bad04e59a3 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:47:55.555137 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-a800e44a-e511-46d5-bb0f-75bad04e59a3 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:47:55.676066 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-a800e44a-e511-46d5-bb0f-75bad04e59a3 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:47:55.684104 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-a800e44a-e511-46d5-bb0f-75bad04e59a3 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:47:55.685608 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-a800e44a-e511-46d5-bb0f-75bad04e59a3 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:47:55.686752 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-a800e44a-e511-46d5-bb0f-75bad04e59a3 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672" status: 200 len: 1754 microversion: 2.20 time: 0.144253 Oct 27 15:47:55.687306 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 468/858] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Oct 27 15:47:55 2021] GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672 => generated 1754 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 15:47:56.230159 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-a95dfaec-c110-4592-9001-989b960af7ad tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:47:56.231054 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-a95dfaec-c110-4592-9001-989b960af7ad tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: 62c89161-c119-48b2-839d-712db798ff96] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:47:56.237298 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-a95dfaec-c110-4592-9001-989b960af7ad tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:47:56.237814 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-a95dfaec-c110-4592-9001-989b960af7ad tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:47:56.238572 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-a95dfaec-c110-4592-9001-989b960af7ad tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:47:56.239003 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-a95dfaec-c110-4592-9001-989b960af7ad tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:47:56.266612 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-a95dfaec-c110-4592-9001-989b960af7ad tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040192 Oct 27 15:47:56.267163 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 391/859] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Oct 27 15:47:56 2021] GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 15:47:56.704698 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-59679669-e276-4778-bac3-676799ca9380 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:47:56.705303 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-59679669-e276-4778-bac3-676799ca9380 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:47:56.712263 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-59679669-e276-4778-bac3-676799ca9380 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:47:56.712708 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-59679669-e276-4778-bac3-676799ca9380 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:47:56.713467 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-59679669-e276-4778-bac3-676799ca9380 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:47:56.713899 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-59679669-e276-4778-bac3-676799ca9380 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:47:56.835340 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-59679669-e276-4778-bac3-676799ca9380 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:47:56.843314 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-59679669-e276-4778-bac3-676799ca9380 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:47:56.844822 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-59679669-e276-4778-bac3-676799ca9380 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:47:56.845956 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-59679669-e276-4778-bac3-676799ca9380 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672" status: 200 len: 1754 microversion: 2.20 time: 0.144983 Oct 27 15:47:56.846776 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 469/860] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Oct 27 15:47:56 2021] GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672 => generated 1754 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 15:47:57.278627 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-63743614-338c-4a91-ae69-d2872749400a tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:47:57.279524 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-63743614-338c-4a91-ae69-d2872749400a tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: 62c89161-c119-48b2-839d-712db798ff96] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:47:57.286193 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-63743614-338c-4a91-ae69-d2872749400a tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:47:57.286631 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-63743614-338c-4a91-ae69-d2872749400a tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:47:57.287393 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-63743614-338c-4a91-ae69-d2872749400a tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:47:57.287822 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-63743614-338c-4a91-ae69-d2872749400a tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:47:57.316435 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-63743614-338c-4a91-ae69-d2872749400a tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040877 Oct 27 15:47:57.316927 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 392/861] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Oct 27 15:47:57 2021] GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 15:47:57.864982 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-bfe7ed20-ff98-45d1-86f6-2e609e610f77 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:47:57.865613 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-bfe7ed20-ff98-45d1-86f6-2e609e610f77 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:47:57.871724 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-bfe7ed20-ff98-45d1-86f6-2e609e610f77 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:47:57.872212 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-bfe7ed20-ff98-45d1-86f6-2e609e610f77 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:47:57.872971 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-bfe7ed20-ff98-45d1-86f6-2e609e610f77 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:47:57.873401 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-bfe7ed20-ff98-45d1-86f6-2e609e610f77 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:47:57.995521 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-bfe7ed20-ff98-45d1-86f6-2e609e610f77 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:47:58.004473 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-bfe7ed20-ff98-45d1-86f6-2e609e610f77 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:47:58.005942 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-bfe7ed20-ff98-45d1-86f6-2e609e610f77 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:47:58.007079 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-bfe7ed20-ff98-45d1-86f6-2e609e610f77 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672" status: 200 len: 1754 microversion: 2.20 time: 0.146512 Oct 27 15:47:58.007633 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 470/862] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Oct 27 15:47:57 2021] GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672 => generated 1754 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 15:47:58.328002 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-c80c63fe-67ef-47ef-b935-83354f793d01 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:47:58.328896 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-c80c63fe-67ef-47ef-b935-83354f793d01 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: 62c89161-c119-48b2-839d-712db798ff96] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:47:58.335118 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-c80c63fe-67ef-47ef-b935-83354f793d01 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:47:58.335566 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-c80c63fe-67ef-47ef-b935-83354f793d01 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:47:58.336363 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-c80c63fe-67ef-47ef-b935-83354f793d01 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:47:58.336793 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-c80c63fe-67ef-47ef-b935-83354f793d01 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:47:58.367199 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-c80c63fe-67ef-47ef-b935-83354f793d01 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042938 Oct 27 15:47:58.367759 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 393/863] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Oct 27 15:47:58 2021] GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 15:47:59.024929 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-80a69db7-364c-420d-bfdf-e1e40bc0fcde tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:47:59.025464 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-80a69db7-364c-420d-bfdf-e1e40bc0fcde tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:47:59.031611 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-80a69db7-364c-420d-bfdf-e1e40bc0fcde tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:47:59.032102 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-80a69db7-364c-420d-bfdf-e1e40bc0fcde tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:47:59.032859 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-80a69db7-364c-420d-bfdf-e1e40bc0fcde tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:47:59.033290 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-80a69db7-364c-420d-bfdf-e1e40bc0fcde tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:47:59.151329 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-80a69db7-364c-420d-bfdf-e1e40bc0fcde tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:47:59.159901 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-80a69db7-364c-420d-bfdf-e1e40bc0fcde tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:47:59.161406 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-80a69db7-364c-420d-bfdf-e1e40bc0fcde tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:47:59.162545 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-80a69db7-364c-420d-bfdf-e1e40bc0fcde tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672" status: 200 len: 1754 microversion: 2.20 time: 0.141413 Oct 27 15:47:59.163114 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 471/864] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Oct 27 15:47:59 2021] GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672 => generated 1754 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 15:47:59.378891 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-773536ce-68c1-4cc8-86ee-bdbf0a963b83 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:47:59.379708 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-773536ce-68c1-4cc8-86ee-bdbf0a963b83 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: 62c89161-c119-48b2-839d-712db798ff96] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:47:59.385927 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-773536ce-68c1-4cc8-86ee-bdbf0a963b83 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:47:59.386375 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-773536ce-68c1-4cc8-86ee-bdbf0a963b83 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:47:59.387137 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-773536ce-68c1-4cc8-86ee-bdbf0a963b83 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:47:59.387571 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-773536ce-68c1-4cc8-86ee-bdbf0a963b83 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:47:59.416749 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-773536ce-68c1-4cc8-86ee-bdbf0a963b83 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041829 Oct 27 15:47:59.417305 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 394/865] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Oct 27 15:47:59 2021] GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 15:48:00.180575 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-ea81100c-28be-47c7-acd8-7babf2af9563 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:48:00.181102 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-ea81100c-28be-47c7-acd8-7babf2af9563 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:48:00.187265 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-ea81100c-28be-47c7-acd8-7babf2af9563 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:48:00.187705 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-ea81100c-28be-47c7-acd8-7babf2af9563 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:48:00.188499 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-ea81100c-28be-47c7-acd8-7babf2af9563 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:48:00.188931 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-ea81100c-28be-47c7-acd8-7babf2af9563 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:48:00.318625 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-ea81100c-28be-47c7-acd8-7babf2af9563 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:48:00.326900 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-ea81100c-28be-47c7-acd8-7babf2af9563 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:48:00.328430 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-ea81100c-28be-47c7-acd8-7babf2af9563 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:48:00.329597 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-ea81100c-28be-47c7-acd8-7babf2af9563 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672" status: 200 len: 1754 microversion: 2.20 time: 0.152842 Oct 27 15:48:00.330131 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 472/866] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Oct 27 15:48:00 2021] GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672 => generated 1754 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 15:48:00.427757 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-eeb906bd-1fe6-4069-a31f-ac2907d635e8 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:48:00.428866 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-eeb906bd-1fe6-4069-a31f-ac2907d635e8 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: 62c89161-c119-48b2-839d-712db798ff96] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:48:00.435410 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-eeb906bd-1fe6-4069-a31f-ac2907d635e8 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:48:00.435798 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-eeb906bd-1fe6-4069-a31f-ac2907d635e8 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:48:00.436595 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-eeb906bd-1fe6-4069-a31f-ac2907d635e8 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:48:00.437028 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-eeb906bd-1fe6-4069-a31f-ac2907d635e8 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:48:00.466737 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-eeb906bd-1fe6-4069-a31f-ac2907d635e8 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043261 Oct 27 15:48:00.467306 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 395/867] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Oct 27 15:48:00 2021] GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 15:48:01.349065 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-22afdb06-062e-487e-84c1-f4c1d08f7708 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:48:01.349664 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-22afdb06-062e-487e-84c1-f4c1d08f7708 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:48:01.355859 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-22afdb06-062e-487e-84c1-f4c1d08f7708 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:48:01.356320 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-22afdb06-062e-487e-84c1-f4c1d08f7708 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:48:01.357122 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-22afdb06-062e-487e-84c1-f4c1d08f7708 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:48:01.357562 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-22afdb06-062e-487e-84c1-f4c1d08f7708 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:48:01.479078 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-7764554a-5e5b-43ca-b55a-a6357f523cb5 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:48:01.480036 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-7764554a-5e5b-43ca-b55a-a6357f523cb5 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: 62c89161-c119-48b2-839d-712db798ff96] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:48:01.480196 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-22afdb06-062e-487e-84c1-f4c1d08f7708 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:48:01.486325 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-7764554a-5e5b-43ca-b55a-a6357f523cb5 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:48:01.486771 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-7764554a-5e5b-43ca-b55a-a6357f523cb5 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:48:01.488122 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-7764554a-5e5b-43ca-b55a-a6357f523cb5 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:48:01.488650 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-7764554a-5e5b-43ca-b55a-a6357f523cb5 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:48:01.488809 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-22afdb06-062e-487e-84c1-f4c1d08f7708 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:48:01.490309 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-22afdb06-062e-487e-84c1-f4c1d08f7708 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:48:01.491466 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-22afdb06-062e-487e-84c1-f4c1d08f7708 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672" status: 200 len: 1754 microversion: 2.20 time: 0.146549 Oct 27 15:48:01.492049 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 473/868] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Oct 27 15:48:01 2021] GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672 => generated 1754 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 15:48:01.516983 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-7764554a-5e5b-43ca-b55a-a6357f523cb5 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042197 Oct 27 15:48:01.517530 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 396/869] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Oct 27 15:48:01 2021] GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 15:48:02.510237 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-4fef1af6-05ac-49a8-85df-cb17eea56c41 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:48:02.510862 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-4fef1af6-05ac-49a8-85df-cb17eea56c41 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:48:02.516989 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-4fef1af6-05ac-49a8-85df-cb17eea56c41 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:48:02.517430 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-4fef1af6-05ac-49a8-85df-cb17eea56c41 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:48:02.518183 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-4fef1af6-05ac-49a8-85df-cb17eea56c41 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:48:02.518966 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-4fef1af6-05ac-49a8-85df-cb17eea56c41 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:48:02.527254 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-be3cf20a-c8cd-4fe0-9636-7fb5f4e63166 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:48:02.528219 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-be3cf20a-c8cd-4fe0-9636-7fb5f4e63166 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: 62c89161-c119-48b2-839d-712db798ff96] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:48:02.534972 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-be3cf20a-c8cd-4fe0-9636-7fb5f4e63166 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:48:02.535515 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-be3cf20a-c8cd-4fe0-9636-7fb5f4e63166 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:48:02.536209 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-be3cf20a-c8cd-4fe0-9636-7fb5f4e63166 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:48:02.536637 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-be3cf20a-c8cd-4fe0-9636-7fb5f4e63166 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:48:02.567152 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-be3cf20a-c8cd-4fe0-9636-7fb5f4e63166 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043492 Oct 27 15:48:02.567723 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 397/870] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Oct 27 15:48:02 2021] GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 15:48:02.640252 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-4fef1af6-05ac-49a8-85df-cb17eea56c41 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:48:02.649594 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-4fef1af6-05ac-49a8-85df-cb17eea56c41 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:48:02.651092 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-4fef1af6-05ac-49a8-85df-cb17eea56c41 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:48:02.652327 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-4fef1af6-05ac-49a8-85df-cb17eea56c41 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672" status: 200 len: 1754 microversion: 2.20 time: 0.146011 Oct 27 15:48:02.652851 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 474/871] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Oct 27 15:48:02 2021] GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672 => generated 1754 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 15:48:03.577959 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-1b385110-a4af-46b2-b627-3e31e1c999d2 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:48:03.578847 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-1b385110-a4af-46b2-b627-3e31e1c999d2 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: 62c89161-c119-48b2-839d-712db798ff96] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:48:03.585703 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-1b385110-a4af-46b2-b627-3e31e1c999d2 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:48:03.586145 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-1b385110-a4af-46b2-b627-3e31e1c999d2 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:48:03.586903 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-1b385110-a4af-46b2-b627-3e31e1c999d2 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:48:03.587331 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-1b385110-a4af-46b2-b627-3e31e1c999d2 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:48:03.615788 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-1b385110-a4af-46b2-b627-3e31e1c999d2 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041543 Oct 27 15:48:03.616364 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 398/872] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Oct 27 15:48:03 2021] GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 15:48:03.671915 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-c6c723ad-eafa-4237-9aa6-8a687582c58d tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:48:03.672792 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-c6c723ad-eafa-4237-9aa6-8a687582c58d tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:48:03.679728 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-c6c723ad-eafa-4237-9aa6-8a687582c58d tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:48:03.680203 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-c6c723ad-eafa-4237-9aa6-8a687582c58d tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:48:03.680969 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-c6c723ad-eafa-4237-9aa6-8a687582c58d tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:48:03.681399 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-c6c723ad-eafa-4237-9aa6-8a687582c58d tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:48:03.801052 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-c6c723ad-eafa-4237-9aa6-8a687582c58d tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:48:03.809506 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-c6c723ad-eafa-4237-9aa6-8a687582c58d tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:48:03.811044 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-c6c723ad-eafa-4237-9aa6-8a687582c58d tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:48:03.812234 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-c6c723ad-eafa-4237-9aa6-8a687582c58d tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672" status: 200 len: 1754 microversion: 2.20 time: 0.144862 Oct 27 15:48:03.812796 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 475/873] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Oct 27 15:48:03 2021] GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672 => generated 1754 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 15:48:04.627098 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-6859c96c-8504-4cca-a16a-1a258c5864a5 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:48:04.628714 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-6859c96c-8504-4cca-a16a-1a258c5864a5 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: 62c89161-c119-48b2-839d-712db798ff96] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:48:04.635068 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-6859c96c-8504-4cca-a16a-1a258c5864a5 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:48:04.635513 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-6859c96c-8504-4cca-a16a-1a258c5864a5 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:48:04.636297 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-6859c96c-8504-4cca-a16a-1a258c5864a5 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:48:04.636731 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-6859c96c-8504-4cca-a16a-1a258c5864a5 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:48:04.665183 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-6859c96c-8504-4cca-a16a-1a258c5864a5 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041864 Oct 27 15:48:04.665728 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 399/874] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Oct 27 15:48:04 2021] GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 15:48:04.830581 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-c6f67b94-76c5-4286-813b-3f62fe34e63f tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:48:04.831176 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-c6f67b94-76c5-4286-813b-3f62fe34e63f tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:48:04.837508 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-c6f67b94-76c5-4286-813b-3f62fe34e63f tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:48:04.837947 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-c6f67b94-76c5-4286-813b-3f62fe34e63f tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:48:04.838699 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-c6f67b94-76c5-4286-813b-3f62fe34e63f tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:48:04.839127 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-c6f67b94-76c5-4286-813b-3f62fe34e63f tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:48:04.967181 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-c6f67b94-76c5-4286-813b-3f62fe34e63f tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:48:04.976263 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-c6f67b94-76c5-4286-813b-3f62fe34e63f tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:48:04.977875 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-c6f67b94-76c5-4286-813b-3f62fe34e63f tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:48:04.979053 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-c6f67b94-76c5-4286-813b-3f62fe34e63f tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672" status: 200 len: 1754 microversion: 2.20 time: 0.152143 Oct 27 15:48:04.979634 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 476/875] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Oct 27 15:48:04 2021] GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672 => generated 1754 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 15:48:05.677213 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-9c08a2b7-db51-43ae-9817-e5562138421a tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:48:05.678143 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-9c08a2b7-db51-43ae-9817-e5562138421a tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: 62c89161-c119-48b2-839d-712db798ff96] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:48:05.684479 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-9c08a2b7-db51-43ae-9817-e5562138421a tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:48:05.684924 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-9c08a2b7-db51-43ae-9817-e5562138421a tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:48:05.685687 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-9c08a2b7-db51-43ae-9817-e5562138421a tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:48:05.686118 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-9c08a2b7-db51-43ae-9817-e5562138421a tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:48:05.714692 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-9c08a2b7-db51-43ae-9817-e5562138421a tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041903 Oct 27 15:48:05.715243 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 400/876] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Oct 27 15:48:05 2021] GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 15:48:05.997688 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-b9588a38-60c2-46e6-b3c8-101fb7eb6db6 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:48:05.998294 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-b9588a38-60c2-46e6-b3c8-101fb7eb6db6 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:48:06.004739 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-b9588a38-60c2-46e6-b3c8-101fb7eb6db6 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:48:06.005188 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-b9588a38-60c2-46e6-b3c8-101fb7eb6db6 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:48:06.005973 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-b9588a38-60c2-46e6-b3c8-101fb7eb6db6 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:48:06.006394 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-b9588a38-60c2-46e6-b3c8-101fb7eb6db6 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:48:06.124452 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-b9588a38-60c2-46e6-b3c8-101fb7eb6db6 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:48:06.133167 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-b9588a38-60c2-46e6-b3c8-101fb7eb6db6 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:48:06.134654 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-b9588a38-60c2-46e6-b3c8-101fb7eb6db6 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:48:06.135796 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-b9588a38-60c2-46e6-b3c8-101fb7eb6db6 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672" status: 200 len: 1754 microversion: 2.20 time: 0.141830 Oct 27 15:48:06.136404 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 477/877] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Oct 27 15:48:05 2021] GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672 => generated 1754 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 15:48:06.726520 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-b10a5c9d-49a1-4cd9-bfa8-6b44640f7184 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:48:06.727684 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-b10a5c9d-49a1-4cd9-bfa8-6b44640f7184 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: 62c89161-c119-48b2-839d-712db798ff96] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:48:06.734145 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-b10a5c9d-49a1-4cd9-bfa8-6b44640f7184 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:48:06.734585 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-b10a5c9d-49a1-4cd9-bfa8-6b44640f7184 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:48:06.735360 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-b10a5c9d-49a1-4cd9-bfa8-6b44640f7184 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:48:06.735794 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-b10a5c9d-49a1-4cd9-bfa8-6b44640f7184 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:48:06.764884 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-b10a5c9d-49a1-4cd9-bfa8-6b44640f7184 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042287 Oct 27 15:48:06.765434 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 401/878] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Oct 27 15:48:06 2021] GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 15:48:07.154306 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-6e798715-9814-47d3-a5dd-926ac7272689 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:48:07.154987 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-6e798715-9814-47d3-a5dd-926ac7272689 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:48:07.162030 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-6e798715-9814-47d3-a5dd-926ac7272689 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:48:07.162473 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-6e798715-9814-47d3-a5dd-926ac7272689 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:48:07.163238 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-6e798715-9814-47d3-a5dd-926ac7272689 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:48:07.163675 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-6e798715-9814-47d3-a5dd-926ac7272689 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:48:07.285625 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-6e798715-9814-47d3-a5dd-926ac7272689 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:48:07.298357 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-6e798715-9814-47d3-a5dd-926ac7272689 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:48:07.302111 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-6e798715-9814-47d3-a5dd-926ac7272689 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:48:07.303760 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-6e798715-9814-47d3-a5dd-926ac7272689 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672" status: 200 len: 1754 microversion: 2.20 time: 0.153032 Oct 27 15:48:07.304740 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 478/879] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Oct 27 15:48:07 2021] GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672 => generated 1754 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 15:48:07.776862 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-0e632b63-90be-46e7-a5e1-07e60c3e9a00 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:48:07.777909 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-0e632b63-90be-46e7-a5e1-07e60c3e9a00 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: 62c89161-c119-48b2-839d-712db798ff96] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:48:07.784151 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-0e632b63-90be-46e7-a5e1-07e60c3e9a00 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:48:07.784598 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-0e632b63-90be-46e7-a5e1-07e60c3e9a00 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:48:07.785421 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-0e632b63-90be-46e7-a5e1-07e60c3e9a00 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:48:07.786652 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-0e632b63-90be-46e7-a5e1-07e60c3e9a00 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:48:07.814701 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-0e632b63-90be-46e7-a5e1-07e60c3e9a00 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041598 Oct 27 15:48:07.815242 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 402/880] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Oct 27 15:48:07 2021] GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 15:48:08.327032 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-823d1a8d-7a40-4ac4-bc19-19ec2372ca0e tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:48:08.328203 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-823d1a8d-7a40-4ac4-bc19-19ec2372ca0e tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:48:08.337783 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-823d1a8d-7a40-4ac4-bc19-19ec2372ca0e tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:48:08.338318 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-823d1a8d-7a40-4ac4-bc19-19ec2372ca0e tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:48:08.339292 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-823d1a8d-7a40-4ac4-bc19-19ec2372ca0e tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:48:08.339909 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-823d1a8d-7a40-4ac4-bc19-19ec2372ca0e tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:48:08.464975 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-823d1a8d-7a40-4ac4-bc19-19ec2372ca0e tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:48:08.473738 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-823d1a8d-7a40-4ac4-bc19-19ec2372ca0e tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:48:08.475234 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-823d1a8d-7a40-4ac4-bc19-19ec2372ca0e tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:48:08.476440 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-823d1a8d-7a40-4ac4-bc19-19ec2372ca0e tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672" status: 200 len: 1754 microversion: 2.20 time: 0.156396 Oct 27 15:48:08.476990 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 479/881] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Oct 27 15:48:08 2021] GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672 => generated 1754 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 15:48:08.826707 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-c12e161e-8b44-4cef-85dd-f7405e2d9048 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:48:08.827594 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-c12e161e-8b44-4cef-85dd-f7405e2d9048 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: 62c89161-c119-48b2-839d-712db798ff96] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:48:08.834866 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-c12e161e-8b44-4cef-85dd-f7405e2d9048 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:48:08.835359 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-c12e161e-8b44-4cef-85dd-f7405e2d9048 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:48:08.836349 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-c12e161e-8b44-4cef-85dd-f7405e2d9048 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:48:08.836853 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-c12e161e-8b44-4cef-85dd-f7405e2d9048 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:48:08.871259 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-c12e161e-8b44-4cef-85dd-f7405e2d9048 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048213 Oct 27 15:48:08.871869 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 403/882] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Oct 27 15:48:08 2021] GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 15:48:09.495702 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-f810774d-2dc9-48e3-b066-a3f1e1b51357 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:48:09.496332 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-f810774d-2dc9-48e3-b066-a3f1e1b51357 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:48:09.502403 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-f810774d-2dc9-48e3-b066-a3f1e1b51357 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:48:09.502847 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-f810774d-2dc9-48e3-b066-a3f1e1b51357 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:48:09.503603 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-f810774d-2dc9-48e3-b066-a3f1e1b51357 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:48:09.504084 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-f810774d-2dc9-48e3-b066-a3f1e1b51357 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:48:09.624540 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-f810774d-2dc9-48e3-b066-a3f1e1b51357 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:48:09.632975 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-f810774d-2dc9-48e3-b066-a3f1e1b51357 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:48:09.634488 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-f810774d-2dc9-48e3-b066-a3f1e1b51357 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:48:09.635638 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-f810774d-2dc9-48e3-b066-a3f1e1b51357 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672" status: 200 len: 1754 microversion: 2.20 time: 0.143827 Oct 27 15:48:09.636236 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 480/883] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Oct 27 15:48:09 2021] GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672 => generated 1754 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 15:48:09.883186 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-60b7ef16-9012-4ed3-bad0-69b9016f681c tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:48:09.884056 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-60b7ef16-9012-4ed3-bad0-69b9016f681c tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: 62c89161-c119-48b2-839d-712db798ff96] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:48:09.890357 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-60b7ef16-9012-4ed3-bad0-69b9016f681c tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:48:09.890800 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-60b7ef16-9012-4ed3-bad0-69b9016f681c tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:48:09.891563 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-60b7ef16-9012-4ed3-bad0-69b9016f681c tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:48:09.892026 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-60b7ef16-9012-4ed3-bad0-69b9016f681c tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:48:09.922677 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-60b7ef16-9012-4ed3-bad0-69b9016f681c tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043357 Oct 27 15:48:09.923243 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 404/884] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Oct 27 15:48:09 2021] GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 15:48:10.654604 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-79c2aacd-6fb1-4f79-807d-ffe46c79bd63 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:48:10.655134 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-79c2aacd-6fb1-4f79-807d-ffe46c79bd63 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:48:10.662304 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-79c2aacd-6fb1-4f79-807d-ffe46c79bd63 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:48:10.662748 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-79c2aacd-6fb1-4f79-807d-ffe46c79bd63 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:48:10.663518 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-79c2aacd-6fb1-4f79-807d-ffe46c79bd63 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:48:10.664095 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-79c2aacd-6fb1-4f79-807d-ffe46c79bd63 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:48:10.787347 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-79c2aacd-6fb1-4f79-807d-ffe46c79bd63 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:48:10.796540 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-79c2aacd-6fb1-4f79-807d-ffe46c79bd63 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:48:10.798253 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-79c2aacd-6fb1-4f79-807d-ffe46c79bd63 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:48:10.799610 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-79c2aacd-6fb1-4f79-807d-ffe46c79bd63 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672" status: 200 len: 1754 microversion: 2.20 time: 0.148807 Oct 27 15:48:10.800261 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 481/885] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Oct 27 15:48:10 2021] GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672 => generated 1754 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 15:48:10.934746 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-0f1d8158-0417-42ff-81e3-f0ba28968235 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:48:10.935671 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-0f1d8158-0417-42ff-81e3-f0ba28968235 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: 62c89161-c119-48b2-839d-712db798ff96] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:48:10.941765 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-0f1d8158-0417-42ff-81e3-f0ba28968235 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:48:10.942202 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-0f1d8158-0417-42ff-81e3-f0ba28968235 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:48:10.944043 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-0f1d8158-0417-42ff-81e3-f0ba28968235 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:48:10.944472 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-0f1d8158-0417-42ff-81e3-f0ba28968235 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:48:10.976388 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-0f1d8158-0417-42ff-81e3-f0ba28968235 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045469 Oct 27 15:48:10.977140 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 405/886] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Oct 27 15:48:10 2021] GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 15:48:11.819979 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-c93de1c5-00e2-4447-826f-077c0e961899 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:48:11.820580 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-c93de1c5-00e2-4447-826f-077c0e961899 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:48:11.826872 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-c93de1c5-00e2-4447-826f-077c0e961899 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:48:11.827312 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-c93de1c5-00e2-4447-826f-077c0e961899 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:48:11.828110 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-c93de1c5-00e2-4447-826f-077c0e961899 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:48:11.828550 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-c93de1c5-00e2-4447-826f-077c0e961899 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:48:11.950930 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-c93de1c5-00e2-4447-826f-077c0e961899 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:48:11.958868 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-c93de1c5-00e2-4447-826f-077c0e961899 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:48:11.960936 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-c93de1c5-00e2-4447-826f-077c0e961899 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:48:11.962071 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-c93de1c5-00e2-4447-826f-077c0e961899 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672" status: 200 len: 1748 microversion: 2.20 time: 0.146311 Oct 27 15:48:11.962655 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 482/887] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Oct 27 15:48:11 2021] GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672 => generated 1748 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 15:48:11.987869 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-6a54148d-297a-495f-a33b-72c88534884a tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:48:11.988765 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-6a54148d-297a-495f-a33b-72c88534884a tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: 62c89161-c119-48b2-839d-712db798ff96] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:48:11.995393 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-6a54148d-297a-495f-a33b-72c88534884a tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:48:11.995832 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-6a54148d-297a-495f-a33b-72c88534884a tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:48:11.996612 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-6a54148d-297a-495f-a33b-72c88534884a tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:48:11.997035 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-6a54148d-297a-495f-a33b-72c88534884a tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:48:12.026184 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-6a54148d-297a-495f-a33b-72c88534884a tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041971 Oct 27 15:48:12.026741 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 406/888] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Oct 27 15:48:11 2021] GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 15:48:12.981661 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-947d508d-1d3a-466e-ae54-92407fafcbcb tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:48:12.982312 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-947d508d-1d3a-466e-ae54-92407fafcbcb tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:48:12.988853 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-947d508d-1d3a-466e-ae54-92407fafcbcb tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:48:12.989322 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-947d508d-1d3a-466e-ae54-92407fafcbcb tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:48:12.990118 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-947d508d-1d3a-466e-ae54-92407fafcbcb tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:48:12.990608 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-947d508d-1d3a-466e-ae54-92407fafcbcb tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:48:13.037534 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-c7515e62-d969-4d45-b363-1457169015f6 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:48:13.039067 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-c7515e62-d969-4d45-b363-1457169015f6 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: 62c89161-c119-48b2-839d-712db798ff96] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:48:13.045200 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-c7515e62-d969-4d45-b363-1457169015f6 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:48:13.045638 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-c7515e62-d969-4d45-b363-1457169015f6 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:48:13.046403 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-c7515e62-d969-4d45-b363-1457169015f6 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:48:13.046827 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-c7515e62-d969-4d45-b363-1457169015f6 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:48:13.077171 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-c7515e62-d969-4d45-b363-1457169015f6 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043419 Oct 27 15:48:13.077964 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 407/889] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Oct 27 15:48:13 2021] GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 15:48:13.114520 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-947d508d-1d3a-466e-ae54-92407fafcbcb tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:48:13.123537 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-947d508d-1d3a-466e-ae54-92407fafcbcb tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:48:13.125067 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-947d508d-1d3a-466e-ae54-92407fafcbcb tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:48:13.126208 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-947d508d-1d3a-466e-ae54-92407fafcbcb tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672" status: 200 len: 1748 microversion: 2.20 time: 0.148463 Oct 27 15:48:13.126775 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 483/890] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Oct 27 15:48:12 2021] GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672 => generated 1748 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 15:48:14.089342 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-33c29217-d0c7-44f7-84d1-6d6fc9da7616 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:48:14.090232 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-33c29217-d0c7-44f7-84d1-6d6fc9da7616 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: 62c89161-c119-48b2-839d-712db798ff96] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:48:14.096665 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-33c29217-d0c7-44f7-84d1-6d6fc9da7616 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:48:14.097102 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-33c29217-d0c7-44f7-84d1-6d6fc9da7616 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:48:14.097952 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-33c29217-d0c7-44f7-84d1-6d6fc9da7616 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:48:14.098385 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-33c29217-d0c7-44f7-84d1-6d6fc9da7616 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:48:14.127245 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-33c29217-d0c7-44f7-84d1-6d6fc9da7616 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042399 Oct 27 15:48:14.127788 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 408/891] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Oct 27 15:48:14 2021] GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 15:48:14.146225 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-e8c3907b-bc46-4762-8606-2c48156417de tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:48:14.146940 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-e8c3907b-bc46-4762-8606-2c48156417de tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:48:14.154843 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-e8c3907b-bc46-4762-8606-2c48156417de tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:48:14.155366 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-e8c3907b-bc46-4762-8606-2c48156417de tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:48:14.156183 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-e8c3907b-bc46-4762-8606-2c48156417de tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:48:14.156665 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-e8c3907b-bc46-4762-8606-2c48156417de tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:48:14.278515 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-e8c3907b-bc46-4762-8606-2c48156417de tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:48:14.286756 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-e8c3907b-bc46-4762-8606-2c48156417de tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:48:14.288398 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-e8c3907b-bc46-4762-8606-2c48156417de tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:48:14.290219 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-e8c3907b-bc46-4762-8606-2c48156417de tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672" status: 200 len: 1748 microversion: 2.20 time: 0.148061 Oct 27 15:48:14.290776 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 484/892] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Oct 27 15:48:14 2021] GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672 => generated 1748 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 15:48:15.139823 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-19198599-d161-4ea7-ac77-c083fedc8016 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:48:15.140735 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-19198599-d161-4ea7-ac77-c083fedc8016 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: 62c89161-c119-48b2-839d-712db798ff96] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:48:15.146883 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-19198599-d161-4ea7-ac77-c083fedc8016 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:48:15.147316 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-19198599-d161-4ea7-ac77-c083fedc8016 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:48:15.148140 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-19198599-d161-4ea7-ac77-c083fedc8016 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:48:15.148561 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-19198599-d161-4ea7-ac77-c083fedc8016 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:48:15.176101 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-19198599-d161-4ea7-ac77-c083fedc8016 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039936 Oct 27 15:48:15.176568 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 409/893] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Oct 27 15:48:15 2021] GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 15:48:15.310801 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-dbedb354-678e-464e-94fc-02d30e2a4b41 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:48:15.311573 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-dbedb354-678e-464e-94fc-02d30e2a4b41 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:48:15.319148 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-dbedb354-678e-464e-94fc-02d30e2a4b41 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:48:15.319585 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-dbedb354-678e-464e-94fc-02d30e2a4b41 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:48:15.320394 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-dbedb354-678e-464e-94fc-02d30e2a4b41 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:48:15.320828 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-dbedb354-678e-464e-94fc-02d30e2a4b41 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:48:15.445942 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-dbedb354-678e-464e-94fc-02d30e2a4b41 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:48:15.454232 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-dbedb354-678e-464e-94fc-02d30e2a4b41 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:48:15.455711 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-dbedb354-678e-464e-94fc-02d30e2a4b41 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:48:15.456889 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-dbedb354-678e-464e-94fc-02d30e2a4b41 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672" status: 200 len: 1748 microversion: 2.20 time: 0.152243 Oct 27 15:48:15.457435 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 485/894] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Oct 27 15:48:15 2021] GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672 => generated 1748 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 15:48:16.188055 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-fc6da3f8-0dc9-4f2f-8340-e9147f6a550c tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:48:16.188979 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-fc6da3f8-0dc9-4f2f-8340-e9147f6a550c tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: 62c89161-c119-48b2-839d-712db798ff96] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:48:16.195229 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-fc6da3f8-0dc9-4f2f-8340-e9147f6a550c tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:48:16.195669 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-fc6da3f8-0dc9-4f2f-8340-e9147f6a550c tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:48:16.196453 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-fc6da3f8-0dc9-4f2f-8340-e9147f6a550c tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:48:16.196879 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-fc6da3f8-0dc9-4f2f-8340-e9147f6a550c tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:48:16.227205 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-fc6da3f8-0dc9-4f2f-8340-e9147f6a550c tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043011 Oct 27 15:48:16.227779 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 410/895] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Oct 27 15:48:16 2021] GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 15:48:16.477274 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-66eaddde-5bbd-4a54-b96f-95c6761f3484 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:48:16.477823 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-66eaddde-5bbd-4a54-b96f-95c6761f3484 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:48:16.484185 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-66eaddde-5bbd-4a54-b96f-95c6761f3484 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:48:16.484622 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-66eaddde-5bbd-4a54-b96f-95c6761f3484 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:48:16.485388 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-66eaddde-5bbd-4a54-b96f-95c6761f3484 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:48:16.485813 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-66eaddde-5bbd-4a54-b96f-95c6761f3484 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:48:16.609329 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-66eaddde-5bbd-4a54-b96f-95c6761f3484 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:48:16.618011 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-66eaddde-5bbd-4a54-b96f-95c6761f3484 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:48:16.619756 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-66eaddde-5bbd-4a54-b96f-95c6761f3484 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:48:16.621179 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-66eaddde-5bbd-4a54-b96f-95c6761f3484 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672" status: 200 len: 1748 microversion: 2.20 time: 0.149074 Oct 27 15:48:16.621848 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 486/896] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Oct 27 15:48:16 2021] GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672 => generated 1748 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 15:48:17.238629 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-6b80d822-533c-4632-9bcd-cee5d3b0f225 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:48:17.239527 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-6b80d822-533c-4632-9bcd-cee5d3b0f225 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: 62c89161-c119-48b2-839d-712db798ff96] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:48:17.246189 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-6b80d822-533c-4632-9bcd-cee5d3b0f225 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:48:17.246639 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-6b80d822-533c-4632-9bcd-cee5d3b0f225 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:48:17.247397 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-6b80d822-533c-4632-9bcd-cee5d3b0f225 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:48:17.247831 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-6b80d822-533c-4632-9bcd-cee5d3b0f225 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:48:17.276447 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-6b80d822-533c-4632-9bcd-cee5d3b0f225 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041661 Oct 27 15:48:17.276996 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 411/897] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Oct 27 15:48:17 2021] GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 15:48:17.641635 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-a1a0fc97-03be-4327-9bf6-54781a91da12 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:48:17.642357 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-a1a0fc97-03be-4327-9bf6-54781a91da12 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:48:17.649600 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-a1a0fc97-03be-4327-9bf6-54781a91da12 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:48:17.650054 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-a1a0fc97-03be-4327-9bf6-54781a91da12 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:48:17.650819 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-a1a0fc97-03be-4327-9bf6-54781a91da12 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:48:17.651256 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-a1a0fc97-03be-4327-9bf6-54781a91da12 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:48:17.774961 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-a1a0fc97-03be-4327-9bf6-54781a91da12 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:48:17.783090 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-a1a0fc97-03be-4327-9bf6-54781a91da12 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:48:17.784581 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-a1a0fc97-03be-4327-9bf6-54781a91da12 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:48:17.785721 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-a1a0fc97-03be-4327-9bf6-54781a91da12 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672" status: 200 len: 1748 microversion: 2.20 time: 0.148485 Oct 27 15:48:17.786306 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 487/898] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Oct 27 15:48:17 2021] GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672 => generated 1748 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 15:48:18.288411 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-977cab1b-b070-42f5-a303-bc8b346910cb tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:48:18.289312 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-977cab1b-b070-42f5-a303-bc8b346910cb tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: 62c89161-c119-48b2-839d-712db798ff96] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:48:18.296183 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-977cab1b-b070-42f5-a303-bc8b346910cb tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:48:18.296628 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-977cab1b-b070-42f5-a303-bc8b346910cb tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:48:18.297386 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-977cab1b-b070-42f5-a303-bc8b346910cb tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:48:18.297817 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-977cab1b-b070-42f5-a303-bc8b346910cb tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:48:18.326490 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-977cab1b-b070-42f5-a303-bc8b346910cb tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041828 Oct 27 15:48:18.327043 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 412/899] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Oct 27 15:48:18 2021] GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 15:48:18.804032 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-63c275f6-8c33-4389-97c0-c2d250fccc02 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:48:18.804631 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-63c275f6-8c33-4389-97c0-c2d250fccc02 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:48:18.811281 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-63c275f6-8c33-4389-97c0-c2d250fccc02 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:48:18.811717 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-63c275f6-8c33-4389-97c0-c2d250fccc02 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:48:18.812499 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-63c275f6-8c33-4389-97c0-c2d250fccc02 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:48:18.812925 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-63c275f6-8c33-4389-97c0-c2d250fccc02 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:48:18.936509 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-63c275f6-8c33-4389-97c0-c2d250fccc02 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:48:18.944498 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-63c275f6-8c33-4389-97c0-c2d250fccc02 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:48:18.946676 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-63c275f6-8c33-4389-97c0-c2d250fccc02 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:48:18.947824 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-63c275f6-8c33-4389-97c0-c2d250fccc02 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672" status: 200 len: 1748 microversion: 2.20 time: 0.147572 Oct 27 15:48:18.948398 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 488/900] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Oct 27 15:48:18 2021] GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672 => generated 1748 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 15:48:19.338076 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-c91eef28-0e7a-496d-bf26-2489819fd5c5 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:48:19.339002 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-c91eef28-0e7a-496d-bf26-2489819fd5c5 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: 62c89161-c119-48b2-839d-712db798ff96] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:48:19.346516 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-c91eef28-0e7a-496d-bf26-2489819fd5c5 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:48:19.346960 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-c91eef28-0e7a-496d-bf26-2489819fd5c5 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:48:19.347717 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-c91eef28-0e7a-496d-bf26-2489819fd5c5 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:48:19.348172 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-c91eef28-0e7a-496d-bf26-2489819fd5c5 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:48:19.376657 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-c91eef28-0e7a-496d-bf26-2489819fd5c5 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042480 Oct 27 15:48:19.377200 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 413/901] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Oct 27 15:48:19 2021] GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 15:48:19.966377 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-66daae4e-9f62-4e97-9a81-88201444f91b tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:48:19.966977 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-66daae4e-9f62-4e97-9a81-88201444f91b tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:48:19.973436 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-66daae4e-9f62-4e97-9a81-88201444f91b tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:48:19.973876 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-66daae4e-9f62-4e97-9a81-88201444f91b tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:48:19.974634 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-66daae4e-9f62-4e97-9a81-88201444f91b tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:48:19.975067 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-66daae4e-9f62-4e97-9a81-88201444f91b tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:48:20.095128 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-66daae4e-9f62-4e97-9a81-88201444f91b tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:48:20.104511 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-66daae4e-9f62-4e97-9a81-88201444f91b tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:48:20.106002 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-66daae4e-9f62-4e97-9a81-88201444f91b tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:48:20.107149 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-66daae4e-9f62-4e97-9a81-88201444f91b tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672" status: 200 len: 1748 microversion: 2.20 time: 0.144534 Oct 27 15:48:20.107709 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 489/902] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Oct 27 15:48:19 2021] GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672 => generated 1748 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 15:48:20.388185 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-32f267f7-f3e1-4364-a3b0-15284ac24834 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:48:20.389083 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-32f267f7-f3e1-4364-a3b0-15284ac24834 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: 62c89161-c119-48b2-839d-712db798ff96] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:48:20.395266 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-32f267f7-f3e1-4364-a3b0-15284ac24834 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:48:20.395710 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-32f267f7-f3e1-4364-a3b0-15284ac24834 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:48:20.396507 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-32f267f7-f3e1-4364-a3b0-15284ac24834 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:48:20.396938 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-32f267f7-f3e1-4364-a3b0-15284ac24834 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:48:20.426348 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-32f267f7-f3e1-4364-a3b0-15284ac24834 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042034 Oct 27 15:48:20.426901 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 414/903] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Oct 27 15:48:20 2021] GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 15:48:21.125039 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-11bfb3cc-df7e-4fdd-8b51-534cfaa8e2b8 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:48:21.125641 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-11bfb3cc-df7e-4fdd-8b51-534cfaa8e2b8 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:48:21.131832 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-11bfb3cc-df7e-4fdd-8b51-534cfaa8e2b8 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:48:21.132421 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-11bfb3cc-df7e-4fdd-8b51-534cfaa8e2b8 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:48:21.133340 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-11bfb3cc-df7e-4fdd-8b51-534cfaa8e2b8 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:48:21.133832 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-11bfb3cc-df7e-4fdd-8b51-534cfaa8e2b8 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:48:21.254575 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-11bfb3cc-df7e-4fdd-8b51-534cfaa8e2b8 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:48:21.263326 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-11bfb3cc-df7e-4fdd-8b51-534cfaa8e2b8 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:48:21.264835 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-11bfb3cc-df7e-4fdd-8b51-534cfaa8e2b8 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:48:21.265985 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-11bfb3cc-df7e-4fdd-8b51-534cfaa8e2b8 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672" status: 200 len: 1748 microversion: 2.20 time: 0.144775 Oct 27 15:48:21.266541 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 490/904] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Oct 27 15:48:21 2021] GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672 => generated 1748 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 15:48:21.437698 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-9af13b43-57a0-44d7-91aa-23305b20e09c tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:48:21.438592 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-9af13b43-57a0-44d7-91aa-23305b20e09c tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: 62c89161-c119-48b2-839d-712db798ff96] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:48:21.444698 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-9af13b43-57a0-44d7-91aa-23305b20e09c tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:48:21.445141 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-9af13b43-57a0-44d7-91aa-23305b20e09c tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:48:21.446426 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-9af13b43-57a0-44d7-91aa-23305b20e09c tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:48:21.446854 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-9af13b43-57a0-44d7-91aa-23305b20e09c tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:48:21.476484 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-9af13b43-57a0-44d7-91aa-23305b20e09c tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042499 Oct 27 15:48:21.477037 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 415/905] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Oct 27 15:48:21 2021] GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 15:48:22.284551 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-7df99ddc-5c20-4eb2-a0c5-dae2252b9f33 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:48:22.285156 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-7df99ddc-5c20-4eb2-a0c5-dae2252b9f33 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:48:22.291208 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-7df99ddc-5c20-4eb2-a0c5-dae2252b9f33 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:48:22.291647 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-7df99ddc-5c20-4eb2-a0c5-dae2252b9f33 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:48:22.292435 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-7df99ddc-5c20-4eb2-a0c5-dae2252b9f33 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:48:22.292895 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-7df99ddc-5c20-4eb2-a0c5-dae2252b9f33 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:48:22.418819 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-7df99ddc-5c20-4eb2-a0c5-dae2252b9f33 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:48:22.426842 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-7df99ddc-5c20-4eb2-a0c5-dae2252b9f33 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:48:22.428335 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-7df99ddc-5c20-4eb2-a0c5-dae2252b9f33 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:48:22.429468 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-7df99ddc-5c20-4eb2-a0c5-dae2252b9f33 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672" status: 200 len: 1748 microversion: 2.20 time: 0.148803 Oct 27 15:48:22.430638 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 491/906] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Oct 27 15:48:22 2021] GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672 => generated 1748 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 15:48:22.487547 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-029a94b3-b9b6-4566-95e3-a668f3ac70a5 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:48:22.488387 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-029a94b3-b9b6-4566-95e3-a668f3ac70a5 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: 62c89161-c119-48b2-839d-712db798ff96] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:48:22.495410 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-029a94b3-b9b6-4566-95e3-a668f3ac70a5 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:48:22.495864 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-029a94b3-b9b6-4566-95e3-a668f3ac70a5 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:48:22.496625 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-029a94b3-b9b6-4566-95e3-a668f3ac70a5 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:48:22.497051 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-029a94b3-b9b6-4566-95e3-a668f3ac70a5 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:48:22.526207 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-029a94b3-b9b6-4566-95e3-a668f3ac70a5 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042441 Oct 27 15:48:22.526754 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 416/907] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Oct 27 15:48:22 2021] GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 15:48:23.449427 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-107c48f7-20a7-444d-81fd-a4823331f059 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:48:23.450030 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-107c48f7-20a7-444d-81fd-a4823331f059 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:48:23.456296 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-107c48f7-20a7-444d-81fd-a4823331f059 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:48:23.456739 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-107c48f7-20a7-444d-81fd-a4823331f059 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:48:23.457499 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-107c48f7-20a7-444d-81fd-a4823331f059 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:48:23.457931 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-107c48f7-20a7-444d-81fd-a4823331f059 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:48:23.537768 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-d0248051-5f00-4973-ad92-b104e19e0b48 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:48:23.538689 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-d0248051-5f00-4973-ad92-b104e19e0b48 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: 62c89161-c119-48b2-839d-712db798ff96] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:48:23.544963 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-d0248051-5f00-4973-ad92-b104e19e0b48 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:48:23.545404 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-d0248051-5f00-4973-ad92-b104e19e0b48 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:48:23.546167 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-d0248051-5f00-4973-ad92-b104e19e0b48 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:48:23.546593 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-d0248051-5f00-4973-ad92-b104e19e0b48 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:48:23.578541 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-d0248051-5f00-4973-ad92-b104e19e0b48 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044542 Oct 27 15:48:23.579107 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 417/908] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Oct 27 15:48:23 2021] GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 15:48:23.581538 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-107c48f7-20a7-444d-81fd-a4823331f059 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:48:23.593878 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-107c48f7-20a7-444d-81fd-a4823331f059 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:48:23.595431 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-107c48f7-20a7-444d-81fd-a4823331f059 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:48:23.596970 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-107c48f7-20a7-444d-81fd-a4823331f059 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672" status: 200 len: 1748 microversion: 2.20 time: 0.151773 Oct 27 15:48:23.597624 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 492/909] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Oct 27 15:48:23 2021] GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672 => generated 1748 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 15:48:24.592175 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-586db003-70ad-4165-a255-9254f7aaf434 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:48:24.592982 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-586db003-70ad-4165-a255-9254f7aaf434 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: 62c89161-c119-48b2-839d-712db798ff96] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:48:24.599375 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-586db003-70ad-4165-a255-9254f7aaf434 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:48:24.599819 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-586db003-70ad-4165-a255-9254f7aaf434 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:48:24.600611 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-586db003-70ad-4165-a255-9254f7aaf434 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:48:24.601039 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-586db003-70ad-4165-a255-9254f7aaf434 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:48:24.614468 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-8e6500fb-6071-4320-b61f-a271ee11dbb1 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:48:24.615192 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-8e6500fb-6071-4320-b61f-a271ee11dbb1 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:48:24.622141 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-8e6500fb-6071-4320-b61f-a271ee11dbb1 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:48:24.622585 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-8e6500fb-6071-4320-b61f-a271ee11dbb1 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:48:24.623355 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-8e6500fb-6071-4320-b61f-a271ee11dbb1 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:48:24.623786 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-8e6500fb-6071-4320-b61f-a271ee11dbb1 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:48:24.632146 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-586db003-70ad-4165-a255-9254f7aaf434 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043750 Oct 27 15:48:24.633037 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 418/910] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Oct 27 15:48:24 2021] GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 15:48:24.745951 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-8e6500fb-6071-4320-b61f-a271ee11dbb1 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:48:24.754088 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-8e6500fb-6071-4320-b61f-a271ee11dbb1 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:48:24.755588 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-8e6500fb-6071-4320-b61f-a271ee11dbb1 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:48:24.756772 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-8e6500fb-6071-4320-b61f-a271ee11dbb1 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672" status: 200 len: 1748 microversion: 2.20 time: 0.146091 Oct 27 15:48:24.757322 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 493/911] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Oct 27 15:48:24 2021] GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672 => generated 1748 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 15:48:25.644030 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-67bd97fa-61ad-4510-a53c-bd24454f4f57 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:48:25.644914 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-67bd97fa-61ad-4510-a53c-bd24454f4f57 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: 62c89161-c119-48b2-839d-712db798ff96] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:48:25.651454 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-67bd97fa-61ad-4510-a53c-bd24454f4f57 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:48:25.651980 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-67bd97fa-61ad-4510-a53c-bd24454f4f57 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:48:25.652873 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-67bd97fa-61ad-4510-a53c-bd24454f4f57 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:48:25.653515 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-67bd97fa-61ad-4510-a53c-bd24454f4f57 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:48:25.684228 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-67bd97fa-61ad-4510-a53c-bd24454f4f57 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043950 Oct 27 15:48:25.684779 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 419/912] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Oct 27 15:48:25 2021] GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 15:48:25.774932 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-a278e471-f887-4071-a35c-6bb4190fdf28 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:48:25.775524 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-a278e471-f887-4071-a35c-6bb4190fdf28 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:48:25.781969 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-a278e471-f887-4071-a35c-6bb4190fdf28 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:48:25.782408 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-a278e471-f887-4071-a35c-6bb4190fdf28 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:48:25.783162 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-a278e471-f887-4071-a35c-6bb4190fdf28 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:48:25.783589 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-a278e471-f887-4071-a35c-6bb4190fdf28 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:48:25.906382 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-a278e471-f887-4071-a35c-6bb4190fdf28 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:48:25.915127 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-a278e471-f887-4071-a35c-6bb4190fdf28 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:48:25.916694 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-a278e471-f887-4071-a35c-6bb4190fdf28 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:48:25.917865 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-a278e471-f887-4071-a35c-6bb4190fdf28 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672" status: 200 len: 1748 microversion: 2.20 time: 0.146696 Oct 27 15:48:25.918670 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 494/913] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Oct 27 15:48:25 2021] GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672 => generated 1748 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 15:48:26.695919 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-5d810c06-18b2-4158-bab3-b206a8beb737 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:48:26.696964 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-5d810c06-18b2-4158-bab3-b206a8beb737 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: 62c89161-c119-48b2-839d-712db798ff96] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:48:26.703019 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-5d810c06-18b2-4158-bab3-b206a8beb737 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:48:26.703457 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-5d810c06-18b2-4158-bab3-b206a8beb737 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:48:26.704240 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-5d810c06-18b2-4158-bab3-b206a8beb737 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:48:26.704665 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-5d810c06-18b2-4158-bab3-b206a8beb737 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:48:26.735078 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-5d810c06-18b2-4158-bab3-b206a8beb737 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043422 Oct 27 15:48:26.735643 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 420/914] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Oct 27 15:48:26 2021] GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 15:48:26.936231 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-cdbca813-750b-4e17-98fb-c967092454c6 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:48:26.936854 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-cdbca813-750b-4e17-98fb-c967092454c6 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:48:26.942963 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-cdbca813-750b-4e17-98fb-c967092454c6 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:48:26.943406 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-cdbca813-750b-4e17-98fb-c967092454c6 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:48:26.944236 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-cdbca813-750b-4e17-98fb-c967092454c6 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:48:26.944695 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-cdbca813-750b-4e17-98fb-c967092454c6 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:48:27.079319 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-cdbca813-750b-4e17-98fb-c967092454c6 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:48:27.087782 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-cdbca813-750b-4e17-98fb-c967092454c6 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:48:27.089298 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-cdbca813-750b-4e17-98fb-c967092454c6 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:48:27.090450 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-cdbca813-750b-4e17-98fb-c967092454c6 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672" status: 200 len: 1748 microversion: 2.20 time: 0.158003 Oct 27 15:48:27.091009 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 495/915] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Oct 27 15:48:26 2021] GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672 => generated 1748 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 15:48:27.747631 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-6571b174-fc7c-4c33-842f-3a1e0a9eae79 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:48:27.748590 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-6571b174-fc7c-4c33-842f-3a1e0a9eae79 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: 62c89161-c119-48b2-839d-712db798ff96] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:48:27.754755 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-6571b174-fc7c-4c33-842f-3a1e0a9eae79 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:48:27.755200 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-6571b174-fc7c-4c33-842f-3a1e0a9eae79 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:48:27.755983 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-6571b174-fc7c-4c33-842f-3a1e0a9eae79 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:48:27.756416 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-6571b174-fc7c-4c33-842f-3a1e0a9eae79 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:48:27.785164 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-6571b174-fc7c-4c33-842f-3a1e0a9eae79 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041377 Oct 27 15:48:27.785731 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 421/916] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Oct 27 15:48:27 2021] GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 15:48:28.109200 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-91e8450c-dc7d-4dc3-845f-e74c32c5989c tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:48:28.109950 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-91e8450c-dc7d-4dc3-845f-e74c32c5989c tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:48:28.116431 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-91e8450c-dc7d-4dc3-845f-e74c32c5989c tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:48:28.116869 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-91e8450c-dc7d-4dc3-845f-e74c32c5989c tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:48:28.118245 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-91e8450c-dc7d-4dc3-845f-e74c32c5989c tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:48:28.118835 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-91e8450c-dc7d-4dc3-845f-e74c32c5989c tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:48:28.245097 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-91e8450c-dc7d-4dc3-845f-e74c32c5989c tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:48:28.253260 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-91e8450c-dc7d-4dc3-845f-e74c32c5989c tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:48:28.254743 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-91e8450c-dc7d-4dc3-845f-e74c32c5989c tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:48:28.255920 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-91e8450c-dc7d-4dc3-845f-e74c32c5989c tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672" status: 200 len: 1748 microversion: 2.20 time: 0.151080 Oct 27 15:48:28.256480 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 496/917] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Oct 27 15:48:28 2021] GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672 => generated 1748 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 15:48:28.796611 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-050ccaa6-6010-4eb0-b9c5-7954c2e8d5ea tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:48:28.797501 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-050ccaa6-6010-4eb0-b9c5-7954c2e8d5ea tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: 62c89161-c119-48b2-839d-712db798ff96] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:48:28.803816 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-050ccaa6-6010-4eb0-b9c5-7954c2e8d5ea tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:48:28.804385 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-050ccaa6-6010-4eb0-b9c5-7954c2e8d5ea tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:48:28.805761 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-050ccaa6-6010-4eb0-b9c5-7954c2e8d5ea tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:48:28.806197 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-050ccaa6-6010-4eb0-b9c5-7954c2e8d5ea tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:48:28.835440 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-050ccaa6-6010-4eb0-b9c5-7954c2e8d5ea tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042595 Oct 27 15:48:28.836629 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 422/918] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Oct 27 15:48:28 2021] GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 15:48:29.273648 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-71576f26-9a2c-40bd-95a1-377f3f939dd2 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:48:29.274246 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-71576f26-9a2c-40bd-95a1-377f3f939dd2 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:48:29.280783 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-71576f26-9a2c-40bd-95a1-377f3f939dd2 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:48:29.281306 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-71576f26-9a2c-40bd-95a1-377f3f939dd2 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:48:29.282187 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-71576f26-9a2c-40bd-95a1-377f3f939dd2 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:48:29.282667 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-71576f26-9a2c-40bd-95a1-377f3f939dd2 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:48:29.406343 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-71576f26-9a2c-40bd-95a1-377f3f939dd2 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:48:29.414492 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-71576f26-9a2c-40bd-95a1-377f3f939dd2 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:48:29.416126 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-71576f26-9a2c-40bd-95a1-377f3f939dd2 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:48:29.417283 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-71576f26-9a2c-40bd-95a1-377f3f939dd2 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672" status: 200 len: 1748 microversion: 2.20 time: 0.147430 Oct 27 15:48:29.417845 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 497/919] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Oct 27 15:48:29 2021] GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672 => generated 1748 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 15:48:29.847704 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-defaefff-3ac3-4d8b-ae6b-cb76df697bd6 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:48:29.848621 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-defaefff-3ac3-4d8b-ae6b-cb76df697bd6 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: 62c89161-c119-48b2-839d-712db798ff96] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:48:29.855594 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-defaefff-3ac3-4d8b-ae6b-cb76df697bd6 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:48:29.856145 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-defaefff-3ac3-4d8b-ae6b-cb76df697bd6 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:48:29.856917 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-defaefff-3ac3-4d8b-ae6b-cb76df697bd6 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:48:29.857345 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-defaefff-3ac3-4d8b-ae6b-cb76df697bd6 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:48:29.885798 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-defaefff-3ac3-4d8b-ae6b-cb76df697bd6 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042084 Oct 27 15:48:29.886363 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 423/920] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Oct 27 15:48:29 2021] GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 15:48:30.434971 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-f4848287-5241-48d8-9312-967e49d3c07d tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:48:30.435506 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-f4848287-5241-48d8-9312-967e49d3c07d tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:48:30.441727 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-f4848287-5241-48d8-9312-967e49d3c07d tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:48:30.442163 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-f4848287-5241-48d8-9312-967e49d3c07d tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:48:30.442918 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-f4848287-5241-48d8-9312-967e49d3c07d tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:48:30.443344 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-f4848287-5241-48d8-9312-967e49d3c07d tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:48:30.572166 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-f4848287-5241-48d8-9312-967e49d3c07d tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:48:30.580443 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-f4848287-5241-48d8-9312-967e49d3c07d tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:48:30.581935 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-f4848287-5241-48d8-9312-967e49d3c07d tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:48:30.583081 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-f4848287-5241-48d8-9312-967e49d3c07d tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672" status: 200 len: 1748 microversion: 2.20 time: 0.151910 Oct 27 15:48:30.583638 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 498/921] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Oct 27 15:48:30 2021] GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672 => generated 1748 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 15:48:30.897461 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-8cfea6f7-6f9a-4c31-ad65-112459b43f63 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:48:30.898361 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-8cfea6f7-6f9a-4c31-ad65-112459b43f63 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: 62c89161-c119-48b2-839d-712db798ff96] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:48:30.905017 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-8cfea6f7-6f9a-4c31-ad65-112459b43f63 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:48:30.905457 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-8cfea6f7-6f9a-4c31-ad65-112459b43f63 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:48:30.906217 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-8cfea6f7-6f9a-4c31-ad65-112459b43f63 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:48:30.906651 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-8cfea6f7-6f9a-4c31-ad65-112459b43f63 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:48:30.936503 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-8cfea6f7-6f9a-4c31-ad65-112459b43f63 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042800 Oct 27 15:48:30.937072 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 424/922] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Oct 27 15:48:30 2021] GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 15:48:31.602143 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-05de71a7-8226-46e3-8e9f-92f853bd89ce tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:48:31.602923 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-05de71a7-8226-46e3-8e9f-92f853bd89ce tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:48:31.609019 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-05de71a7-8226-46e3-8e9f-92f853bd89ce tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:48:31.609458 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-05de71a7-8226-46e3-8e9f-92f853bd89ce tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:48:31.610213 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-05de71a7-8226-46e3-8e9f-92f853bd89ce tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:48:31.610639 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-05de71a7-8226-46e3-8e9f-92f853bd89ce tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:48:31.736590 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-05de71a7-8226-46e3-8e9f-92f853bd89ce tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:48:31.745168 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-05de71a7-8226-46e3-8e9f-92f853bd89ce tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:48:31.746661 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-05de71a7-8226-46e3-8e9f-92f853bd89ce tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:48:31.748047 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-05de71a7-8226-46e3-8e9f-92f853bd89ce tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672" status: 200 len: 1748 microversion: 2.20 time: 0.150119 Oct 27 15:48:31.748606 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 499/923] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Oct 27 15:48:31 2021] GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672 => generated 1748 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 15:48:31.947794 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-5175c566-1eca-4080-83c1-81475a2334c7 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:48:31.948770 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-5175c566-1eca-4080-83c1-81475a2334c7 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: 62c89161-c119-48b2-839d-712db798ff96] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:48:31.954879 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-5175c566-1eca-4080-83c1-81475a2334c7 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:48:31.955316 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-5175c566-1eca-4080-83c1-81475a2334c7 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:48:31.956102 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-5175c566-1eca-4080-83c1-81475a2334c7 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:48:31.956527 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-5175c566-1eca-4080-83c1-81475a2334c7 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:48:31.986150 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-5175c566-1eca-4080-83c1-81475a2334c7 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042891 Oct 27 15:48:31.986695 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 425/924] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Oct 27 15:48:31 2021] GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 15:48:32.766524 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-80213e43-592c-4b30-861a-a2be1d6655ad tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:48:32.767105 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-80213e43-592c-4b30-861a-a2be1d6655ad tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:48:32.775146 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-80213e43-592c-4b30-861a-a2be1d6655ad tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:48:32.775592 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-80213e43-592c-4b30-861a-a2be1d6655ad tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:48:32.777452 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-80213e43-592c-4b30-861a-a2be1d6655ad tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:48:32.777880 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-80213e43-592c-4b30-861a-a2be1d6655ad tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:48:32.910590 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-80213e43-592c-4b30-861a-a2be1d6655ad tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:48:32.919825 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-80213e43-592c-4b30-861a-a2be1d6655ad tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:48:32.921343 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-80213e43-592c-4b30-861a-a2be1d6655ad tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:48:32.922508 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-80213e43-592c-4b30-861a-a2be1d6655ad tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672" status: 200 len: 1748 microversion: 2.20 time: 0.159704 Oct 27 15:48:32.923078 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 500/925] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Oct 27 15:48:32 2021] GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672 => generated 1748 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 15:48:32.997949 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-1f0e3221-1542-46c3-a3db-b2635462f1ff tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:48:32.998896 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-1f0e3221-1542-46c3-a3db-b2635462f1ff tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: 62c89161-c119-48b2-839d-712db798ff96] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:48:33.005176 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-1f0e3221-1542-46c3-a3db-b2635462f1ff tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:48:33.005617 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-1f0e3221-1542-46c3-a3db-b2635462f1ff tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:48:33.006372 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-1f0e3221-1542-46c3-a3db-b2635462f1ff tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:48:33.006795 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-1f0e3221-1542-46c3-a3db-b2635462f1ff tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:48:33.036835 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-1f0e3221-1542-46c3-a3db-b2635462f1ff tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042510 Oct 27 15:48:33.037306 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 426/926] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Oct 27 15:48:32 2021] GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 15:48:33.942273 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-17f23d83-6fc9-45a1-9c1c-e4ddd5d91b18 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:48:33.942880 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-17f23d83-6fc9-45a1-9c1c-e4ddd5d91b18 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:48:33.949907 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-17f23d83-6fc9-45a1-9c1c-e4ddd5d91b18 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:48:33.950349 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-17f23d83-6fc9-45a1-9c1c-e4ddd5d91b18 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:48:33.951111 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-17f23d83-6fc9-45a1-9c1c-e4ddd5d91b18 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:48:33.951544 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-17f23d83-6fc9-45a1-9c1c-e4ddd5d91b18 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:48:34.049407 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-33913150-aeef-4505-b2ba-08219a6e3a49 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:48:34.050360 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-33913150-aeef-4505-b2ba-08219a6e3a49 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: 62c89161-c119-48b2-839d-712db798ff96] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:48:34.057343 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-33913150-aeef-4505-b2ba-08219a6e3a49 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:48:34.057789 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-33913150-aeef-4505-b2ba-08219a6e3a49 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:48:34.058559 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-33913150-aeef-4505-b2ba-08219a6e3a49 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:48:34.059023 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-33913150-aeef-4505-b2ba-08219a6e3a49 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:48:34.069464 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-17f23d83-6fc9-45a1-9c1c-e4ddd5d91b18 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:48:34.078138 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-17f23d83-6fc9-45a1-9c1c-e4ddd5d91b18 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:48:34.079629 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-17f23d83-6fc9-45a1-9c1c-e4ddd5d91b18 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:48:34.080818 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-17f23d83-6fc9-45a1-9c1c-e4ddd5d91b18 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672" status: 200 len: 1748 microversion: 2.20 time: 0.142249 Oct 27 15:48:34.081377 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 501/927] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Oct 27 15:48:33 2021] GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672 => generated 1748 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 15:48:34.089176 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-33913150-aeef-4505-b2ba-08219a6e3a49 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043524 Oct 27 15:48:34.089726 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 427/928] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Oct 27 15:48:34 2021] GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 15:48:35.099801 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-75dce9ed-ee2c-4dac-b8fb-1678f63260b7 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:48:35.100424 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-75dce9ed-ee2c-4dac-b8fb-1678f63260b7 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:48:35.100662 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-6cfa0d08-8d03-4819-a299-f3faf57f7c69 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:48:35.101725 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-6cfa0d08-8d03-4819-a299-f3faf57f7c69 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: 62c89161-c119-48b2-839d-712db798ff96] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:48:35.107085 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-75dce9ed-ee2c-4dac-b8fb-1678f63260b7 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:48:35.107528 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-75dce9ed-ee2c-4dac-b8fb-1678f63260b7 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:48:35.108320 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-75dce9ed-ee2c-4dac-b8fb-1678f63260b7 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:48:35.108628 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-6cfa0d08-8d03-4819-a299-f3faf57f7c69 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:48:35.108748 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-75dce9ed-ee2c-4dac-b8fb-1678f63260b7 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:48:35.109071 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-6cfa0d08-8d03-4819-a299-f3faf57f7c69 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:48:35.109829 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-6cfa0d08-8d03-4819-a299-f3faf57f7c69 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:48:35.110258 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-6cfa0d08-8d03-4819-a299-f3faf57f7c69 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:48:35.139870 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-6cfa0d08-8d03-4819-a299-f3faf57f7c69 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042684 Oct 27 15:48:35.140362 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 428/929] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Oct 27 15:48:35 2021] GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 15:48:35.224919 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-75dce9ed-ee2c-4dac-b8fb-1678f63260b7 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:48:35.234291 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-75dce9ed-ee2c-4dac-b8fb-1678f63260b7 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:48:35.235863 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-75dce9ed-ee2c-4dac-b8fb-1678f63260b7 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:48:35.236999 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-75dce9ed-ee2c-4dac-b8fb-1678f63260b7 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672" status: 200 len: 1748 microversion: 2.20 time: 0.141298 Oct 27 15:48:35.237545 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 502/930] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Oct 27 15:48:35 2021] GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672 => generated 1748 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 15:48:36.151284 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-ca682ecb-ac68-436f-b112-7bafa1fd4c93 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:48:36.152196 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-ca682ecb-ac68-436f-b112-7bafa1fd4c93 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: 62c89161-c119-48b2-839d-712db798ff96] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:48:36.158376 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-ca682ecb-ac68-436f-b112-7bafa1fd4c93 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:48:36.158811 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-ca682ecb-ac68-436f-b112-7bafa1fd4c93 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:48:36.159558 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-ca682ecb-ac68-436f-b112-7bafa1fd4c93 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:48:36.160020 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-ca682ecb-ac68-436f-b112-7bafa1fd4c93 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:48:36.188683 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-ca682ecb-ac68-436f-b112-7bafa1fd4c93 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041430 Oct 27 15:48:36.189221 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 429/931] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Oct 27 15:48:36 2021] GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 15:48:36.255159 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-d08a0a16-6715-4e27-8801-ecf031b7224c tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:48:36.255753 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-d08a0a16-6715-4e27-8801-ecf031b7224c tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:48:36.262351 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-d08a0a16-6715-4e27-8801-ecf031b7224c tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:48:36.262788 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-d08a0a16-6715-4e27-8801-ecf031b7224c tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:48:36.263542 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-d08a0a16-6715-4e27-8801-ecf031b7224c tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:48:36.264006 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-d08a0a16-6715-4e27-8801-ecf031b7224c tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:48:36.383968 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-d08a0a16-6715-4e27-8801-ecf031b7224c tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:48:36.392054 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-d08a0a16-6715-4e27-8801-ecf031b7224c tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:48:36.393564 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-d08a0a16-6715-4e27-8801-ecf031b7224c tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:48:36.394716 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-d08a0a16-6715-4e27-8801-ecf031b7224c tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672" status: 200 len: 1748 microversion: 2.20 time: 0.143223 Oct 27 15:48:36.395433 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 503/932] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Oct 27 15:48:36 2021] GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672 => generated 1748 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 15:48:37.200326 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-3f37003e-505f-4fb3-941a-1af34ca23a29 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:48:37.201251 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-3f37003e-505f-4fb3-941a-1af34ca23a29 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: 62c89161-c119-48b2-839d-712db798ff96] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:48:37.207326 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-3f37003e-505f-4fb3-941a-1af34ca23a29 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:48:37.207765 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-3f37003e-505f-4fb3-941a-1af34ca23a29 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:48:37.208544 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-3f37003e-505f-4fb3-941a-1af34ca23a29 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:48:37.208973 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-3f37003e-505f-4fb3-941a-1af34ca23a29 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:48:37.241401 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-3f37003e-505f-4fb3-941a-1af34ca23a29 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045448 Oct 27 15:48:37.242039 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 430/933] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Oct 27 15:48:37 2021] GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 15:48:37.411741 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-82c02e72-6af8-4fda-b430-8ef8bf83af0e tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:48:37.412376 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-82c02e72-6af8-4fda-b430-8ef8bf83af0e tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:48:37.418571 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-82c02e72-6af8-4fda-b430-8ef8bf83af0e tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:48:37.419012 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-82c02e72-6af8-4fda-b430-8ef8bf83af0e tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:48:37.419767 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-82c02e72-6af8-4fda-b430-8ef8bf83af0e tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:48:37.420224 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-82c02e72-6af8-4fda-b430-8ef8bf83af0e tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:48:37.539701 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-82c02e72-6af8-4fda-b430-8ef8bf83af0e tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:48:37.548051 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-82c02e72-6af8-4fda-b430-8ef8bf83af0e tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:48:37.549547 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-82c02e72-6af8-4fda-b430-8ef8bf83af0e tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:48:37.550690 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-82c02e72-6af8-4fda-b430-8ef8bf83af0e tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672" status: 200 len: 1748 microversion: 2.20 time: 0.142740 Oct 27 15:48:37.551244 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 504/934] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Oct 27 15:48:37 2021] GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672 => generated 1748 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 15:48:38.253311 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-827120c7-6392-4995-99c5-cf955e2fed58 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:48:38.254324 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-827120c7-6392-4995-99c5-cf955e2fed58 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: 62c89161-c119-48b2-839d-712db798ff96] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:48:38.261256 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-827120c7-6392-4995-99c5-cf955e2fed58 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:48:38.261738 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-827120c7-6392-4995-99c5-cf955e2fed58 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:48:38.262607 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-827120c7-6392-4995-99c5-cf955e2fed58 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:48:38.263099 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-827120c7-6392-4995-99c5-cf955e2fed58 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:48:38.291983 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-827120c7-6392-4995-99c5-cf955e2fed58 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042924 Oct 27 15:48:38.292533 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 431/935] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Oct 27 15:48:38 2021] GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 15:48:38.569004 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-def7b2da-474d-403b-94ca-0e853f3cc122 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:48:38.569603 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-def7b2da-474d-403b-94ca-0e853f3cc122 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:48:38.576314 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-def7b2da-474d-403b-94ca-0e853f3cc122 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:48:38.576754 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-def7b2da-474d-403b-94ca-0e853f3cc122 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:48:38.577810 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-def7b2da-474d-403b-94ca-0e853f3cc122 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:48:38.578276 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-def7b2da-474d-403b-94ca-0e853f3cc122 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:48:38.707834 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-def7b2da-474d-403b-94ca-0e853f3cc122 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:48:38.716593 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-def7b2da-474d-403b-94ca-0e853f3cc122 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:48:38.718088 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-def7b2da-474d-403b-94ca-0e853f3cc122 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:48:38.719230 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-def7b2da-474d-403b-94ca-0e853f3cc122 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672" status: 200 len: 1748 microversion: 2.20 time: 0.153928 Oct 27 15:48:38.719782 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 505/936] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Oct 27 15:48:38 2021] GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672 => generated 1748 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 15:48:39.303346 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-652bdb09-8e7d-4a73-9d22-62ae5c631c59 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:48:39.304299 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-652bdb09-8e7d-4a73-9d22-62ae5c631c59 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: 62c89161-c119-48b2-839d-712db798ff96] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:48:39.311309 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-652bdb09-8e7d-4a73-9d22-62ae5c631c59 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:48:39.311744 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-652bdb09-8e7d-4a73-9d22-62ae5c631c59 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:48:39.312531 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-652bdb09-8e7d-4a73-9d22-62ae5c631c59 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:48:39.312956 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-652bdb09-8e7d-4a73-9d22-62ae5c631c59 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:48:39.340971 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-652bdb09-8e7d-4a73-9d22-62ae5c631c59 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041418 Oct 27 15:48:39.341507 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 432/937] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Oct 27 15:48:39 2021] GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 15:48:39.737523 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-626914bf-71dd-4c5c-8ad1-37911586e5c6 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:48:39.738129 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-626914bf-71dd-4c5c-8ad1-37911586e5c6 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:48:39.744569 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-626914bf-71dd-4c5c-8ad1-37911586e5c6 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:48:39.745011 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-626914bf-71dd-4c5c-8ad1-37911586e5c6 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:48:39.745771 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-626914bf-71dd-4c5c-8ad1-37911586e5c6 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:48:39.746202 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-626914bf-71dd-4c5c-8ad1-37911586e5c6 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:48:39.869470 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-626914bf-71dd-4c5c-8ad1-37911586e5c6 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:48:39.877522 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-626914bf-71dd-4c5c-8ad1-37911586e5c6 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:48:39.879045 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-626914bf-71dd-4c5c-8ad1-37911586e5c6 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:48:39.880222 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-626914bf-71dd-4c5c-8ad1-37911586e5c6 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672" status: 200 len: 1748 microversion: 2.20 time: 0.146352 Oct 27 15:48:39.880778 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 506/938] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Oct 27 15:48:39 2021] GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672 => generated 1748 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 15:48:40.352325 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-cdac31cf-9270-4cb7-9453-cb2d55fba1f8 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:48:40.353255 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-cdac31cf-9270-4cb7-9453-cb2d55fba1f8 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: 62c89161-c119-48b2-839d-712db798ff96] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:48:40.359313 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-cdac31cf-9270-4cb7-9453-cb2d55fba1f8 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:48:40.359746 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-cdac31cf-9270-4cb7-9453-cb2d55fba1f8 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:48:40.360528 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-cdac31cf-9270-4cb7-9453-cb2d55fba1f8 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:48:40.360950 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-cdac31cf-9270-4cb7-9453-cb2d55fba1f8 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:48:40.390102 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-cdac31cf-9270-4cb7-9453-cb2d55fba1f8 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041569 Oct 27 15:48:40.390649 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 433/939] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Oct 27 15:48:40 2021] GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 15:48:40.898091 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-5ab6d35e-c998-45f1-a507-608ebcd8db3a tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:48:40.898618 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-5ab6d35e-c998-45f1-a507-608ebcd8db3a tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:48:40.904900 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-5ab6d35e-c998-45f1-a507-608ebcd8db3a tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:48:40.905344 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-5ab6d35e-c998-45f1-a507-608ebcd8db3a tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:48:40.906109 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-5ab6d35e-c998-45f1-a507-608ebcd8db3a tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:48:40.906541 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-5ab6d35e-c998-45f1-a507-608ebcd8db3a tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:48:41.028065 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-5ab6d35e-c998-45f1-a507-608ebcd8db3a tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:48:41.036809 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-5ab6d35e-c998-45f1-a507-608ebcd8db3a tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:48:41.038401 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-5ab6d35e-c998-45f1-a507-608ebcd8db3a tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:48:41.039576 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-5ab6d35e-c998-45f1-a507-608ebcd8db3a tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672" status: 200 len: 1748 microversion: 2.20 time: 0.145337 Oct 27 15:48:41.041389 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 507/940] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Oct 27 15:48:40 2021] GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672 => generated 1748 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 15:48:41.402090 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-53cb75eb-99d6-43fa-8605-e1692538a764 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:48:41.403003 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-53cb75eb-99d6-43fa-8605-e1692538a764 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: 62c89161-c119-48b2-839d-712db798ff96] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:48:41.409145 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-53cb75eb-99d6-43fa-8605-e1692538a764 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:48:41.409579 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-53cb75eb-99d6-43fa-8605-e1692538a764 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:48:41.410326 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-53cb75eb-99d6-43fa-8605-e1692538a764 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:48:41.410751 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-53cb75eb-99d6-43fa-8605-e1692538a764 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:48:41.439767 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-53cb75eb-99d6-43fa-8605-e1692538a764 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042198 Oct 27 15:48:41.440359 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 434/941] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Oct 27 15:48:41 2021] GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 15:48:42.058479 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-ca6d7b19-a28b-41ca-952d-a8b94cd953c5 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:48:42.059082 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-ca6d7b19-a28b-41ca-952d-a8b94cd953c5 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:48:42.065291 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-ca6d7b19-a28b-41ca-952d-a8b94cd953c5 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:48:42.065722 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-ca6d7b19-a28b-41ca-952d-a8b94cd953c5 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:48:42.066484 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-ca6d7b19-a28b-41ca-952d-a8b94cd953c5 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:48:42.066915 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-ca6d7b19-a28b-41ca-952d-a8b94cd953c5 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:48:42.184163 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-ca6d7b19-a28b-41ca-952d-a8b94cd953c5 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:48:42.192169 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-ca6d7b19-a28b-41ca-952d-a8b94cd953c5 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:48:42.193705 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-ca6d7b19-a28b-41ca-952d-a8b94cd953c5 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:48:42.194852 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-ca6d7b19-a28b-41ca-952d-a8b94cd953c5 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672" status: 200 len: 1748 microversion: 2.20 time: 0.140605 Oct 27 15:48:42.195411 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 508/942] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Oct 27 15:48:42 2021] GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672 => generated 1748 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 15:48:42.451001 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-6b240cda-f098-4b7d-9536-418feada6236 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:48:42.451910 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-6b240cda-f098-4b7d-9536-418feada6236 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: 62c89161-c119-48b2-839d-712db798ff96] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:48:42.457937 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-6b240cda-f098-4b7d-9536-418feada6236 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:48:42.458377 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-6b240cda-f098-4b7d-9536-418feada6236 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:48:42.459122 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-6b240cda-f098-4b7d-9536-418feada6236 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:48:42.459547 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-6b240cda-f098-4b7d-9536-418feada6236 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:48:42.488283 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-6b240cda-f098-4b7d-9536-418feada6236 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041112 Oct 27 15:48:42.488824 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 435/943] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Oct 27 15:48:42 2021] GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 15:48:43.212849 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-4e8b9715-f51f-4381-b850-62410dee8cde tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:48:43.213451 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-4e8b9715-f51f-4381-b850-62410dee8cde tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:48:43.219653 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-4e8b9715-f51f-4381-b850-62410dee8cde tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:48:43.220135 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-4e8b9715-f51f-4381-b850-62410dee8cde tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:48:43.221179 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-4e8b9715-f51f-4381-b850-62410dee8cde tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:48:43.221610 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-4e8b9715-f51f-4381-b850-62410dee8cde tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:48:43.341426 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-4e8b9715-f51f-4381-b850-62410dee8cde tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:48:43.349704 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-4e8b9715-f51f-4381-b850-62410dee8cde tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:48:43.351197 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-4e8b9715-f51f-4381-b850-62410dee8cde tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:48:43.352471 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-4e8b9715-f51f-4381-b850-62410dee8cde tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672" status: 200 len: 1748 microversion: 2.20 time: 0.143372 Oct 27 15:48:43.353588 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 509/944] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Oct 27 15:48:43 2021] GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672 => generated 1748 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 15:48:43.499701 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-41778082-c31d-4f17-8012-93d7014a7b7b tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:48:43.500562 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-41778082-c31d-4f17-8012-93d7014a7b7b tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: 62c89161-c119-48b2-839d-712db798ff96] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:48:43.506694 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-41778082-c31d-4f17-8012-93d7014a7b7b tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:48:43.507130 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-41778082-c31d-4f17-8012-93d7014a7b7b tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:48:43.507903 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-41778082-c31d-4f17-8012-93d7014a7b7b tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:48:43.508332 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-41778082-c31d-4f17-8012-93d7014a7b7b tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:48:43.537248 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-41778082-c31d-4f17-8012-93d7014a7b7b tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041349 Oct 27 15:48:43.537793 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 436/945] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Oct 27 15:48:43 2021] GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 15:48:44.371375 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-1349e27c-cef8-4349-8d5c-d25026527ba4 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:48:44.372120 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-1349e27c-cef8-4349-8d5c-d25026527ba4 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:48:44.378241 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-1349e27c-cef8-4349-8d5c-d25026527ba4 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:48:44.378688 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-1349e27c-cef8-4349-8d5c-d25026527ba4 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:48:44.379453 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-1349e27c-cef8-4349-8d5c-d25026527ba4 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:48:44.379919 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-1349e27c-cef8-4349-8d5c-d25026527ba4 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:48:44.496917 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-1349e27c-cef8-4349-8d5c-d25026527ba4 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:48:44.504924 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-1349e27c-cef8-4349-8d5c-d25026527ba4 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:48:44.506416 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-1349e27c-cef8-4349-8d5c-d25026527ba4 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:48:44.507559 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-1349e27c-cef8-4349-8d5c-d25026527ba4 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672" status: 200 len: 1748 microversion: 2.20 time: 0.140582 Oct 27 15:48:44.508174 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 510/946] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Oct 27 15:48:44 2021] GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672 => generated 1748 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 15:48:44.548818 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-96959328-a0dd-4692-8dca-96168eba1c0c tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:48:44.549711 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-96959328-a0dd-4692-8dca-96168eba1c0c tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: 62c89161-c119-48b2-839d-712db798ff96] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:48:44.555932 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-96959328-a0dd-4692-8dca-96168eba1c0c tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:48:44.556376 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-96959328-a0dd-4692-8dca-96168eba1c0c tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:48:44.557134 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-96959328-a0dd-4692-8dca-96168eba1c0c tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:48:44.557565 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-96959328-a0dd-4692-8dca-96168eba1c0c tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:48:44.585575 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-96959328-a0dd-4692-8dca-96168eba1c0c tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040485 Oct 27 15:48:44.586122 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 437/947] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Oct 27 15:48:44 2021] GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 15:48:45.526916 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-ec6d14a1-b70b-492b-bc47-042c991ef3b1 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:48:45.527497 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-ec6d14a1-b70b-492b-bc47-042c991ef3b1 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:48:45.533758 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-ec6d14a1-b70b-492b-bc47-042c991ef3b1 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:48:45.534198 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-ec6d14a1-b70b-492b-bc47-042c991ef3b1 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:48:45.534961 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-ec6d14a1-b70b-492b-bc47-042c991ef3b1 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:48:45.535389 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-ec6d14a1-b70b-492b-bc47-042c991ef3b1 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:48:45.597293 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-0afc8e08-f412-4340-8719-2f797f6eba4e tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:48:45.598196 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-0afc8e08-f412-4340-8719-2f797f6eba4e tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: 62c89161-c119-48b2-839d-712db798ff96] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:48:45.605294 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-0afc8e08-f412-4340-8719-2f797f6eba4e tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:48:45.605746 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-0afc8e08-f412-4340-8719-2f797f6eba4e tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:48:45.606521 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-0afc8e08-f412-4340-8719-2f797f6eba4e tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:48:45.606949 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-0afc8e08-f412-4340-8719-2f797f6eba4e tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:48:45.636073 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-0afc8e08-f412-4340-8719-2f797f6eba4e tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042752 Oct 27 15:48:45.636870 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 438/948] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Oct 27 15:48:45 2021] GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 15:48:45.660096 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-ec6d14a1-b70b-492b-bc47-042c991ef3b1 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:48:45.669314 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-ec6d14a1-b70b-492b-bc47-042c991ef3b1 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:48:45.670795 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-ec6d14a1-b70b-492b-bc47-042c991ef3b1 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:48:45.671971 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-ec6d14a1-b70b-492b-bc47-042c991ef3b1 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672" status: 200 len: 1748 microversion: 2.20 time: 0.149726 Oct 27 15:48:45.672529 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 511/949] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Oct 27 15:48:45 2021] GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672 => generated 1748 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 15:48:46.646412 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-b7652102-62c6-467f-9e3c-8cb10bdbc75d tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:48:46.648003 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-b7652102-62c6-467f-9e3c-8cb10bdbc75d tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: 62c89161-c119-48b2-839d-712db798ff96] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:48:46.654833 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-b7652102-62c6-467f-9e3c-8cb10bdbc75d tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:48:46.655278 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-b7652102-62c6-467f-9e3c-8cb10bdbc75d tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:48:46.656077 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-b7652102-62c6-467f-9e3c-8cb10bdbc75d tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:48:46.656509 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-b7652102-62c6-467f-9e3c-8cb10bdbc75d tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:48:46.685070 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-b7652102-62c6-467f-9e3c-8cb10bdbc75d tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042406 Oct 27 15:48:46.685905 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 439/950] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Oct 27 15:48:46 2021] GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 15:48:46.690629 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-ee0d4841-8a34-4c84-8753-452b418b0b46 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:48:46.691231 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-ee0d4841-8a34-4c84-8753-452b418b0b46 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:48:46.698101 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-ee0d4841-8a34-4c84-8753-452b418b0b46 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:48:46.698537 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-ee0d4841-8a34-4c84-8753-452b418b0b46 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:48:46.699301 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-ee0d4841-8a34-4c84-8753-452b418b0b46 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:48:46.699730 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-ee0d4841-8a34-4c84-8753-452b418b0b46 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:48:46.827161 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-ee0d4841-8a34-4c84-8753-452b418b0b46 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:48:46.835275 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-ee0d4841-8a34-4c84-8753-452b418b0b46 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:48:46.837504 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-ee0d4841-8a34-4c84-8753-452b418b0b46 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:48:46.838673 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-ee0d4841-8a34-4c84-8753-452b418b0b46 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672" status: 200 len: 1748 microversion: 2.20 time: 0.151833 Oct 27 15:48:46.839236 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 512/951] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Oct 27 15:48:46 2021] GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672 => generated 1748 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 15:48:47.696722 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-a75d07c4-d0c7-489f-9446-b3f9c0fc9fe3 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:48:47.697621 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-a75d07c4-d0c7-489f-9446-b3f9c0fc9fe3 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: 62c89161-c119-48b2-839d-712db798ff96] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:48:47.704143 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-a75d07c4-d0c7-489f-9446-b3f9c0fc9fe3 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:48:47.704592 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-a75d07c4-d0c7-489f-9446-b3f9c0fc9fe3 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:48:47.705368 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-a75d07c4-d0c7-489f-9446-b3f9c0fc9fe3 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:48:47.705803 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-a75d07c4-d0c7-489f-9446-b3f9c0fc9fe3 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:48:47.736349 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-a75d07c4-d0c7-489f-9446-b3f9c0fc9fe3 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043370 Oct 27 15:48:47.736990 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 440/952] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Oct 27 15:48:47 2021] GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 15:48:47.857497 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-dbde9f3d-bced-4d5b-9dab-0f679f705f52 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:48:47.858120 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-dbde9f3d-bced-4d5b-9dab-0f679f705f52 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:48:47.864318 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-dbde9f3d-bced-4d5b-9dab-0f679f705f52 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:48:47.864764 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-dbde9f3d-bced-4d5b-9dab-0f679f705f52 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:48:47.865563 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-dbde9f3d-bced-4d5b-9dab-0f679f705f52 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:48:47.866027 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-dbde9f3d-bced-4d5b-9dab-0f679f705f52 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:48:47.986860 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-dbde9f3d-bced-4d5b-9dab-0f679f705f52 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:48:47.995567 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-dbde9f3d-bced-4d5b-9dab-0f679f705f52 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:48:47.997145 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-dbde9f3d-bced-4d5b-9dab-0f679f705f52 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:48:47.998307 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-dbde9f3d-bced-4d5b-9dab-0f679f705f52 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672" status: 200 len: 1748 microversion: 2.20 time: 0.144531 Oct 27 15:48:47.998901 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 513/953] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Oct 27 15:48:47 2021] GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672 => generated 1748 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 15:48:48.748328 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-9ba4dbcb-3111-4a7f-81e1-f03ce9bad6a3 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:48:48.749216 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-9ba4dbcb-3111-4a7f-81e1-f03ce9bad6a3 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: 62c89161-c119-48b2-839d-712db798ff96] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:48:48.755351 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-9ba4dbcb-3111-4a7f-81e1-f03ce9bad6a3 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:48:48.755790 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-9ba4dbcb-3111-4a7f-81e1-f03ce9bad6a3 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:48:48.756567 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-9ba4dbcb-3111-4a7f-81e1-f03ce9bad6a3 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:48:48.756990 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-9ba4dbcb-3111-4a7f-81e1-f03ce9bad6a3 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:48:48.785577 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-9ba4dbcb-3111-4a7f-81e1-f03ce9bad6a3 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040991 Oct 27 15:48:48.786150 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 441/954] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Oct 27 15:48:48 2021] GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 15:48:49.016151 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-2397e444-92ef-4dfc-b6e8-d2f763a26b05 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:48:49.016754 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-2397e444-92ef-4dfc-b6e8-d2f763a26b05 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:48:49.022887 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-2397e444-92ef-4dfc-b6e8-d2f763a26b05 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:48:49.023326 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-2397e444-92ef-4dfc-b6e8-d2f763a26b05 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:48:49.024243 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-2397e444-92ef-4dfc-b6e8-d2f763a26b05 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:48:49.024694 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-2397e444-92ef-4dfc-b6e8-d2f763a26b05 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:48:49.148330 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-2397e444-92ef-4dfc-b6e8-d2f763a26b05 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:48:49.156839 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-2397e444-92ef-4dfc-b6e8-d2f763a26b05 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:48:49.158326 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-2397e444-92ef-4dfc-b6e8-d2f763a26b05 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:48:49.159459 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-2397e444-92ef-4dfc-b6e8-d2f763a26b05 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672" status: 200 len: 1748 microversion: 2.20 time: 0.146983 Oct 27 15:48:49.160041 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 514/955] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Oct 27 15:48:49 2021] GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672 => generated 1748 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 15:48:49.796954 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-c1b0d592-01f7-44ee-bd84-98aa6bf0fa04 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:48:49.797876 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-c1b0d592-01f7-44ee-bd84-98aa6bf0fa04 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: 62c89161-c119-48b2-839d-712db798ff96] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:48:49.804014 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-c1b0d592-01f7-44ee-bd84-98aa6bf0fa04 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:48:49.804452 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-c1b0d592-01f7-44ee-bd84-98aa6bf0fa04 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:48:49.805203 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-c1b0d592-01f7-44ee-bd84-98aa6bf0fa04 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:48:49.806215 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-c1b0d592-01f7-44ee-bd84-98aa6bf0fa04 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:48:49.834530 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-c1b0d592-01f7-44ee-bd84-98aa6bf0fa04 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041456 Oct 27 15:48:49.835070 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 442/956] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Oct 27 15:48:49 2021] GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 15:48:50.177536 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-2ca41593-3435-48aa-bb7f-24f2db12b421 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:48:50.178210 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-2ca41593-3435-48aa-bb7f-24f2db12b421 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:48:50.185071 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-2ca41593-3435-48aa-bb7f-24f2db12b421 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:48:50.185517 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-2ca41593-3435-48aa-bb7f-24f2db12b421 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:48:50.186287 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-2ca41593-3435-48aa-bb7f-24f2db12b421 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:48:50.186718 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-2ca41593-3435-48aa-bb7f-24f2db12b421 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:48:50.307423 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-2ca41593-3435-48aa-bb7f-24f2db12b421 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:48:50.315658 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-2ca41593-3435-48aa-bb7f-24f2db12b421 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:48:50.317188 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-2ca41593-3435-48aa-bb7f-24f2db12b421 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:48:50.318348 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-2ca41593-3435-48aa-bb7f-24f2db12b421 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672" status: 200 len: 1748 microversion: 2.20 time: 0.144531 Oct 27 15:48:50.318903 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 515/957] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Oct 27 15:48:50 2021] GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672 => generated 1748 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 15:48:50.847185 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-21305265-8c2c-461b-ba69-eac499c10407 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:48:50.848107 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-21305265-8c2c-461b-ba69-eac499c10407 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: 62c89161-c119-48b2-839d-712db798ff96] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:48:50.855566 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-21305265-8c2c-461b-ba69-eac499c10407 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:48:50.856038 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-21305265-8c2c-461b-ba69-eac499c10407 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:48:50.856834 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-21305265-8c2c-461b-ba69-eac499c10407 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:48:50.857257 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-21305265-8c2c-461b-ba69-eac499c10407 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:48:50.887382 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-21305265-8c2c-461b-ba69-eac499c10407 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044171 Oct 27 15:48:50.887974 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 443/958] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Oct 27 15:48:50 2021] GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 15:48:51.337970 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-35f4e7b0-4c84-498c-97cf-711014dc3899 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:48:51.338564 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-35f4e7b0-4c84-498c-97cf-711014dc3899 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:48:51.344702 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-35f4e7b0-4c84-498c-97cf-711014dc3899 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:48:51.345396 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-35f4e7b0-4c84-498c-97cf-711014dc3899 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:48:51.346161 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-35f4e7b0-4c84-498c-97cf-711014dc3899 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:48:51.346584 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-35f4e7b0-4c84-498c-97cf-711014dc3899 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:48:51.465295 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-35f4e7b0-4c84-498c-97cf-711014dc3899 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:48:51.473825 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-35f4e7b0-4c84-498c-97cf-711014dc3899 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:48:51.475592 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-35f4e7b0-4c84-498c-97cf-711014dc3899 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:48:51.476775 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-35f4e7b0-4c84-498c-97cf-711014dc3899 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672" status: 200 len: 1748 microversion: 2.20 time: 0.143177 Oct 27 15:48:51.477338 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 516/959] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Oct 27 15:48:51 2021] GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672 => generated 1748 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 15:48:51.898424 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-182754ef-95d4-4257-aa1f-95dbd97e74fe tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:48:51.900055 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-182754ef-95d4-4257-aa1f-95dbd97e74fe tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: 62c89161-c119-48b2-839d-712db798ff96] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:48:51.906239 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-182754ef-95d4-4257-aa1f-95dbd97e74fe tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:48:51.906682 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-182754ef-95d4-4257-aa1f-95dbd97e74fe tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:48:51.907436 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-182754ef-95d4-4257-aa1f-95dbd97e74fe tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:48:51.907890 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-182754ef-95d4-4257-aa1f-95dbd97e74fe tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:48:51.936535 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-182754ef-95d4-4257-aa1f-95dbd97e74fe tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041816 Oct 27 15:48:51.937089 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 444/960] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Oct 27 15:48:51 2021] GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 15:48:52.495230 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-843d81a3-f6ba-4dda-86d9-4af8872070cb tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:48:52.496039 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-843d81a3-f6ba-4dda-86d9-4af8872070cb tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:48:52.501381 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-843d81a3-f6ba-4dda-86d9-4af8872070cb tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:48:52.501826 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-843d81a3-f6ba-4dda-86d9-4af8872070cb tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:48:52.502578 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-843d81a3-f6ba-4dda-86d9-4af8872070cb tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:48:52.503000 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-843d81a3-f6ba-4dda-86d9-4af8872070cb tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:48:52.624282 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-843d81a3-f6ba-4dda-86d9-4af8872070cb tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:48:52.632422 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-843d81a3-f6ba-4dda-86d9-4af8872070cb tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:48:52.635004 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-843d81a3-f6ba-4dda-86d9-4af8872070cb tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:48:52.636165 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-843d81a3-f6ba-4dda-86d9-4af8872070cb tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672" status: 200 len: 1748 microversion: 2.20 time: 0.145744 Oct 27 15:48:52.636750 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 517/961] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Oct 27 15:48:52 2021] GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672 => generated 1748 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 15:48:52.946896 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-687d2e0f-563e-4774-8e70-21c2f019117a tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:48:52.947792 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-687d2e0f-563e-4774-8e70-21c2f019117a tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: 62c89161-c119-48b2-839d-712db798ff96] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:48:52.953942 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-687d2e0f-563e-4774-8e70-21c2f019117a tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:48:52.954385 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-687d2e0f-563e-4774-8e70-21c2f019117a tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:48:52.955142 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-687d2e0f-563e-4774-8e70-21c2f019117a tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:48:52.955574 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-687d2e0f-563e-4774-8e70-21c2f019117a tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:48:52.983760 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-687d2e0f-563e-4774-8e70-21c2f019117a tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040710 Oct 27 15:48:52.984342 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 445/962] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Oct 27 15:48:52 2021] GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 15:48:53.655043 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-7f52c9f0-3919-44ca-ad93-ba584a8be62e tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:48:53.655654 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-7f52c9f0-3919-44ca-ad93-ba584a8be62e tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:48:53.661866 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-7f52c9f0-3919-44ca-ad93-ba584a8be62e tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:48:53.662309 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-7f52c9f0-3919-44ca-ad93-ba584a8be62e tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:48:53.663074 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-7f52c9f0-3919-44ca-ad93-ba584a8be62e tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:48:53.663510 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-7f52c9f0-3919-44ca-ad93-ba584a8be62e tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:48:53.995425 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-c1f590fb-c804-48b6-9910-b10e567d9005 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:48:53.996415 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-c1f590fb-c804-48b6-9910-b10e567d9005 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: 62c89161-c119-48b2-839d-712db798ff96] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:48:54.002828 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-c1f590fb-c804-48b6-9910-b10e567d9005 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:48:54.003276 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-c1f590fb-c804-48b6-9910-b10e567d9005 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:48:54.004076 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-c1f590fb-c804-48b6-9910-b10e567d9005 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:48:54.004509 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-c1f590fb-c804-48b6-9910-b10e567d9005 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:48:54.006035 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-7f52c9f0-3919-44ca-ad93-ba584a8be62e tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:48:54.015290 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-7f52c9f0-3919-44ca-ad93-ba584a8be62e tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:48:54.016814 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-7f52c9f0-3919-44ca-ad93-ba584a8be62e tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:48:54.017944 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-7f52c9f0-3919-44ca-ad93-ba584a8be62e tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672" status: 200 len: 1748 microversion: 2.20 time: 0.367234 Oct 27 15:48:54.018503 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 518/963] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Oct 27 15:48:53 2021] GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672 => generated 1748 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 15:48:54.034855 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-c1f590fb-c804-48b6-9910-b10e567d9005 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043756 Oct 27 15:48:54.035417 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 446/964] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Oct 27 15:48:53 2021] GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 15:48:55.036741 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-7820d8e9-c815-4500-8175-e4bfa4ecb497 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:48:55.037355 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-7820d8e9-c815-4500-8175-e4bfa4ecb497 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:48:55.044163 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-7820d8e9-c815-4500-8175-e4bfa4ecb497 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:48:55.044611 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-7820d8e9-c815-4500-8175-e4bfa4ecb497 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:48:55.045419 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-7820d8e9-c815-4500-8175-e4bfa4ecb497 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:48:55.045858 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-7820d8e9-c815-4500-8175-e4bfa4ecb497 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:48:55.046395 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-bd6caa6b-e219-4125-8833-725fd79c3c65 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:48:55.047292 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-bd6caa6b-e219-4125-8833-725fd79c3c65 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: 62c89161-c119-48b2-839d-712db798ff96] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:48:55.053504 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-bd6caa6b-e219-4125-8833-725fd79c3c65 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:48:55.053934 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-bd6caa6b-e219-4125-8833-725fd79c3c65 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:48:55.054706 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-bd6caa6b-e219-4125-8833-725fd79c3c65 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:48:55.055141 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-bd6caa6b-e219-4125-8833-725fd79c3c65 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:48:55.084800 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-bd6caa6b-e219-4125-8833-725fd79c3c65 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042180 Oct 27 15:48:55.085367 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 447/965] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Oct 27 15:48:55 2021] GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 15:48:55.172722 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-7820d8e9-c815-4500-8175-e4bfa4ecb497 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:48:55.180772 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-7820d8e9-c815-4500-8175-e4bfa4ecb497 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:48:55.182990 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-7820d8e9-c815-4500-8175-e4bfa4ecb497 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:48:55.184170 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-7820d8e9-c815-4500-8175-e4bfa4ecb497 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672" status: 200 len: 1748 microversion: 2.20 time: 0.151131 Oct 27 15:48:55.184723 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 519/966] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Oct 27 15:48:55 2021] GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672 => generated 1748 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 15:48:56.096441 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-35a391f0-4758-49ec-8fc2-55f0a1f10e11 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:48:56.097330 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-35a391f0-4758-49ec-8fc2-55f0a1f10e11 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: 62c89161-c119-48b2-839d-712db798ff96] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:48:56.103880 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-35a391f0-4758-49ec-8fc2-55f0a1f10e11 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:48:56.104346 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-35a391f0-4758-49ec-8fc2-55f0a1f10e11 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:48:56.105110 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-35a391f0-4758-49ec-8fc2-55f0a1f10e11 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:48:56.105542 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-35a391f0-4758-49ec-8fc2-55f0a1f10e11 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:48:56.133366 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-35a391f0-4758-49ec-8fc2-55f0a1f10e11 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040934 Oct 27 15:48:56.133958 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 448/967] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Oct 27 15:48:56 2021] GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 15:48:56.202072 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-9aeaa191-5bfc-4b25-8f47-b1c5372fa299 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:48:56.202674 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-9aeaa191-5bfc-4b25-8f47-b1c5372fa299 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:48:56.208835 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-9aeaa191-5bfc-4b25-8f47-b1c5372fa299 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:48:56.209283 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-9aeaa191-5bfc-4b25-8f47-b1c5372fa299 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:48:56.210071 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-9aeaa191-5bfc-4b25-8f47-b1c5372fa299 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:48:56.210504 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-9aeaa191-5bfc-4b25-8f47-b1c5372fa299 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:48:56.338281 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-9aeaa191-5bfc-4b25-8f47-b1c5372fa299 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:48:56.347975 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-9aeaa191-5bfc-4b25-8f47-b1c5372fa299 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:48:56.349456 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-9aeaa191-5bfc-4b25-8f47-b1c5372fa299 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:48:56.350601 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-9aeaa191-5bfc-4b25-8f47-b1c5372fa299 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672" status: 200 len: 1748 microversion: 2.20 time: 0.152275 Oct 27 15:48:56.351154 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 520/968] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Oct 27 15:48:56 2021] GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672 => generated 1748 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 15:48:57.144964 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-36ba2664-1350-400c-9770-f694d9843ec1 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:48:57.145866 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-36ba2664-1350-400c-9770-f694d9843ec1 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: 62c89161-c119-48b2-839d-712db798ff96] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:48:57.152589 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-36ba2664-1350-400c-9770-f694d9843ec1 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:48:57.153023 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-36ba2664-1350-400c-9770-f694d9843ec1 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:48:57.153766 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-36ba2664-1350-400c-9770-f694d9843ec1 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:48:57.154191 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-36ba2664-1350-400c-9770-f694d9843ec1 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:48:57.181544 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-36ba2664-1350-400c-9770-f694d9843ec1 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040226 Oct 27 15:48:57.182117 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 449/969] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Oct 27 15:48:57 2021] GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 15:48:57.369917 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-2e12a2eb-e4ae-4e0b-a334-c97b528a5093 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:48:57.370552 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-2e12a2eb-e4ae-4e0b-a334-c97b528a5093 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:48:57.378234 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-2e12a2eb-e4ae-4e0b-a334-c97b528a5093 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:48:57.378234 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-2e12a2eb-e4ae-4e0b-a334-c97b528a5093 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:48:57.378234 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-2e12a2eb-e4ae-4e0b-a334-c97b528a5093 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:48:57.378494 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-2e12a2eb-e4ae-4e0b-a334-c97b528a5093 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:48:57.500421 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-2e12a2eb-e4ae-4e0b-a334-c97b528a5093 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:48:57.508445 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-2e12a2eb-e4ae-4e0b-a334-c97b528a5093 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:48:57.510700 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-2e12a2eb-e4ae-4e0b-a334-c97b528a5093 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:48:57.511833 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-2e12a2eb-e4ae-4e0b-a334-c97b528a5093 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672" status: 200 len: 1748 microversion: 2.20 time: 0.146054 Oct 27 15:48:57.512464 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 521/970] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Oct 27 15:48:57 2021] GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672 => generated 1748 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 15:48:58.192974 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-bc0a26f3-fe68-46ff-9fac-27456b5ced07 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:48:58.193878 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-bc0a26f3-fe68-46ff-9fac-27456b5ced07 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: 62c89161-c119-48b2-839d-712db798ff96] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:48:58.200325 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-bc0a26f3-fe68-46ff-9fac-27456b5ced07 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:48:58.200773 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-bc0a26f3-fe68-46ff-9fac-27456b5ced07 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:48:58.201538 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-bc0a26f3-fe68-46ff-9fac-27456b5ced07 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:48:58.201975 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-bc0a26f3-fe68-46ff-9fac-27456b5ced07 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:48:58.231030 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-bc0a26f3-fe68-46ff-9fac-27456b5ced07 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041785 Oct 27 15:48:58.231571 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 450/971] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Oct 27 15:48:58 2021] GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 15:48:58.529749 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-dc654259-565f-4122-be33-4106c4997d11 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:48:58.530366 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-dc654259-565f-4122-be33-4106c4997d11 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:48:58.536596 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-dc654259-565f-4122-be33-4106c4997d11 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:48:58.537044 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-dc654259-565f-4122-be33-4106c4997d11 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:48:58.537811 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-dc654259-565f-4122-be33-4106c4997d11 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:48:58.538247 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-dc654259-565f-4122-be33-4106c4997d11 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:48:58.657268 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-dc654259-565f-4122-be33-4106c4997d11 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:48:58.665328 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-dc654259-565f-4122-be33-4106c4997d11 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:48:58.666829 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-dc654259-565f-4122-be33-4106c4997d11 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:48:58.668018 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-dc654259-565f-4122-be33-4106c4997d11 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672" status: 200 len: 1748 microversion: 2.20 time: 0.141931 Oct 27 15:48:58.668608 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 522/972] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Oct 27 15:48:58 2021] GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672 => generated 1748 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 15:48:59.242576 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-93f595ef-8420-4e84-b801-8872ba8a25a3 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:48:59.243461 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-93f595ef-8420-4e84-b801-8872ba8a25a3 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: 62c89161-c119-48b2-839d-712db798ff96] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:48:59.250204 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-93f595ef-8420-4e84-b801-8872ba8a25a3 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:48:59.250671 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-93f595ef-8420-4e84-b801-8872ba8a25a3 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:48:59.251430 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-93f595ef-8420-4e84-b801-8872ba8a25a3 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:48:59.251878 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-93f595ef-8420-4e84-b801-8872ba8a25a3 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:48:59.280238 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-93f595ef-8420-4e84-b801-8872ba8a25a3 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041404 Oct 27 15:48:59.280789 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 451/973] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Oct 27 15:48:59 2021] GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 15:48:59.686116 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-0e22bd58-a79b-4b1e-939a-0b6180658f47 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:48:59.686720 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-0e22bd58-a79b-4b1e-939a-0b6180658f47 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:48:59.692908 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-0e22bd58-a79b-4b1e-939a-0b6180658f47 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:48:59.693353 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-0e22bd58-a79b-4b1e-939a-0b6180658f47 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:48:59.694110 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-0e22bd58-a79b-4b1e-939a-0b6180658f47 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:48:59.694544 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-0e22bd58-a79b-4b1e-939a-0b6180658f47 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:48:59.818931 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-0e22bd58-a79b-4b1e-939a-0b6180658f47 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:48:59.827740 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-0e22bd58-a79b-4b1e-939a-0b6180658f47 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:48:59.829252 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-0e22bd58-a79b-4b1e-939a-0b6180658f47 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:48:59.830402 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-0e22bd58-a79b-4b1e-939a-0b6180658f47 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672" status: 200 len: 1748 microversion: 2.20 time: 0.148295 Oct 27 15:48:59.830960 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 523/974] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Oct 27 15:48:59 2021] GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672 => generated 1748 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 15:49:00.292547 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-d5c62f96-a5a4-4fbe-963d-8110009a846a tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:49:00.293449 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-d5c62f96-a5a4-4fbe-963d-8110009a846a tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: 62c89161-c119-48b2-839d-712db798ff96] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:49:00.299537 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-d5c62f96-a5a4-4fbe-963d-8110009a846a tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:49:00.300025 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-d5c62f96-a5a4-4fbe-963d-8110009a846a tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:49:00.300786 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-d5c62f96-a5a4-4fbe-963d-8110009a846a tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:49:00.301221 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-d5c62f96-a5a4-4fbe-963d-8110009a846a tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:49:00.329631 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-d5c62f96-a5a4-4fbe-963d-8110009a846a tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041585 Oct 27 15:49:00.330179 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 452/975] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Oct 27 15:49:00 2021] GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 15:49:00.848392 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-0c6ab2f7-96f7-436a-b172-de4138e2caf9 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:49:00.848995 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-0c6ab2f7-96f7-436a-b172-de4138e2caf9 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:49:00.856082 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-0c6ab2f7-96f7-436a-b172-de4138e2caf9 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:49:00.856563 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-0c6ab2f7-96f7-436a-b172-de4138e2caf9 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:49:00.857410 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-0c6ab2f7-96f7-436a-b172-de4138e2caf9 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:49:00.857841 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-0c6ab2f7-96f7-436a-b172-de4138e2caf9 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:49:00.977885 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-0c6ab2f7-96f7-436a-b172-de4138e2caf9 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:49:00.986304 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-0c6ab2f7-96f7-436a-b172-de4138e2caf9 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:49:00.987800 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-0c6ab2f7-96f7-436a-b172-de4138e2caf9 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:49:00.988988 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-0c6ab2f7-96f7-436a-b172-de4138e2caf9 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672" status: 200 len: 1748 microversion: 2.20 time: 0.144910 Oct 27 15:49:00.989547 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 524/976] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Oct 27 15:49:00 2021] GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672 => generated 1748 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 15:49:01.341031 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-6ff0f2c0-aa19-4494-b62e-066d8e5c7d27 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:49:01.341924 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-6ff0f2c0-aa19-4494-b62e-066d8e5c7d27 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: 62c89161-c119-48b2-839d-712db798ff96] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:49:01.348431 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-6ff0f2c0-aa19-4494-b62e-066d8e5c7d27 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:49:01.348861 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-6ff0f2c0-aa19-4494-b62e-066d8e5c7d27 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:49:01.349615 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-6ff0f2c0-aa19-4494-b62e-066d8e5c7d27 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:49:01.350049 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-6ff0f2c0-aa19-4494-b62e-066d8e5c7d27 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:49:01.379282 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-6ff0f2c0-aa19-4494-b62e-066d8e5c7d27 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041969 Oct 27 15:49:01.379840 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 453/977] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Oct 27 15:49:01 2021] GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 15:49:02.007759 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-57541d48-8898-41de-beb0-8b30263d8f99 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:49:02.008390 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-57541d48-8898-41de-beb0-8b30263d8f99 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:49:02.015550 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-57541d48-8898-41de-beb0-8b30263d8f99 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:49:02.016036 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-57541d48-8898-41de-beb0-8b30263d8f99 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:49:02.016795 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-57541d48-8898-41de-beb0-8b30263d8f99 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:49:02.017220 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-57541d48-8898-41de-beb0-8b30263d8f99 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:49:02.136189 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-57541d48-8898-41de-beb0-8b30263d8f99 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:49:02.145331 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-57541d48-8898-41de-beb0-8b30263d8f99 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:49:02.146807 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-57541d48-8898-41de-beb0-8b30263d8f99 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:49:02.148042 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-57541d48-8898-41de-beb0-8b30263d8f99 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672" status: 200 len: 1748 microversion: 2.20 time: 0.144062 Oct 27 15:49:02.148596 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 525/978] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Oct 27 15:49:02 2021] GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672 => generated 1748 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 15:49:02.390622 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-305cfef0-5fa3-4d3c-89f4-f3c3de1a62fd tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:49:02.391527 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-305cfef0-5fa3-4d3c-89f4-f3c3de1a62fd tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: 62c89161-c119-48b2-839d-712db798ff96] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:49:02.397795 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-305cfef0-5fa3-4d3c-89f4-f3c3de1a62fd tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:49:02.398238 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-305cfef0-5fa3-4d3c-89f4-f3c3de1a62fd tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:49:02.399006 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-305cfef0-5fa3-4d3c-89f4-f3c3de1a62fd tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:49:02.399440 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-305cfef0-5fa3-4d3c-89f4-f3c3de1a62fd tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:49:02.427774 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-305cfef0-5fa3-4d3c-89f4-f3c3de1a62fd tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041106 Oct 27 15:49:02.428353 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 454/979] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Oct 27 15:49:02 2021] GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 15:49:03.168344 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-8b686d29-ff2b-4f3f-be1a-93d566edc11a tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:49:03.168879 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-8b686d29-ff2b-4f3f-be1a-93d566edc11a tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:49:03.174898 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-8b686d29-ff2b-4f3f-be1a-93d566edc11a tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:49:03.175331 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-8b686d29-ff2b-4f3f-be1a-93d566edc11a tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:49:03.176111 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-8b686d29-ff2b-4f3f-be1a-93d566edc11a tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:49:03.176540 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-8b686d29-ff2b-4f3f-be1a-93d566edc11a tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:49:03.296992 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-8b686d29-ff2b-4f3f-be1a-93d566edc11a tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:49:03.305213 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-8b686d29-ff2b-4f3f-be1a-93d566edc11a tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:49:03.306720 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-8b686d29-ff2b-4f3f-be1a-93d566edc11a tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:49:03.307885 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-8b686d29-ff2b-4f3f-be1a-93d566edc11a tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672" status: 200 len: 1748 microversion: 2.20 time: 0.143296 Oct 27 15:49:03.308694 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 526/980] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Oct 27 15:49:03 2021] GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672 => generated 1748 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 15:49:03.439629 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-1424a764-3734-4493-9d4a-e9df377b84fe tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:49:03.440546 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-1424a764-3734-4493-9d4a-e9df377b84fe tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: 62c89161-c119-48b2-839d-712db798ff96] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:49:03.446725 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-1424a764-3734-4493-9d4a-e9df377b84fe tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:49:03.447155 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-1424a764-3734-4493-9d4a-e9df377b84fe tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:49:03.447941 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-1424a764-3734-4493-9d4a-e9df377b84fe tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:49:03.448383 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-1424a764-3734-4493-9d4a-e9df377b84fe tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:49:03.477104 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-1424a764-3734-4493-9d4a-e9df377b84fe tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041291 Oct 27 15:49:03.477654 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 455/981] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Oct 27 15:49:03 2021] GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 15:49:04.325267 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-790f7919-2ebc-496f-98a8-2495fb26ca57 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:49:04.326383 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-790f7919-2ebc-496f-98a8-2495fb26ca57 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:49:04.332565 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-790f7919-2ebc-496f-98a8-2495fb26ca57 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:49:04.333006 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-790f7919-2ebc-496f-98a8-2495fb26ca57 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:49:04.333770 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-790f7919-2ebc-496f-98a8-2495fb26ca57 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:49:04.334202 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-790f7919-2ebc-496f-98a8-2495fb26ca57 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:49:04.451646 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-790f7919-2ebc-496f-98a8-2495fb26ca57 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:49:04.459890 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-790f7919-2ebc-496f-98a8-2495fb26ca57 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:49:04.461386 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-790f7919-2ebc-496f-98a8-2495fb26ca57 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:49:04.462534 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-790f7919-2ebc-496f-98a8-2495fb26ca57 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672" status: 200 len: 1748 microversion: 2.20 time: 0.141133 Oct 27 15:49:04.463129 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 527/982] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Oct 27 15:49:04 2021] GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672 => generated 1748 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 15:49:04.488503 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-3557ecd7-e221-45df-8e55-908bae6820d5 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:49:04.489353 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-3557ecd7-e221-45df-8e55-908bae6820d5 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: 62c89161-c119-48b2-839d-712db798ff96] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:49:04.495427 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-3557ecd7-e221-45df-8e55-908bae6820d5 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:49:04.495878 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-3557ecd7-e221-45df-8e55-908bae6820d5 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:49:04.496641 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-3557ecd7-e221-45df-8e55-908bae6820d5 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:49:04.497065 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-3557ecd7-e221-45df-8e55-908bae6820d5 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:49:04.526275 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-3557ecd7-e221-45df-8e55-908bae6820d5 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041576 Oct 27 15:49:04.526813 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 456/983] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Oct 27 15:49:04 2021] GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 15:49:05.480469 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-8c5007d7-0828-4c1e-a161-5ff9d1cc636f tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:49:05.481074 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-8c5007d7-0828-4c1e-a161-5ff9d1cc636f tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:49:05.487349 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-8c5007d7-0828-4c1e-a161-5ff9d1cc636f tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:49:05.487787 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-8c5007d7-0828-4c1e-a161-5ff9d1cc636f tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:49:05.488570 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-8c5007d7-0828-4c1e-a161-5ff9d1cc636f tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:49:05.488998 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-8c5007d7-0828-4c1e-a161-5ff9d1cc636f tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:49:05.537603 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-a781160b-d27f-466d-b3a1-9569b914088e tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:49:05.538526 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-a781160b-d27f-466d-b3a1-9569b914088e tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: 62c89161-c119-48b2-839d-712db798ff96] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:49:05.544732 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-a781160b-d27f-466d-b3a1-9569b914088e tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:49:05.545241 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-a781160b-d27f-466d-b3a1-9569b914088e tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:49:05.545950 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-a781160b-d27f-466d-b3a1-9569b914088e tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:49:05.546380 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-a781160b-d27f-466d-b3a1-9569b914088e tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:49:05.575431 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-a781160b-d27f-466d-b3a1-9569b914088e tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041501 Oct 27 15:49:05.576720 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 457/984] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Oct 27 15:49:05 2021] GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 15:49:05.609173 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-8c5007d7-0828-4c1e-a161-5ff9d1cc636f tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:49:05.617309 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-8c5007d7-0828-4c1e-a161-5ff9d1cc636f tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:49:05.618820 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-8c5007d7-0828-4c1e-a161-5ff9d1cc636f tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:49:05.620026 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-8c5007d7-0828-4c1e-a161-5ff9d1cc636f tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672" status: 200 len: 1748 microversion: 2.20 time: 0.143247 Oct 27 15:49:05.620617 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 528/985] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Oct 27 15:49:05 2021] GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672 => generated 1748 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 15:49:06.587467 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-cf80a78d-26a6-49bb-8511-97e0a3f36b64 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:49:06.588308 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-cf80a78d-26a6-49bb-8511-97e0a3f36b64 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: 62c89161-c119-48b2-839d-712db798ff96] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:49:06.595292 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-cf80a78d-26a6-49bb-8511-97e0a3f36b64 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:49:06.595734 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-cf80a78d-26a6-49bb-8511-97e0a3f36b64 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:49:06.596525 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-cf80a78d-26a6-49bb-8511-97e0a3f36b64 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:49:06.596962 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-cf80a78d-26a6-49bb-8511-97e0a3f36b64 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:49:06.625782 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-cf80a78d-26a6-49bb-8511-97e0a3f36b64 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042123 Oct 27 15:49:06.626341 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 458/986] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Oct 27 15:49:06 2021] GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 15:49:06.637842 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-6bb1c40e-a97d-4430-a7a8-9c754e61b7be tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:49:06.638468 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-6bb1c40e-a97d-4430-a7a8-9c754e61b7be tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:49:06.644779 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-6bb1c40e-a97d-4430-a7a8-9c754e61b7be tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:49:06.645216 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-6bb1c40e-a97d-4430-a7a8-9c754e61b7be tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:49:06.645966 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-6bb1c40e-a97d-4430-a7a8-9c754e61b7be tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:49:06.646390 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-6bb1c40e-a97d-4430-a7a8-9c754e61b7be tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:49:06.771381 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-6bb1c40e-a97d-4430-a7a8-9c754e61b7be tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:49:06.782782 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-6bb1c40e-a97d-4430-a7a8-9c754e61b7be tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:49:06.782782 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-6bb1c40e-a97d-4430-a7a8-9c754e61b7be tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:49:06.782970 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-6bb1c40e-a97d-4430-a7a8-9c754e61b7be tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672" status: 200 len: 1748 microversion: 2.20 time: 0.148844 Oct 27 15:49:06.783765 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 529/987] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Oct 27 15:49:06 2021] GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672 => generated 1748 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 15:49:07.637048 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-b81a5fbd-b0ad-4a82-a118-af7d9eaa48d4 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:49:07.637944 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-b81a5fbd-b0ad-4a82-a118-af7d9eaa48d4 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: 62c89161-c119-48b2-839d-712db798ff96] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:49:07.644580 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-b81a5fbd-b0ad-4a82-a118-af7d9eaa48d4 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:49:07.645026 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-b81a5fbd-b0ad-4a82-a118-af7d9eaa48d4 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:49:07.645784 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-b81a5fbd-b0ad-4a82-a118-af7d9eaa48d4 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:49:07.646216 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-b81a5fbd-b0ad-4a82-a118-af7d9eaa48d4 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:49:07.675148 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-b81a5fbd-b0ad-4a82-a118-af7d9eaa48d4 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041693 Oct 27 15:49:07.675784 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 459/988] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Oct 27 15:49:07 2021] GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 15:49:07.801477 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-a1516184-9d42-40ec-ab07-10fa2c57fc96 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:49:07.802074 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-a1516184-9d42-40ec-ab07-10fa2c57fc96 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:49:07.809230 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-a1516184-9d42-40ec-ab07-10fa2c57fc96 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:49:07.809734 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-a1516184-9d42-40ec-ab07-10fa2c57fc96 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:49:07.810609 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-a1516184-9d42-40ec-ab07-10fa2c57fc96 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:49:07.811093 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-a1516184-9d42-40ec-ab07-10fa2c57fc96 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:49:07.935372 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-a1516184-9d42-40ec-ab07-10fa2c57fc96 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:49:07.943543 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-a1516184-9d42-40ec-ab07-10fa2c57fc96 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:49:07.945079 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-a1516184-9d42-40ec-ab07-10fa2c57fc96 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:49:07.946224 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-a1516184-9d42-40ec-ab07-10fa2c57fc96 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672" status: 200 len: 1748 microversion: 2.20 time: 0.149226 Oct 27 15:49:07.946782 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 530/989] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Oct 27 15:49:07 2021] GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672 => generated 1748 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 15:49:08.686348 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-4fdf6bee-b443-479a-a084-e8d4948284e3 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:49:08.687250 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-4fdf6bee-b443-479a-a084-e8d4948284e3 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: 62c89161-c119-48b2-839d-712db798ff96] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:49:08.694158 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-4fdf6bee-b443-479a-a084-e8d4948284e3 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:49:08.694601 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-4fdf6bee-b443-479a-a084-e8d4948284e3 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:49:08.695353 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-4fdf6bee-b443-479a-a084-e8d4948284e3 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:49:08.695782 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-4fdf6bee-b443-479a-a084-e8d4948284e3 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:49:08.724346 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-4fdf6bee-b443-479a-a084-e8d4948284e3 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041687 Oct 27 15:49:08.724922 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 460/990] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Oct 27 15:49:08 2021] GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 15:49:08.964142 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-ca265dd1-bb41-45c4-95c8-38c6d7ba8abc tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:49:08.964862 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-ca265dd1-bb41-45c4-95c8-38c6d7ba8abc tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:49:08.972342 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-ca265dd1-bb41-45c4-95c8-38c6d7ba8abc tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:49:08.972781 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-ca265dd1-bb41-45c4-95c8-38c6d7ba8abc tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:49:08.973543 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-ca265dd1-bb41-45c4-95c8-38c6d7ba8abc tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:49:08.973969 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-ca265dd1-bb41-45c4-95c8-38c6d7ba8abc tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:49:09.094662 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-ca265dd1-bb41-45c4-95c8-38c6d7ba8abc tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:49:09.103011 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-ca265dd1-bb41-45c4-95c8-38c6d7ba8abc tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:49:09.104552 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-ca265dd1-bb41-45c4-95c8-38c6d7ba8abc tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:49:09.105696 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-ca265dd1-bb41-45c4-95c8-38c6d7ba8abc tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672" status: 200 len: 1748 microversion: 2.20 time: 0.145309 Oct 27 15:49:09.106252 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 531/991] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Oct 27 15:49:08 2021] GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672 => generated 1748 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 15:49:09.736107 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-859b752e-46ae-42ac-8cea-e28a9eb48958 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:49:09.737001 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-859b752e-46ae-42ac-8cea-e28a9eb48958 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: 62c89161-c119-48b2-839d-712db798ff96] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:49:09.743583 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-859b752e-46ae-42ac-8cea-e28a9eb48958 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:49:09.744055 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-859b752e-46ae-42ac-8cea-e28a9eb48958 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:49:09.744812 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-859b752e-46ae-42ac-8cea-e28a9eb48958 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:49:09.745240 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-859b752e-46ae-42ac-8cea-e28a9eb48958 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:49:09.774608 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-859b752e-46ae-42ac-8cea-e28a9eb48958 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042444 Oct 27 15:49:09.775163 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 461/992] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Oct 27 15:49:09 2021] GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 15:49:10.124259 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-3fcce1e1-e68c-4d93-917e-424c99a3e617 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:49:10.124859 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-3fcce1e1-e68c-4d93-917e-424c99a3e617 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:49:10.131023 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-3fcce1e1-e68c-4d93-917e-424c99a3e617 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:49:10.131470 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-3fcce1e1-e68c-4d93-917e-424c99a3e617 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:49:10.132271 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-3fcce1e1-e68c-4d93-917e-424c99a3e617 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:49:10.132705 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-3fcce1e1-e68c-4d93-917e-424c99a3e617 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:49:10.260293 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-3fcce1e1-e68c-4d93-917e-424c99a3e617 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:49:10.269182 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-3fcce1e1-e68c-4d93-917e-424c99a3e617 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:49:10.270670 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-3fcce1e1-e68c-4d93-917e-424c99a3e617 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:49:10.271817 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-3fcce1e1-e68c-4d93-917e-424c99a3e617 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672" status: 200 len: 1748 microversion: 2.20 time: 0.151328 Oct 27 15:49:10.272394 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 532/993] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Oct 27 15:49:10 2021] GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672 => generated 1748 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 15:49:10.786174 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-6f49e970-b469-47d9-8b70-895fdffe89df tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:49:10.787075 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-6f49e970-b469-47d9-8b70-895fdffe89df tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: 62c89161-c119-48b2-839d-712db798ff96] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:49:10.793354 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-6f49e970-b469-47d9-8b70-895fdffe89df tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:49:10.793805 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-6f49e970-b469-47d9-8b70-895fdffe89df tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:49:10.794571 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-6f49e970-b469-47d9-8b70-895fdffe89df tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:49:10.795005 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-6f49e970-b469-47d9-8b70-895fdffe89df tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:49:10.823350 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-6f49e970-b469-47d9-8b70-895fdffe89df tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040981 Oct 27 15:49:10.823915 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 462/994] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Oct 27 15:49:10 2021] GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 15:49:11.290108 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-ad96a370-1517-4dc6-91e6-e05ce2c5cd9b tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:49:11.290689 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-ad96a370-1517-4dc6-91e6-e05ce2c5cd9b tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:49:11.297637 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-ad96a370-1517-4dc6-91e6-e05ce2c5cd9b tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:49:11.298082 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-ad96a370-1517-4dc6-91e6-e05ce2c5cd9b tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:49:11.298843 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-ad96a370-1517-4dc6-91e6-e05ce2c5cd9b tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:49:11.299276 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-ad96a370-1517-4dc6-91e6-e05ce2c5cd9b tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:49:11.417810 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-ad96a370-1517-4dc6-91e6-e05ce2c5cd9b tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:49:11.426465 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-ad96a370-1517-4dc6-91e6-e05ce2c5cd9b tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:49:11.427975 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-ad96a370-1517-4dc6-91e6-e05ce2c5cd9b tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:49:11.429113 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-ad96a370-1517-4dc6-91e6-e05ce2c5cd9b tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672" status: 200 len: 1748 microversion: 2.20 time: 0.142766 Oct 27 15:49:11.429668 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 533/995] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Oct 27 15:49:11 2021] GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672 => generated 1748 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 15:49:11.835391 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-8efa07ae-447f-4ab8-beb8-0406e5b43a5d tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:49:11.836316 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-8efa07ae-447f-4ab8-beb8-0406e5b43a5d tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: 62c89161-c119-48b2-839d-712db798ff96] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:49:11.842453 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-8efa07ae-447f-4ab8-beb8-0406e5b43a5d tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:49:11.842891 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-8efa07ae-447f-4ab8-beb8-0406e5b43a5d tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:49:11.844396 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-8efa07ae-447f-4ab8-beb8-0406e5b43a5d tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:49:11.845076 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-8efa07ae-447f-4ab8-beb8-0406e5b43a5d tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:49:11.872610 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-8efa07ae-447f-4ab8-beb8-0406e5b43a5d tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040929 Oct 27 15:49:11.873148 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 463/996] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Oct 27 15:49:11 2021] GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 15:49:12.448391 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-104bab28-db33-4882-b4fa-d14ee980ea99 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:49:12.448975 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-104bab28-db33-4882-b4fa-d14ee980ea99 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:49:12.455340 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-104bab28-db33-4882-b4fa-d14ee980ea99 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:49:12.455781 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-104bab28-db33-4882-b4fa-d14ee980ea99 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:49:12.456564 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-104bab28-db33-4882-b4fa-d14ee980ea99 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:49:12.456992 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-104bab28-db33-4882-b4fa-d14ee980ea99 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:49:12.578677 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-104bab28-db33-4882-b4fa-d14ee980ea99 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:49:12.587329 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-104bab28-db33-4882-b4fa-d14ee980ea99 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:49:12.588936 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-104bab28-db33-4882-b4fa-d14ee980ea99 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:49:12.590128 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-104bab28-db33-4882-b4fa-d14ee980ea99 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672" status: 200 len: 1748 microversion: 2.20 time: 0.146013 Oct 27 15:49:12.590718 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 534/997] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Oct 27 15:49:12 2021] GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672 => generated 1748 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 15:49:12.803796 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-f858e0a8-2cbc-4cb5-ba1d-54baa8180ea6 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:49:12.804233 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-f858e0a8-2cbc-4cb5-ba1d-54baa8180ea6 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] [instance: a79303e6-05ad-4901-96b7-ce845b4016f4] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:49:12.809930 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-f858e0a8-2cbc-4cb5-ba1d-54baa8180ea6 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:49:12.810369 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-f858e0a8-2cbc-4cb5-ba1d-54baa8180ea6 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:49:12.811113 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-f858e0a8-2cbc-4cb5-ba1d-54baa8180ea6 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:49:12.811537 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-f858e0a8-2cbc-4cb5-ba1d-54baa8180ea6 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:49:12.834646 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-f858e0a8-2cbc-4cb5-ba1d-54baa8180ea6 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] [instance: a79303e6-05ad-4901-96b7-ce845b4016f4] Going to try to terminate instance {{(pid=122225) delete /opt/stack/nova/nova/compute/api.py:2612}} Oct 27 15:49:12.884870 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-542514cb-7a23-47ea-a703-a069d6dc40f6 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:49:12.885865 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-542514cb-7a23-47ea-a703-a069d6dc40f6 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: 62c89161-c119-48b2-839d-712db798ff96] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:49:12.891941 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-542514cb-7a23-47ea-a703-a069d6dc40f6 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:49:12.892452 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-542514cb-7a23-47ea-a703-a069d6dc40f6 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:49:12.893233 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-542514cb-7a23-47ea-a703-a069d6dc40f6 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:49:12.893664 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-542514cb-7a23-47ea-a703-a069d6dc40f6 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:49:12.906377 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-f858e0a8-2cbc-4cb5-ba1d-54baa8180ea6 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] 10.222.0.64 "DELETE /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4" status: 204 len: 0 microversion: 2.1 time: 0.105967 Oct 27 15:49:12.907606 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 464/998] 10.222.0.64 () {58 vars in 1238 bytes} [Wed Oct 27 15:49:12 2021] DELETE /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 15:49:12.916782 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-da1ea683-ad17-4930-ade3-b465f8099ffe tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:49:12.917499 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-da1ea683-ad17-4930-ade3-b465f8099ffe tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] [instance: a79303e6-05ad-4901-96b7-ce845b4016f4] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:49:12.923867 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-da1ea683-ad17-4930-ade3-b465f8099ffe tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:49:12.924313 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-da1ea683-ad17-4930-ade3-b465f8099ffe tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:49:12.925080 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-da1ea683-ad17-4930-ade3-b465f8099ffe tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:49:12.925511 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-da1ea683-ad17-4930-ade3-b465f8099ffe tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:49:12.931867 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-542514cb-7a23-47ea-a703-a069d6dc40f6 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051331 Oct 27 15:49:12.932429 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 535/999] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Oct 27 15:49:12 2021] GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 15:49:13.109139 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-da1ea683-ad17-4930-ade3-b465f8099ffe tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c757a383a434a4c9b1b928087af8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8818377e744d4f6ba65560705c191f0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:49:13.116575 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-da1ea683-ad17-4930-ade3-b465f8099ffe tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] 10.222.0.64 "GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4" status: 200 len: 1576 microversion: 2.1 time: 0.204192 Oct 27 15:49:13.117143 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 465/1000] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:49:12 2021] GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4 => generated 1576 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 15:49:13.609115 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-f73b7591-344e-4f6b-a9a1-81e935abfa81 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:49:13.610477 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-f73b7591-344e-4f6b-a9a1-81e935abfa81 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:49:13.616958 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-f73b7591-344e-4f6b-a9a1-81e935abfa81 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:49:13.617394 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-f73b7591-344e-4f6b-a9a1-81e935abfa81 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:49:13.618144 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-f73b7591-344e-4f6b-a9a1-81e935abfa81 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:49:13.618568 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-f73b7591-344e-4f6b-a9a1-81e935abfa81 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:49:13.740028 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-f73b7591-344e-4f6b-a9a1-81e935abfa81 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:49:13.748096 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-f73b7591-344e-4f6b-a9a1-81e935abfa81 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:49:13.749613 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-f73b7591-344e-4f6b-a9a1-81e935abfa81 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:49:13.750784 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-f73b7591-344e-4f6b-a9a1-81e935abfa81 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672" status: 200 len: 1748 microversion: 2.20 time: 0.145370 Oct 27 15:49:13.751342 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 536/1001] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Oct 27 15:49:13 2021] GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672 => generated 1748 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 15:49:13.942622 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-a50ef4f6-43a2-4f66-8e63-07ff19ca1c6f tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:49:13.943533 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-a50ef4f6-43a2-4f66-8e63-07ff19ca1c6f tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: 62c89161-c119-48b2-839d-712db798ff96] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:49:13.949898 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-a50ef4f6-43a2-4f66-8e63-07ff19ca1c6f tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:49:13.950339 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-a50ef4f6-43a2-4f66-8e63-07ff19ca1c6f tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:49:13.951114 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-a50ef4f6-43a2-4f66-8e63-07ff19ca1c6f tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:49:13.951546 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-a50ef4f6-43a2-4f66-8e63-07ff19ca1c6f tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:49:13.982763 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-a50ef4f6-43a2-4f66-8e63-07ff19ca1c6f tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043861 Oct 27 15:49:13.983333 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 466/1002] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Oct 27 15:49:13 2021] GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 15:49:14.133794 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-0d50eb0a-aa53-43e8-b452-7d7f9ba4be3f tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:49:14.134398 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-0d50eb0a-aa53-43e8-b452-7d7f9ba4be3f tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] [instance: a79303e6-05ad-4901-96b7-ce845b4016f4] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:49:14.140631 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-0d50eb0a-aa53-43e8-b452-7d7f9ba4be3f tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:49:14.141588 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-0d50eb0a-aa53-43e8-b452-7d7f9ba4be3f tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:49:14.142434 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-0d50eb0a-aa53-43e8-b452-7d7f9ba4be3f tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:49:14.142863 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-0d50eb0a-aa53-43e8-b452-7d7f9ba4be3f tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:49:14.271390 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-0d50eb0a-aa53-43e8-b452-7d7f9ba4be3f tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c757a383a434a4c9b1b928087af8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8818377e744d4f6ba65560705c191f0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:49:14.278927 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-0d50eb0a-aa53-43e8-b452-7d7f9ba4be3f tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] 10.222.0.64 "GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4" status: 200 len: 1576 microversion: 2.1 time: 0.148778 Oct 27 15:49:14.279526 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 537/1003] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:49:14 2021] GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4 => generated 1576 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 15:49:14.769651 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-c8fc9312-dfea-400f-8a1d-22c4ead8b4d0 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:49:14.770265 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-c8fc9312-dfea-400f-8a1d-22c4ead8b4d0 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:49:14.776527 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-c8fc9312-dfea-400f-8a1d-22c4ead8b4d0 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:49:14.776971 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-c8fc9312-dfea-400f-8a1d-22c4ead8b4d0 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:49:14.777761 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-c8fc9312-dfea-400f-8a1d-22c4ead8b4d0 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:49:14.778196 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-c8fc9312-dfea-400f-8a1d-22c4ead8b4d0 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:49:14.995047 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-df90123c-19d2-4ba9-a95d-e75a106c5655 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:49:14.996253 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-df90123c-19d2-4ba9-a95d-e75a106c5655 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: 62c89161-c119-48b2-839d-712db798ff96] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:49:15.003268 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-df90123c-19d2-4ba9-a95d-e75a106c5655 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:49:15.003935 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-df90123c-19d2-4ba9-a95d-e75a106c5655 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:49:15.004884 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-df90123c-19d2-4ba9-a95d-e75a106c5655 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:49:15.005437 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-df90123c-19d2-4ba9-a95d-e75a106c5655 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:49:15.036872 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-df90123c-19d2-4ba9-a95d-e75a106c5655 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045884 Oct 27 15:49:15.037606 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 538/1004] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Oct 27 15:49:14 2021] GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 15:49:15.132880 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-c8fc9312-dfea-400f-8a1d-22c4ead8b4d0 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:49:15.142305 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-c8fc9312-dfea-400f-8a1d-22c4ead8b4d0 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:49:15.143809 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-c8fc9312-dfea-400f-8a1d-22c4ead8b4d0 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:49:15.144992 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-c8fc9312-dfea-400f-8a1d-22c4ead8b4d0 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672" status: 200 len: 1748 microversion: 2.20 time: 0.379332 Oct 27 15:49:15.145695 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 467/1005] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Oct 27 15:49:14 2021] GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672 => generated 1748 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 15:49:15.296253 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-5da2642b-ec3f-44f3-97ea-d4344f2f690a tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:49:15.296876 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-5da2642b-ec3f-44f3-97ea-d4344f2f690a tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] [instance: a79303e6-05ad-4901-96b7-ce845b4016f4] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:49:15.303367 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-5da2642b-ec3f-44f3-97ea-d4344f2f690a tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:49:15.303813 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-5da2642b-ec3f-44f3-97ea-d4344f2f690a tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:49:15.304605 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-5da2642b-ec3f-44f3-97ea-d4344f2f690a tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:49:15.305242 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-5da2642b-ec3f-44f3-97ea-d4344f2f690a tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:49:15.379558 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-5da2642b-ec3f-44f3-97ea-d4344f2f690a tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c757a383a434a4c9b1b928087af8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8818377e744d4f6ba65560705c191f0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:49:15.387664 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-5da2642b-ec3f-44f3-97ea-d4344f2f690a tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] 10.222.0.64 "GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4" status: 200 len: 1509 microversion: 2.1 time: 0.095005 Oct 27 15:49:15.388273 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 539/1006] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:49:15 2021] GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4 => generated 1509 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 15:49:15.653462 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [req-cc8ce662-a245-4642-878f-1bedee0e0682 req-a49bee94-4db0-4df6-8b93-6e84e4bf4c73 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a79303e6-05ad-4901-96b7-ce845b4016f4", "name": "network-vif-deleted", "tag": "9cdb66cd-4ae2-4cf0-98ca-af0002156976"}]} {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 15:49:15.655031 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 27 15:49:15.655031 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: warnings.warn(msg) Oct 27 15:49:15.663497 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [req-cc8ce662-a245-4642-878f-1bedee0e0682 req-a49bee94-4db0-4df6-8b93-6e84e4bf4c73 service nova] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:49:15.664021 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [req-cc8ce662-a245-4642-878f-1bedee0e0682 req-a49bee94-4db0-4df6-8b93-6e84e4bf4c73 service nova] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:49:15.675142 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.compute.server_external_events [req-cc8ce662-a245-4642-878f-1bedee0e0682 req-a49bee94-4db0-4df6-8b93-6e84e4bf4c73 service nova] Creating event network-vif-deleted:9cdb66cd-4ae2-4cf0-98ca-af0002156976 for instance a79303e6-05ad-4901-96b7-ce845b4016f4 on hv-cinder-80070 Oct 27 15:49:15.680165 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [req-cc8ce662-a245-4642-878f-1bedee0e0682 req-a49bee94-4db0-4df6-8b93-6e84e4bf4c73 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.108945 Oct 27 15:49:15.680838 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 468/1007] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Oct 27 15:49:15 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 15:49:16.048918 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-d9346069-4b77-4ebf-9911-d14640605926 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:49:16.050003 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-d9346069-4b77-4ebf-9911-d14640605926 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: 62c89161-c119-48b2-839d-712db798ff96] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:49:16.056925 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-d9346069-4b77-4ebf-9911-d14640605926 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:49:16.057511 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-d9346069-4b77-4ebf-9911-d14640605926 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:49:16.058392 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-d9346069-4b77-4ebf-9911-d14640605926 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:49:16.058947 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-d9346069-4b77-4ebf-9911-d14640605926 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:49:16.093387 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-d9346069-4b77-4ebf-9911-d14640605926 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048418 Oct 27 15:49:16.098228 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 540/1008] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Oct 27 15:49:16 2021] GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 15:49:16.165210 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-c23de35c-f6e2-406d-b9d0-a4ffb05154f9 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:49:16.166170 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-c23de35c-f6e2-406d-b9d0-a4ffb05154f9 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:49:16.174858 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-c23de35c-f6e2-406d-b9d0-a4ffb05154f9 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:49:16.175630 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-c23de35c-f6e2-406d-b9d0-a4ffb05154f9 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:49:16.176606 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-c23de35c-f6e2-406d-b9d0-a4ffb05154f9 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:49:16.177151 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-c23de35c-f6e2-406d-b9d0-a4ffb05154f9 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:49:16.311326 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-c23de35c-f6e2-406d-b9d0-a4ffb05154f9 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:49:16.321119 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-c23de35c-f6e2-406d-b9d0-a4ffb05154f9 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:49:16.323521 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-c23de35c-f6e2-406d-b9d0-a4ffb05154f9 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:49:16.324903 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-c23de35c-f6e2-406d-b9d0-a4ffb05154f9 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672" status: 200 len: 1748 microversion: 2.20 time: 0.164392 Oct 27 15:49:16.325456 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 469/1009] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Oct 27 15:49:16 2021] GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672 => generated 1748 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 15:49:16.404605 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-39f3671f-d81f-4f21-bf1a-6572251d4386 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:49:16.405210 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-39f3671f-d81f-4f21-bf1a-6572251d4386 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] [instance: a79303e6-05ad-4901-96b7-ce845b4016f4] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:49:16.411567 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-39f3671f-d81f-4f21-bf1a-6572251d4386 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:49:16.412143 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-39f3671f-d81f-4f21-bf1a-6572251d4386 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:49:16.412930 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-39f3671f-d81f-4f21-bf1a-6572251d4386 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:49:16.413362 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-39f3671f-d81f-4f21-bf1a-6572251d4386 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:49:16.482389 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-39f3671f-d81f-4f21-bf1a-6572251d4386 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c757a383a434a4c9b1b928087af8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8818377e744d4f6ba65560705c191f0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:49:16.490212 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-39f3671f-d81f-4f21-bf1a-6572251d4386 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] 10.222.0.64 "GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4" status: 200 len: 1226 microversion: 2.1 time: 0.089204 Oct 27 15:49:16.490786 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 541/1010] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:49:16 2021] GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4 => generated 1226 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 15:49:17.044910 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 27 15:49:17.045149 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: Wed Oct 27 15:49:17 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Oct 27 15:49:17.112658 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-375f776e-b0f1-4670-b700-b77217757595 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:49:17.113515 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-375f776e-b0f1-4670-b700-b77217757595 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: 62c89161-c119-48b2-839d-712db798ff96] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:49:17.119459 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-375f776e-b0f1-4670-b700-b77217757595 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:49:17.119940 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-375f776e-b0f1-4670-b700-b77217757595 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:49:17.120709 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-375f776e-b0f1-4670-b700-b77217757595 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:49:17.121147 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-375f776e-b0f1-4670-b700-b77217757595 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:49:17.150558 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-375f776e-b0f1-4670-b700-b77217757595 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042279 Oct 27 15:49:17.151117 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 470/1011] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Oct 27 15:49:17 2021] GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 15:49:17.342331 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-c2efc2cb-6c79-401d-8bc1-ca94ab775969 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:49:17.342965 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-c2efc2cb-6c79-401d-8bc1-ca94ab775969 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:49:17.350021 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-c2efc2cb-6c79-401d-8bc1-ca94ab775969 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:49:17.350462 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-c2efc2cb-6c79-401d-8bc1-ca94ab775969 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:49:17.351220 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-c2efc2cb-6c79-401d-8bc1-ca94ab775969 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:49:17.351651 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-c2efc2cb-6c79-401d-8bc1-ca94ab775969 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:49:17.476652 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-c2efc2cb-6c79-401d-8bc1-ca94ab775969 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:49:17.486378 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-c2efc2cb-6c79-401d-8bc1-ca94ab775969 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:49:17.488094 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-c2efc2cb-6c79-401d-8bc1-ca94ab775969 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:49:17.489321 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-c2efc2cb-6c79-401d-8bc1-ca94ab775969 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672" status: 200 len: 1748 microversion: 2.20 time: 0.150750 Oct 27 15:49:17.489837 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 542/1012] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Oct 27 15:49:17 2021] GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672 => generated 1748 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 15:49:17.506914 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-3af76adc-dc96-4874-82b3-a89d14014798 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:49:17.507618 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-3af76adc-dc96-4874-82b3-a89d14014798 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] [instance: a79303e6-05ad-4901-96b7-ce845b4016f4] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:49:17.514103 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-3af76adc-dc96-4874-82b3-a89d14014798 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:49:17.514548 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-3af76adc-dc96-4874-82b3-a89d14014798 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:49:17.515318 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-3af76adc-dc96-4874-82b3-a89d14014798 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:49:17.515747 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-3af76adc-dc96-4874-82b3-a89d14014798 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:49:17.577151 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-3af76adc-dc96-4874-82b3-a89d14014798 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c757a383a434a4c9b1b928087af8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8818377e744d4f6ba65560705c191f0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:49:17.585622 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-3af76adc-dc96-4874-82b3-a89d14014798 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] 10.222.0.64 "GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4" status: 200 len: 1226 microversion: 2.1 time: 0.082353 Oct 27 15:49:17.586191 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 471/1013] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:49:17 2021] GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4 => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 15:49:18.162583 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-59acc7af-6617-4890-9ea2-278bf70093f5 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:49:18.163403 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-59acc7af-6617-4890-9ea2-278bf70093f5 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: 62c89161-c119-48b2-839d-712db798ff96] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:49:18.169441 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-59acc7af-6617-4890-9ea2-278bf70093f5 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:49:18.169881 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-59acc7af-6617-4890-9ea2-278bf70093f5 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:49:18.170630 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-59acc7af-6617-4890-9ea2-278bf70093f5 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:49:18.171058 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-59acc7af-6617-4890-9ea2-278bf70093f5 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:49:18.198794 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-59acc7af-6617-4890-9ea2-278bf70093f5 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040316 Oct 27 15:49:18.199339 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 543/1014] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Oct 27 15:49:18 2021] GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 15:49:18.507061 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-194d638a-9648-469e-a5d0-ab24ba3da8b0 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:49:18.507697 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-194d638a-9648-469e-a5d0-ab24ba3da8b0 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:49:18.513700 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-194d638a-9648-469e-a5d0-ab24ba3da8b0 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:49:18.514145 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-194d638a-9648-469e-a5d0-ab24ba3da8b0 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:49:18.514936 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-194d638a-9648-469e-a5d0-ab24ba3da8b0 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:49:18.515369 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-194d638a-9648-469e-a5d0-ab24ba3da8b0 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:49:18.602076 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-6cddcfd4-6975-4759-9809-668480c54c80 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:49:18.602678 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-6cddcfd4-6975-4759-9809-668480c54c80 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] [instance: a79303e6-05ad-4901-96b7-ce845b4016f4] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:49:18.608793 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-6cddcfd4-6975-4759-9809-668480c54c80 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:49:18.609236 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-6cddcfd4-6975-4759-9809-668480c54c80 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:49:18.611144 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-6cddcfd4-6975-4759-9809-668480c54c80 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:49:18.611577 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-6cddcfd4-6975-4759-9809-668480c54c80 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:49:18.637803 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-194d638a-9648-469e-a5d0-ab24ba3da8b0 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:49:18.646151 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-194d638a-9648-469e-a5d0-ab24ba3da8b0 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:49:18.647647 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-194d638a-9648-469e-a5d0-ab24ba3da8b0 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:49:18.648861 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-194d638a-9648-469e-a5d0-ab24ba3da8b0 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672" status: 200 len: 1748 microversion: 2.20 time: 0.145486 Oct 27 15:49:18.649408 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 472/1015] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Oct 27 15:49:18 2021] GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672 => generated 1748 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 15:49:18.670723 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-6cddcfd4-6975-4759-9809-668480c54c80 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c757a383a434a4c9b1b928087af8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8818377e744d4f6ba65560705c191f0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:49:18.678988 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-6cddcfd4-6975-4759-9809-668480c54c80 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] 10.222.0.64 "GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4" status: 200 len: 1226 microversion: 2.1 time: 0.080518 Oct 27 15:49:18.679539 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 544/1016] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:49:18 2021] GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4 => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 15:49:19.210464 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-bb43a729-ccb7-4a27-b1bd-378003a9d6d5 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:49:19.211423 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-bb43a729-ccb7-4a27-b1bd-378003a9d6d5 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: 62c89161-c119-48b2-839d-712db798ff96] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:49:19.217197 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-bb43a729-ccb7-4a27-b1bd-378003a9d6d5 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:49:19.217642 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-bb43a729-ccb7-4a27-b1bd-378003a9d6d5 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:49:19.218408 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-bb43a729-ccb7-4a27-b1bd-378003a9d6d5 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:49:19.218841 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-bb43a729-ccb7-4a27-b1bd-378003a9d6d5 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:49:19.247907 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-bb43a729-ccb7-4a27-b1bd-378003a9d6d5 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041186 Oct 27 15:49:19.248475 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 473/1017] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Oct 27 15:49:19 2021] GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 15:49:19.666949 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-05c80ba0-5d78-4dbb-aeee-7f49abd50457 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:49:19.667549 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-05c80ba0-5d78-4dbb-aeee-7f49abd50457 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:49:19.673984 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-05c80ba0-5d78-4dbb-aeee-7f49abd50457 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:49:19.674423 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-05c80ba0-5d78-4dbb-aeee-7f49abd50457 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:49:19.675184 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-05c80ba0-5d78-4dbb-aeee-7f49abd50457 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:49:19.675615 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-05c80ba0-5d78-4dbb-aeee-7f49abd50457 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:49:19.696737 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-af40c7e1-d9ef-4cc8-863e-2adac9adeddd tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:49:19.697335 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-af40c7e1-d9ef-4cc8-863e-2adac9adeddd tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] [instance: a79303e6-05ad-4901-96b7-ce845b4016f4] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:49:19.704702 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-af40c7e1-d9ef-4cc8-863e-2adac9adeddd tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:49:19.705142 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-af40c7e1-d9ef-4cc8-863e-2adac9adeddd tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:49:19.705906 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-af40c7e1-d9ef-4cc8-863e-2adac9adeddd tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:49:19.706333 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-af40c7e1-d9ef-4cc8-863e-2adac9adeddd tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:49:19.765923 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-af40c7e1-d9ef-4cc8-863e-2adac9adeddd tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c757a383a434a4c9b1b928087af8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8818377e744d4f6ba65560705c191f0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:49:19.773958 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-af40c7e1-d9ef-4cc8-863e-2adac9adeddd tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] 10.222.0.64 "GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4" status: 200 len: 1226 microversion: 2.1 time: 0.081256 Oct 27 15:49:19.774529 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 474/1018] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:49:19 2021] GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4 => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 15:49:19.796362 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-05c80ba0-5d78-4dbb-aeee-7f49abd50457 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:49:19.804391 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-05c80ba0-5d78-4dbb-aeee-7f49abd50457 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:49:19.805876 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-05c80ba0-5d78-4dbb-aeee-7f49abd50457 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:49:19.807012 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-05c80ba0-5d78-4dbb-aeee-7f49abd50457 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672" status: 200 len: 1748 microversion: 2.20 time: 0.143841 Oct 27 15:49:19.807554 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 545/1019] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Oct 27 15:49:19 2021] GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672 => generated 1748 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 15:49:20.259222 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-b1d84f8d-d434-459f-a834-4254f9437937 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:49:20.260166 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-b1d84f8d-d434-459f-a834-4254f9437937 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: 62c89161-c119-48b2-839d-712db798ff96] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:49:20.266616 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-b1d84f8d-d434-459f-a834-4254f9437937 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:49:20.267075 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-b1d84f8d-d434-459f-a834-4254f9437937 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:49:20.268124 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-b1d84f8d-d434-459f-a834-4254f9437937 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:49:20.268578 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-b1d84f8d-d434-459f-a834-4254f9437937 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:49:20.298065 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-b1d84f8d-d434-459f-a834-4254f9437937 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041951 Oct 27 15:49:20.298613 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 475/1020] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Oct 27 15:49:20 2021] GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 15:49:20.790503 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-3edfd598-5f5d-45ef-b6e3-73d75b639bf3 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:49:20.791107 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-3edfd598-5f5d-45ef-b6e3-73d75b639bf3 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] [instance: a79303e6-05ad-4901-96b7-ce845b4016f4] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:49:20.797271 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-3edfd598-5f5d-45ef-b6e3-73d75b639bf3 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:49:20.797709 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-3edfd598-5f5d-45ef-b6e3-73d75b639bf3 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:49:20.798473 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-3edfd598-5f5d-45ef-b6e3-73d75b639bf3 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:49:20.798900 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-3edfd598-5f5d-45ef-b6e3-73d75b639bf3 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:49:20.824979 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-7a0a4406-7991-4d5f-a887-ad1380e615c6 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:49:20.825577 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-7a0a4406-7991-4d5f-a887-ad1380e615c6 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:49:20.832429 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-7a0a4406-7991-4d5f-a887-ad1380e615c6 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:49:20.832874 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-7a0a4406-7991-4d5f-a887-ad1380e615c6 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:49:20.833636 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-7a0a4406-7991-4d5f-a887-ad1380e615c6 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:49:20.834066 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-7a0a4406-7991-4d5f-a887-ad1380e615c6 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:49:20.862361 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-3edfd598-5f5d-45ef-b6e3-73d75b639bf3 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c757a383a434a4c9b1b928087af8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8818377e744d4f6ba65560705c191f0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:49:20.869566 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-3edfd598-5f5d-45ef-b6e3-73d75b639bf3 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] 10.222.0.64 "GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4" status: 200 len: 1226 microversion: 2.1 time: 0.082828 Oct 27 15:49:20.870127 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 546/1021] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:49:20 2021] GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4 => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 15:49:20.954128 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-7a0a4406-7991-4d5f-a887-ad1380e615c6 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:49:20.962258 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-7a0a4406-7991-4d5f-a887-ad1380e615c6 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:49:20.963733 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-7a0a4406-7991-4d5f-a887-ad1380e615c6 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:49:20.964893 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-7a0a4406-7991-4d5f-a887-ad1380e615c6 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672" status: 200 len: 1748 microversion: 2.20 time: 0.143564 Oct 27 15:49:20.965446 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 476/1022] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Oct 27 15:49:20 2021] GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672 => generated 1748 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 15:49:21.309342 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-86511300-999e-4041-9226-1d5df78b0911 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:49:21.310233 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-86511300-999e-4041-9226-1d5df78b0911 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: 62c89161-c119-48b2-839d-712db798ff96] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:49:21.316235 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-86511300-999e-4041-9226-1d5df78b0911 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:49:21.316673 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-86511300-999e-4041-9226-1d5df78b0911 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:49:21.317421 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-86511300-999e-4041-9226-1d5df78b0911 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:49:21.317845 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-86511300-999e-4041-9226-1d5df78b0911 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:49:21.347549 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-86511300-999e-4041-9226-1d5df78b0911 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041939 Oct 27 15:49:21.348193 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 547/1023] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Oct 27 15:49:21 2021] GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 15:49:21.886275 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-93016b25-ba81-4ae6-bf92-3a170bf5219b tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:49:21.886890 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-93016b25-ba81-4ae6-bf92-3a170bf5219b tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] [instance: a79303e6-05ad-4901-96b7-ce845b4016f4] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:49:21.893984 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-93016b25-ba81-4ae6-bf92-3a170bf5219b tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:49:21.894423 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-93016b25-ba81-4ae6-bf92-3a170bf5219b tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:49:21.895187 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-93016b25-ba81-4ae6-bf92-3a170bf5219b tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:49:21.895624 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-93016b25-ba81-4ae6-bf92-3a170bf5219b tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:49:21.957411 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-93016b25-ba81-4ae6-bf92-3a170bf5219b tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c757a383a434a4c9b1b928087af8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8818377e744d4f6ba65560705c191f0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:49:21.964556 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-93016b25-ba81-4ae6-bf92-3a170bf5219b tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] 10.222.0.64 "GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4" status: 200 len: 1226 microversion: 2.1 time: 0.081943 Oct 27 15:49:21.965114 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 477/1024] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:49:21 2021] GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4 => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 15:49:21.983586 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-f12a6b01-ad96-4319-a564-0f213ccfb742 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:49:21.984229 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-f12a6b01-ad96-4319-a564-0f213ccfb742 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:49:21.990463 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-f12a6b01-ad96-4319-a564-0f213ccfb742 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:49:21.990904 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-f12a6b01-ad96-4319-a564-0f213ccfb742 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:49:21.991662 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-f12a6b01-ad96-4319-a564-0f213ccfb742 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:49:21.992129 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-f12a6b01-ad96-4319-a564-0f213ccfb742 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:49:22.110739 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-f12a6b01-ad96-4319-a564-0f213ccfb742 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:49:22.118876 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-f12a6b01-ad96-4319-a564-0f213ccfb742 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:49:22.120418 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-f12a6b01-ad96-4319-a564-0f213ccfb742 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:49:22.121560 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-f12a6b01-ad96-4319-a564-0f213ccfb742 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672" status: 200 len: 1748 microversion: 2.20 time: 0.141624 Oct 27 15:49:22.122108 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 548/1025] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Oct 27 15:49:21 2021] GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672 => generated 1748 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 15:49:22.358454 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-8dab6ecd-7e1b-4294-8100-f28065d4c6b7 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:49:22.359396 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-8dab6ecd-7e1b-4294-8100-f28065d4c6b7 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: 62c89161-c119-48b2-839d-712db798ff96] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:49:22.365898 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-8dab6ecd-7e1b-4294-8100-f28065d4c6b7 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:49:22.366343 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-8dab6ecd-7e1b-4294-8100-f28065d4c6b7 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:49:22.367105 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-8dab6ecd-7e1b-4294-8100-f28065d4c6b7 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:49:22.367540 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-8dab6ecd-7e1b-4294-8100-f28065d4c6b7 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:49:22.396185 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-8dab6ecd-7e1b-4294-8100-f28065d4c6b7 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041473 Oct 27 15:49:22.396741 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 478/1026] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Oct 27 15:49:22 2021] GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 15:49:22.981179 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-0a5245c2-1229-48db-a72d-f90e9457e89a tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:49:22.981784 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-0a5245c2-1229-48db-a72d-f90e9457e89a tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] [instance: a79303e6-05ad-4901-96b7-ce845b4016f4] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:49:22.988101 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-0a5245c2-1229-48db-a72d-f90e9457e89a tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:49:22.988708 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-0a5245c2-1229-48db-a72d-f90e9457e89a tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:49:22.989281 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-0a5245c2-1229-48db-a72d-f90e9457e89a tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:49:22.989706 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-0a5245c2-1229-48db-a72d-f90e9457e89a tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:49:23.141306 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-385cdd1b-5eca-4378-9d07-b59490ca4379 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:49:23.141965 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-385cdd1b-5eca-4378-9d07-b59490ca4379 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:49:23.148635 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-385cdd1b-5eca-4378-9d07-b59490ca4379 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:49:23.149075 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-385cdd1b-5eca-4378-9d07-b59490ca4379 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:49:23.149852 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-385cdd1b-5eca-4378-9d07-b59490ca4379 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:49:23.150291 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-385cdd1b-5eca-4378-9d07-b59490ca4379 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:49:23.210011 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-0a5245c2-1229-48db-a72d-f90e9457e89a tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c757a383a434a4c9b1b928087af8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8818377e744d4f6ba65560705c191f0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:49:23.217440 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-0a5245c2-1229-48db-a72d-f90e9457e89a tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] 10.222.0.64 "GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4" status: 200 len: 1226 microversion: 2.1 time: 0.239862 Oct 27 15:49:23.218009 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 549/1027] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:49:22 2021] GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4 => generated 1226 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 15:49:23.274447 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-385cdd1b-5eca-4378-9d07-b59490ca4379 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:49:23.282579 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-385cdd1b-5eca-4378-9d07-b59490ca4379 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:49:23.284107 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-385cdd1b-5eca-4378-9d07-b59490ca4379 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:49:23.285254 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-385cdd1b-5eca-4378-9d07-b59490ca4379 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672" status: 200 len: 1748 microversion: 2.20 time: 0.148461 Oct 27 15:49:23.285806 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 479/1028] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Oct 27 15:49:23 2021] GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672 => generated 1748 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 15:49:23.406696 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-7f0161c5-afc3-41d2-b05b-bf8af972edd1 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:49:23.407599 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-7f0161c5-afc3-41d2-b05b-bf8af972edd1 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: 62c89161-c119-48b2-839d-712db798ff96] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:49:23.413333 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-7f0161c5-afc3-41d2-b05b-bf8af972edd1 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:49:23.413773 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-7f0161c5-afc3-41d2-b05b-bf8af972edd1 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:49:23.414529 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-7f0161c5-afc3-41d2-b05b-bf8af972edd1 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:49:23.414958 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-7f0161c5-afc3-41d2-b05b-bf8af972edd1 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:49:23.442957 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-7f0161c5-afc3-41d2-b05b-bf8af972edd1 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040177 Oct 27 15:49:23.443490 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 550/1029] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Oct 27 15:49:23 2021] GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 15:49:24.235512 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-5931b4b2-bbf4-499a-916a-591dd7ade675 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:49:24.236128 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-5931b4b2-bbf4-499a-916a-591dd7ade675 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] [instance: a79303e6-05ad-4901-96b7-ce845b4016f4] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:49:24.242225 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-5931b4b2-bbf4-499a-916a-591dd7ade675 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:49:24.242661 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-5931b4b2-bbf4-499a-916a-591dd7ade675 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:49:24.243556 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-5931b4b2-bbf4-499a-916a-591dd7ade675 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:49:24.244012 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-5931b4b2-bbf4-499a-916a-591dd7ade675 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:49:24.303007 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-ea606747-74c0-4c39-af13-4bfb09075fb4 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:49:24.303615 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-ea606747-74c0-4c39-af13-4bfb09075fb4 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:49:24.309821 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-ea606747-74c0-4c39-af13-4bfb09075fb4 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:49:24.310267 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-ea606747-74c0-4c39-af13-4bfb09075fb4 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:49:24.311038 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-ea606747-74c0-4c39-af13-4bfb09075fb4 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:49:24.312414 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-ea606747-74c0-4c39-af13-4bfb09075fb4 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:49:24.313870 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-5931b4b2-bbf4-499a-916a-591dd7ade675 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c757a383a434a4c9b1b928087af8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8818377e744d4f6ba65560705c191f0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:49:24.321256 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-5931b4b2-bbf4-499a-916a-591dd7ade675 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] 10.222.0.64 "GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4" status: 200 len: 1226 microversion: 2.1 time: 0.089880 Oct 27 15:49:24.321811 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 480/1030] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:49:24 2021] GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4 => generated 1226 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 15:49:24.436490 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-ea606747-74c0-4c39-af13-4bfb09075fb4 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:49:24.445055 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-ea606747-74c0-4c39-af13-4bfb09075fb4 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:49:24.446528 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-ea606747-74c0-4c39-af13-4bfb09075fb4 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:49:24.447663 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-ea606747-74c0-4c39-af13-4bfb09075fb4 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672" status: 200 len: 1748 microversion: 2.20 time: 0.148355 Oct 27 15:49:24.448235 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 551/1031] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Oct 27 15:49:24 2021] GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672 => generated 1748 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 15:49:24.455334 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-039c9381-4c9b-4631-bb05-77098ef9170e tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:49:24.456337 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-039c9381-4c9b-4631-bb05-77098ef9170e tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: 62c89161-c119-48b2-839d-712db798ff96] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:49:24.462037 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-039c9381-4c9b-4631-bb05-77098ef9170e tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:49:24.462481 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-039c9381-4c9b-4631-bb05-77098ef9170e tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:49:24.463232 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-039c9381-4c9b-4631-bb05-77098ef9170e tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:49:24.463656 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-039c9381-4c9b-4631-bb05-77098ef9170e tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:49:24.493159 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-039c9381-4c9b-4631-bb05-77098ef9170e tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042410 Oct 27 15:49:24.493626 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 481/1032] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Oct 27 15:49:24 2021] GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 15:49:25.338300 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-4b370aff-9e30-4248-b889-24de719d0413 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:49:25.338973 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-4b370aff-9e30-4248-b889-24de719d0413 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] [instance: a79303e6-05ad-4901-96b7-ce845b4016f4] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:49:25.345924 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-4b370aff-9e30-4248-b889-24de719d0413 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:49:25.346359 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-4b370aff-9e30-4248-b889-24de719d0413 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:49:25.347126 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-4b370aff-9e30-4248-b889-24de719d0413 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:49:25.347557 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-4b370aff-9e30-4248-b889-24de719d0413 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:49:25.407214 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-4b370aff-9e30-4248-b889-24de719d0413 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c757a383a434a4c9b1b928087af8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8818377e744d4f6ba65560705c191f0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:49:25.415694 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-4b370aff-9e30-4248-b889-24de719d0413 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] 10.222.0.64 "GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4" status: 200 len: 1226 microversion: 2.1 time: 0.081010 Oct 27 15:49:25.416365 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 552/1033] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:49:25 2021] GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4 => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 15:49:25.465945 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-1d7a831d-103a-421d-82f3-aafcad119b6d tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:49:25.466535 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-1d7a831d-103a-421d-82f3-aafcad119b6d tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:49:25.473302 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-1d7a831d-103a-421d-82f3-aafcad119b6d tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:49:25.473764 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-1d7a831d-103a-421d-82f3-aafcad119b6d tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:49:25.474491 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-1d7a831d-103a-421d-82f3-aafcad119b6d tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:49:25.474914 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-1d7a831d-103a-421d-82f3-aafcad119b6d tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:49:25.503988 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-de0ef3ca-4c89-4feb-8ab9-dc30c3dda040 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:49:25.504886 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-de0ef3ca-4c89-4feb-8ab9-dc30c3dda040 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: 62c89161-c119-48b2-839d-712db798ff96] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:49:25.510754 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-de0ef3ca-4c89-4feb-8ab9-dc30c3dda040 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:49:25.511202 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-de0ef3ca-4c89-4feb-8ab9-dc30c3dda040 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:49:25.512006 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-de0ef3ca-4c89-4feb-8ab9-dc30c3dda040 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:49:25.512441 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-de0ef3ca-4c89-4feb-8ab9-dc30c3dda040 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:49:25.541935 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-de0ef3ca-4c89-4feb-8ab9-dc30c3dda040 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042108 Oct 27 15:49:25.542495 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 553/1034] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Oct 27 15:49:25 2021] GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 15:49:25.602484 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-1d7a831d-103a-421d-82f3-aafcad119b6d tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:49:25.611179 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-1d7a831d-103a-421d-82f3-aafcad119b6d tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:49:25.612695 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-1d7a831d-103a-421d-82f3-aafcad119b6d tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:49:25.613835 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-1d7a831d-103a-421d-82f3-aafcad119b6d tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672" status: 200 len: 1748 microversion: 2.20 time: 0.151569 Oct 27 15:49:25.614382 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 482/1035] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Oct 27 15:49:25 2021] GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672 => generated 1748 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 15:49:26.433762 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-774f4dd9-5824-4f4a-8bb4-7688f93c8224 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:49:26.434364 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-774f4dd9-5824-4f4a-8bb4-7688f93c8224 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] [instance: a79303e6-05ad-4901-96b7-ce845b4016f4] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:49:26.441293 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-774f4dd9-5824-4f4a-8bb4-7688f93c8224 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:49:26.441734 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-774f4dd9-5824-4f4a-8bb4-7688f93c8224 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:49:26.442496 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-774f4dd9-5824-4f4a-8bb4-7688f93c8224 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:49:26.442928 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-774f4dd9-5824-4f4a-8bb4-7688f93c8224 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:49:26.503437 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-774f4dd9-5824-4f4a-8bb4-7688f93c8224 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c757a383a434a4c9b1b928087af8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8818377e744d4f6ba65560705c191f0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:49:26.510615 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-774f4dd9-5824-4f4a-8bb4-7688f93c8224 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] 10.222.0.64 "GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4" status: 200 len: 1226 microversion: 2.1 time: 0.080518 Oct 27 15:49:26.511157 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 554/1036] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:49:26 2021] GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4 => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 15:49:26.553042 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-059f5e24-ecf2-4e99-9052-ceca43d20b38 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:49:26.553979 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-059f5e24-ecf2-4e99-9052-ceca43d20b38 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: 62c89161-c119-48b2-839d-712db798ff96] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:49:26.560122 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-059f5e24-ecf2-4e99-9052-ceca43d20b38 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:49:26.560560 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-059f5e24-ecf2-4e99-9052-ceca43d20b38 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:49:26.561315 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-059f5e24-ecf2-4e99-9052-ceca43d20b38 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:49:26.561744 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-059f5e24-ecf2-4e99-9052-ceca43d20b38 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:49:26.590407 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-059f5e24-ecf2-4e99-9052-ceca43d20b38 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041046 Oct 27 15:49:26.590950 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 483/1037] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Oct 27 15:49:26 2021] GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 15:49:26.632279 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-e5698545-7783-411c-84f5-104a675ef45b tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:49:26.632905 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-e5698545-7783-411c-84f5-104a675ef45b tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:49:26.638754 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-e5698545-7783-411c-84f5-104a675ef45b tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:49:26.639197 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-e5698545-7783-411c-84f5-104a675ef45b tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:49:26.639973 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-e5698545-7783-411c-84f5-104a675ef45b tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:49:26.640404 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-e5698545-7783-411c-84f5-104a675ef45b tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:49:26.761840 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-e5698545-7783-411c-84f5-104a675ef45b tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:49:26.770384 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-e5698545-7783-411c-84f5-104a675ef45b tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:49:26.771906 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-e5698545-7783-411c-84f5-104a675ef45b tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:49:26.773060 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-e5698545-7783-411c-84f5-104a675ef45b tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672" status: 200 len: 1748 microversion: 2.20 time: 0.144856 Oct 27 15:49:26.773604 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 555/1038] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Oct 27 15:49:26 2021] GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672 => generated 1748 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 15:49:27.528297 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-40c6da8e-6388-4449-9a42-d1e1d224e391 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:49:27.528898 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-40c6da8e-6388-4449-9a42-d1e1d224e391 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] [instance: a79303e6-05ad-4901-96b7-ce845b4016f4] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:49:27.535497 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-40c6da8e-6388-4449-9a42-d1e1d224e391 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:49:27.535967 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-40c6da8e-6388-4449-9a42-d1e1d224e391 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:49:27.536729 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-40c6da8e-6388-4449-9a42-d1e1d224e391 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:49:27.537162 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-40c6da8e-6388-4449-9a42-d1e1d224e391 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:49:27.597415 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-40c6da8e-6388-4449-9a42-d1e1d224e391 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c757a383a434a4c9b1b928087af8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8818377e744d4f6ba65560705c191f0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:49:27.602935 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-a1315921-0ce7-42ac-a995-7f129f7a9731 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:49:27.604512 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-a1315921-0ce7-42ac-a995-7f129f7a9731 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: 62c89161-c119-48b2-839d-712db798ff96] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:49:27.605003 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-40c6da8e-6388-4449-9a42-d1e1d224e391 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] 10.222.0.64 "GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4" status: 200 len: 1226 microversion: 2.1 time: 0.080451 Oct 27 15:49:27.605895 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 484/1039] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:49:27 2021] GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4 => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 15:49:27.613489 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-a1315921-0ce7-42ac-a995-7f129f7a9731 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:49:27.614352 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-a1315921-0ce7-42ac-a995-7f129f7a9731 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:49:27.615382 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-a1315921-0ce7-42ac-a995-7f129f7a9731 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:49:27.616066 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-a1315921-0ce7-42ac-a995-7f129f7a9731 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:49:27.647660 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-a1315921-0ce7-42ac-a995-7f129f7a9731 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048521 Oct 27 15:49:27.648965 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 556/1040] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Oct 27 15:49:27 2021] GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 15:49:27.790593 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-3597400d-a41b-460e-bf21-3b5ad16a13d1 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:49:27.791144 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-3597400d-a41b-460e-bf21-3b5ad16a13d1 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:49:27.796975 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-3597400d-a41b-460e-bf21-3b5ad16a13d1 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:49:27.797414 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-3597400d-a41b-460e-bf21-3b5ad16a13d1 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:49:27.798267 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-3597400d-a41b-460e-bf21-3b5ad16a13d1 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:49:27.799257 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-3597400d-a41b-460e-bf21-3b5ad16a13d1 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:49:27.924531 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-3597400d-a41b-460e-bf21-3b5ad16a13d1 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:49:27.933163 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-3597400d-a41b-460e-bf21-3b5ad16a13d1 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:49:27.934744 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-3597400d-a41b-460e-bf21-3b5ad16a13d1 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:49:27.935987 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-3597400d-a41b-460e-bf21-3b5ad16a13d1 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672" status: 200 len: 1748 microversion: 2.20 time: 0.149293 Oct 27 15:49:27.936564 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 485/1041] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Oct 27 15:49:27 2021] GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672 => generated 1748 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 15:49:28.621397 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-37695d18-a148-4273-9dd0-7b10fad766e9 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:49:28.622001 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-37695d18-a148-4273-9dd0-7b10fad766e9 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] [instance: a79303e6-05ad-4901-96b7-ce845b4016f4] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:49:28.628124 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-37695d18-a148-4273-9dd0-7b10fad766e9 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:49:28.628573 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-37695d18-a148-4273-9dd0-7b10fad766e9 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:49:28.629332 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-37695d18-a148-4273-9dd0-7b10fad766e9 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:49:28.629762 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-37695d18-a148-4273-9dd0-7b10fad766e9 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:49:28.658352 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-815c716c-cddc-4f36-871f-60b801350c0f tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:49:28.659928 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-815c716c-cddc-4f36-871f-60b801350c0f tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: 62c89161-c119-48b2-839d-712db798ff96] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:49:28.666271 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-815c716c-cddc-4f36-871f-60b801350c0f tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:49:28.666689 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-815c716c-cddc-4f36-871f-60b801350c0f tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:49:28.667470 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-815c716c-cddc-4f36-871f-60b801350c0f tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:49:28.667995 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-815c716c-cddc-4f36-871f-60b801350c0f tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:49:28.689599 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-37695d18-a148-4273-9dd0-7b10fad766e9 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c757a383a434a4c9b1b928087af8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8818377e744d4f6ba65560705c191f0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:49:28.696982 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-37695d18-a148-4273-9dd0-7b10fad766e9 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] 10.222.0.64 "GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4" status: 200 len: 1226 microversion: 2.1 time: 0.079210 Oct 27 15:49:28.698194 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 557/1042] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:49:28 2021] GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4 => generated 1226 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 15:49:28.700172 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-815c716c-cddc-4f36-871f-60b801350c0f tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045489 Oct 27 15:49:28.700730 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 486/1043] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Oct 27 15:49:28 2021] GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 15:49:28.955059 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-20652657-4265-47f8-910c-6863144003dd tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:49:28.955774 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-20652657-4265-47f8-910c-6863144003dd tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:49:28.961749 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-20652657-4265-47f8-910c-6863144003dd tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:49:28.962200 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-20652657-4265-47f8-910c-6863144003dd tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:49:28.963002 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-20652657-4265-47f8-910c-6863144003dd tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:49:28.963447 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-20652657-4265-47f8-910c-6863144003dd tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:49:29.086516 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-20652657-4265-47f8-910c-6863144003dd tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:49:29.095272 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-20652657-4265-47f8-910c-6863144003dd tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:49:29.096947 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-20652657-4265-47f8-910c-6863144003dd tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:49:29.098089 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-20652657-4265-47f8-910c-6863144003dd tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672" status: 200 len: 1748 microversion: 2.20 time: 0.146958 Oct 27 15:49:29.098626 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 558/1044] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Oct 27 15:49:28 2021] GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672 => generated 1748 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 15:49:29.712294 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-8c4078d3-421e-405e-a97b-a0814737b6a2 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:49:29.713187 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-8c4078d3-421e-405e-a97b-a0814737b6a2 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: 62c89161-c119-48b2-839d-712db798ff96] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:49:29.713774 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-9af2ca78-3534-4553-803a-dbc381611154 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:49:29.714381 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-9af2ca78-3534-4553-803a-dbc381611154 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] [instance: a79303e6-05ad-4901-96b7-ce845b4016f4] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:49:29.719306 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-8c4078d3-421e-405e-a97b-a0814737b6a2 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:49:29.720023 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-8c4078d3-421e-405e-a97b-a0814737b6a2 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:49:29.720677 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-9af2ca78-3534-4553-803a-dbc381611154 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:49:29.720833 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-8c4078d3-421e-405e-a97b-a0814737b6a2 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:49:29.721126 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-9af2ca78-3534-4553-803a-dbc381611154 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:49:29.721870 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-8c4078d3-421e-405e-a97b-a0814737b6a2 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:49:29.722885 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-9af2ca78-3534-4553-803a-dbc381611154 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:49:29.723352 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-9af2ca78-3534-4553-803a-dbc381611154 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:49:29.750254 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-8c4078d3-421e-405e-a97b-a0814737b6a2 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041703 Oct 27 15:49:29.750815 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 487/1045] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Oct 27 15:49:29 2021] GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 15:49:29.790837 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-9af2ca78-3534-4553-803a-dbc381611154 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c757a383a434a4c9b1b928087af8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8818377e744d4f6ba65560705c191f0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:49:29.798027 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-9af2ca78-3534-4553-803a-dbc381611154 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] 10.222.0.64 "GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4" status: 200 len: 1226 microversion: 2.1 time: 0.087871 Oct 27 15:49:29.798572 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 559/1046] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:49:29 2021] GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4 => generated 1226 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 15:49:30.116321 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-c4d9eeb4-f0a9-45f6-87a7-a08ac94b70b0 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:49:30.116842 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-c4d9eeb4-f0a9-45f6-87a7-a08ac94b70b0 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:49:30.122917 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-c4d9eeb4-f0a9-45f6-87a7-a08ac94b70b0 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:49:30.123353 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-c4d9eeb4-f0a9-45f6-87a7-a08ac94b70b0 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:49:30.124124 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-c4d9eeb4-f0a9-45f6-87a7-a08ac94b70b0 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:49:30.124550 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-c4d9eeb4-f0a9-45f6-87a7-a08ac94b70b0 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:49:30.254787 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-c4d9eeb4-f0a9-45f6-87a7-a08ac94b70b0 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:49:30.263418 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-c4d9eeb4-f0a9-45f6-87a7-a08ac94b70b0 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:49:30.265185 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-c4d9eeb4-f0a9-45f6-87a7-a08ac94b70b0 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:49:30.266434 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-c4d9eeb4-f0a9-45f6-87a7-a08ac94b70b0 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672" status: 200 len: 1748 microversion: 2.20 time: 0.153863 Oct 27 15:49:30.267005 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 488/1047] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Oct 27 15:49:30 2021] GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672 => generated 1748 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 15:49:30.761894 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-9dd5e0b0-8384-4eff-984f-c12178d5ed4e tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:49:30.762796 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-9dd5e0b0-8384-4eff-984f-c12178d5ed4e tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: 62c89161-c119-48b2-839d-712db798ff96] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:49:30.769317 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-9dd5e0b0-8384-4eff-984f-c12178d5ed4e tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:49:30.769762 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-9dd5e0b0-8384-4eff-984f-c12178d5ed4e tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:49:30.770525 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-9dd5e0b0-8384-4eff-984f-c12178d5ed4e tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:49:30.770955 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-9dd5e0b0-8384-4eff-984f-c12178d5ed4e tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:49:30.799037 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-9dd5e0b0-8384-4eff-984f-c12178d5ed4e tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040947 Oct 27 15:49:30.800198 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 560/1048] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Oct 27 15:49:30 2021] GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 15:49:30.814582 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-56a28a33-cc61-4d8e-8cd2-a42b80747ed5 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:49:30.815612 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-56a28a33-cc61-4d8e-8cd2-a42b80747ed5 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] [instance: a79303e6-05ad-4901-96b7-ce845b4016f4] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:49:30.821316 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-56a28a33-cc61-4d8e-8cd2-a42b80747ed5 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:49:30.821751 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-56a28a33-cc61-4d8e-8cd2-a42b80747ed5 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:49:30.822538 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-56a28a33-cc61-4d8e-8cd2-a42b80747ed5 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:49:30.822965 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-56a28a33-cc61-4d8e-8cd2-a42b80747ed5 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:49:30.883884 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-56a28a33-cc61-4d8e-8cd2-a42b80747ed5 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c757a383a434a4c9b1b928087af8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8818377e744d4f6ba65560705c191f0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:49:30.891180 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-56a28a33-cc61-4d8e-8cd2-a42b80747ed5 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] 10.222.0.64 "GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4" status: 200 len: 1226 microversion: 2.1 time: 0.080216 Oct 27 15:49:30.891736 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 489/1049] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:49:30 2021] GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4 => generated 1226 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 15:49:31.285270 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-51401d60-ca1b-4fc7-8e7c-0c41f3cd4f15 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:49:31.285881 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-51401d60-ca1b-4fc7-8e7c-0c41f3cd4f15 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:49:31.291893 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-51401d60-ca1b-4fc7-8e7c-0c41f3cd4f15 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:49:31.292354 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-51401d60-ca1b-4fc7-8e7c-0c41f3cd4f15 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:49:31.293120 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-51401d60-ca1b-4fc7-8e7c-0c41f3cd4f15 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:49:31.293557 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-51401d60-ca1b-4fc7-8e7c-0c41f3cd4f15 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:49:31.411503 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-51401d60-ca1b-4fc7-8e7c-0c41f3cd4f15 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:49:31.419684 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-51401d60-ca1b-4fc7-8e7c-0c41f3cd4f15 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:49:31.421193 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-51401d60-ca1b-4fc7-8e7c-0c41f3cd4f15 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:49:31.422332 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-51401d60-ca1b-4fc7-8e7c-0c41f3cd4f15 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672" status: 200 len: 1748 microversion: 2.20 time: 0.141478 Oct 27 15:49:31.422874 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 561/1050] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Oct 27 15:49:31 2021] GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672 => generated 1748 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 15:49:31.810685 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-9b1f9a39-3284-4735-af1b-5093e5b11942 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:49:31.811983 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-9b1f9a39-3284-4735-af1b-5093e5b11942 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: 62c89161-c119-48b2-839d-712db798ff96] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:49:31.819116 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-9b1f9a39-3284-4735-af1b-5093e5b11942 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:49:31.819696 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-9b1f9a39-3284-4735-af1b-5093e5b11942 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:49:31.820351 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-9b1f9a39-3284-4735-af1b-5093e5b11942 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:49:31.820783 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-9b1f9a39-3284-4735-af1b-5093e5b11942 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:49:31.849306 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-9b1f9a39-3284-4735-af1b-5093e5b11942 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042413 Oct 27 15:49:31.849854 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 490/1051] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Oct 27 15:49:31 2021] GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 15:49:31.908583 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-b109318d-ba6c-4887-9fbe-0ee77cf532f5 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:49:31.909626 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-b109318d-ba6c-4887-9fbe-0ee77cf532f5 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] [instance: a79303e6-05ad-4901-96b7-ce845b4016f4] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:49:31.916102 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-b109318d-ba6c-4887-9fbe-0ee77cf532f5 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:49:31.916574 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-b109318d-ba6c-4887-9fbe-0ee77cf532f5 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:49:31.917343 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-b109318d-ba6c-4887-9fbe-0ee77cf532f5 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:49:31.917771 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-b109318d-ba6c-4887-9fbe-0ee77cf532f5 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:49:31.980728 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-b109318d-ba6c-4887-9fbe-0ee77cf532f5 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c757a383a434a4c9b1b928087af8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8818377e744d4f6ba65560705c191f0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:49:31.988629 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-b109318d-ba6c-4887-9fbe-0ee77cf532f5 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] 10.222.0.64 "GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4" status: 200 len: 1226 microversion: 2.1 time: 0.083800 Oct 27 15:49:31.989188 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 562/1052] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:49:31 2021] GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4 => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 15:49:32.439713 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-514ccd56-a73d-4278-841b-be399f9ceeb0 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:49:32.441183 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-514ccd56-a73d-4278-841b-be399f9ceeb0 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:49:32.447657 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-514ccd56-a73d-4278-841b-be399f9ceeb0 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:49:32.448166 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-514ccd56-a73d-4278-841b-be399f9ceeb0 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:49:32.449018 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-514ccd56-a73d-4278-841b-be399f9ceeb0 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:49:32.449473 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-514ccd56-a73d-4278-841b-be399f9ceeb0 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:49:32.572063 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-514ccd56-a73d-4278-841b-be399f9ceeb0 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:49:32.580229 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-514ccd56-a73d-4278-841b-be399f9ceeb0 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:49:32.582624 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-514ccd56-a73d-4278-841b-be399f9ceeb0 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:49:32.583823 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-514ccd56-a73d-4278-841b-be399f9ceeb0 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672" status: 200 len: 1748 microversion: 2.20 time: 0.147895 Oct 27 15:49:32.584408 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 491/1053] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Oct 27 15:49:32 2021] GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672 => generated 1748 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 15:49:32.860526 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-db2ca6e5-e90f-4e25-a527-4b274f71b0b3 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:49:32.861347 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-db2ca6e5-e90f-4e25-a527-4b274f71b0b3 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: 62c89161-c119-48b2-839d-712db798ff96] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:49:32.867333 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-db2ca6e5-e90f-4e25-a527-4b274f71b0b3 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:49:32.867779 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-db2ca6e5-e90f-4e25-a527-4b274f71b0b3 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:49:32.868691 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-db2ca6e5-e90f-4e25-a527-4b274f71b0b3 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:49:32.869128 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-db2ca6e5-e90f-4e25-a527-4b274f71b0b3 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:49:32.897712 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-db2ca6e5-e90f-4e25-a527-4b274f71b0b3 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041001 Oct 27 15:49:32.898265 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 563/1054] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Oct 27 15:49:32 2021] GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 15:49:33.005557 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-1d0e4de9-66f3-4f39-a318-0086754f1cbf tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:49:33.006197 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-1d0e4de9-66f3-4f39-a318-0086754f1cbf tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] [instance: a79303e6-05ad-4901-96b7-ce845b4016f4] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:49:33.012402 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-1d0e4de9-66f3-4f39-a318-0086754f1cbf tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:49:33.012843 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-1d0e4de9-66f3-4f39-a318-0086754f1cbf tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:49:33.013605 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-1d0e4de9-66f3-4f39-a318-0086754f1cbf tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:49:33.014030 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-1d0e4de9-66f3-4f39-a318-0086754f1cbf tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:49:33.072922 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-1d0e4de9-66f3-4f39-a318-0086754f1cbf tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c757a383a434a4c9b1b928087af8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8818377e744d4f6ba65560705c191f0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:49:33.080042 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-1d0e4de9-66f3-4f39-a318-0086754f1cbf tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] 10.222.0.64 "GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4" status: 200 len: 1226 microversion: 2.1 time: 0.078648 Oct 27 15:49:33.080600 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 492/1055] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:49:33 2021] GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4 => generated 1226 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 15:49:33.602251 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-23ba4fb6-50cc-4351-b1d9-0d4313847474 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:49:33.602865 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-23ba4fb6-50cc-4351-b1d9-0d4313847474 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:49:33.609042 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-23ba4fb6-50cc-4351-b1d9-0d4313847474 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:49:33.609483 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-23ba4fb6-50cc-4351-b1d9-0d4313847474 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:49:33.610247 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-23ba4fb6-50cc-4351-b1d9-0d4313847474 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:49:33.610679 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-23ba4fb6-50cc-4351-b1d9-0d4313847474 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:49:33.731389 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-23ba4fb6-50cc-4351-b1d9-0d4313847474 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:49:33.740198 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-23ba4fb6-50cc-4351-b1d9-0d4313847474 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:49:33.741683 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-23ba4fb6-50cc-4351-b1d9-0d4313847474 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:49:33.742850 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-23ba4fb6-50cc-4351-b1d9-0d4313847474 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672" status: 200 len: 1748 microversion: 2.20 time: 0.144288 Oct 27 15:49:33.743394 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 564/1056] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Oct 27 15:49:33 2021] GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672 => generated 1748 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 15:49:33.908357 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-3f7c76f5-4e7e-4041-b640-271403aced7e tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:49:33.909183 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-3f7c76f5-4e7e-4041-b640-271403aced7e tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: 62c89161-c119-48b2-839d-712db798ff96] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:49:33.916037 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-3f7c76f5-4e7e-4041-b640-271403aced7e tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:49:33.916545 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-3f7c76f5-4e7e-4041-b640-271403aced7e tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:49:33.917384 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-3f7c76f5-4e7e-4041-b640-271403aced7e tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:49:33.918011 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-3f7c76f5-4e7e-4041-b640-271403aced7e tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:49:33.947043 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-3f7c76f5-4e7e-4041-b640-271403aced7e tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042562 Oct 27 15:49:33.947603 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 493/1057] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Oct 27 15:49:33 2021] GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 15:49:34.098219 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-37e50e93-6550-42d3-8186-9b1803ea408f tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:49:34.098834 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-37e50e93-6550-42d3-8186-9b1803ea408f tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] [instance: a79303e6-05ad-4901-96b7-ce845b4016f4] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:49:34.104661 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-37e50e93-6550-42d3-8186-9b1803ea408f tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:49:34.105103 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-37e50e93-6550-42d3-8186-9b1803ea408f tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:49:34.105862 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-37e50e93-6550-42d3-8186-9b1803ea408f tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:49:34.106288 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-37e50e93-6550-42d3-8186-9b1803ea408f tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:49:34.164485 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-37e50e93-6550-42d3-8186-9b1803ea408f tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c757a383a434a4c9b1b928087af8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8818377e744d4f6ba65560705c191f0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:49:34.171622 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-37e50e93-6550-42d3-8186-9b1803ea408f tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] 10.222.0.64 "GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4" status: 200 len: 1226 microversion: 2.1 time: 0.078046 Oct 27 15:49:34.172201 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 565/1058] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:49:34 2021] GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4 => generated 1226 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 15:49:34.761670 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-15cb3680-cbe0-4b0e-9963-3cb5b2ee53ed tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:49:34.762270 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-15cb3680-cbe0-4b0e-9963-3cb5b2ee53ed tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:49:34.768503 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-15cb3680-cbe0-4b0e-9963-3cb5b2ee53ed tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:49:34.769708 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-15cb3680-cbe0-4b0e-9963-3cb5b2ee53ed tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:49:34.770475 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-15cb3680-cbe0-4b0e-9963-3cb5b2ee53ed tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:49:34.770899 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-15cb3680-cbe0-4b0e-9963-3cb5b2ee53ed tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:49:34.893028 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-15cb3680-cbe0-4b0e-9963-3cb5b2ee53ed tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:49:34.901805 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-15cb3680-cbe0-4b0e-9963-3cb5b2ee53ed tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:49:34.903285 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-15cb3680-cbe0-4b0e-9963-3cb5b2ee53ed tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:49:34.904450 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-15cb3680-cbe0-4b0e-9963-3cb5b2ee53ed tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672" status: 200 len: 1748 microversion: 2.20 time: 0.146592 Oct 27 15:49:34.904996 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 494/1059] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Oct 27 15:49:34 2021] GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672 => generated 1748 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 15:49:34.958144 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-68b449bb-63cc-42e3-bbc0-bf2f9894861e tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:49:34.959042 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-68b449bb-63cc-42e3-bbc0-bf2f9894861e tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: 62c89161-c119-48b2-839d-712db798ff96] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:49:34.965172 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-68b449bb-63cc-42e3-bbc0-bf2f9894861e tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:49:34.965607 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-68b449bb-63cc-42e3-bbc0-bf2f9894861e tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:49:34.966361 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-68b449bb-63cc-42e3-bbc0-bf2f9894861e tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:49:34.966785 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-68b449bb-63cc-42e3-bbc0-bf2f9894861e tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:49:34.998515 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-68b449bb-63cc-42e3-bbc0-bf2f9894861e tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044106 Oct 27 15:49:34.999192 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 566/1060] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Oct 27 15:49:34 2021] GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 15:49:35.188415 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-8561d21d-482f-4e6b-a5dd-3a779a6df27a tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:49:35.189017 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-8561d21d-482f-4e6b-a5dd-3a779a6df27a tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] [instance: a79303e6-05ad-4901-96b7-ce845b4016f4] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:49:35.194972 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-8561d21d-482f-4e6b-a5dd-3a779a6df27a tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:49:35.195407 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-8561d21d-482f-4e6b-a5dd-3a779a6df27a tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:49:35.196196 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-8561d21d-482f-4e6b-a5dd-3a779a6df27a tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:49:35.196623 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-8561d21d-482f-4e6b-a5dd-3a779a6df27a tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:49:35.260951 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-8561d21d-482f-4e6b-a5dd-3a779a6df27a tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c757a383a434a4c9b1b928087af8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8818377e744d4f6ba65560705c191f0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:49:35.268283 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-8561d21d-482f-4e6b-a5dd-3a779a6df27a tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] 10.222.0.64 "GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4" status: 200 len: 1226 microversion: 2.1 time: 0.083583 Oct 27 15:49:35.268877 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 495/1061] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:49:35 2021] GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4 => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 15:49:35.923199 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-3649274a-3bd2-4157-9e69-65ae447cac19 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:49:35.923804 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-3649274a-3bd2-4157-9e69-65ae447cac19 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:49:35.930236 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-3649274a-3bd2-4157-9e69-65ae447cac19 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:49:35.930681 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-3649274a-3bd2-4157-9e69-65ae447cac19 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:49:35.931442 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-3649274a-3bd2-4157-9e69-65ae447cac19 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:49:35.931921 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-3649274a-3bd2-4157-9e69-65ae447cac19 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:49:36.011169 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-7e5e32c1-54b5-45f8-8253-d1fd7ba9438a tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:49:36.012107 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-7e5e32c1-54b5-45f8-8253-d1fd7ba9438a tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: 62c89161-c119-48b2-839d-712db798ff96] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:49:36.018254 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-7e5e32c1-54b5-45f8-8253-d1fd7ba9438a tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:49:36.018722 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-7e5e32c1-54b5-45f8-8253-d1fd7ba9438a tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:49:36.019531 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-7e5e32c1-54b5-45f8-8253-d1fd7ba9438a tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:49:36.019989 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-7e5e32c1-54b5-45f8-8253-d1fd7ba9438a tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:49:36.048588 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-7e5e32c1-54b5-45f8-8253-d1fd7ba9438a tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042144 Oct 27 15:49:36.049155 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 496/1062] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Oct 27 15:49:36 2021] GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 15:49:36.052445 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-3649274a-3bd2-4157-9e69-65ae447cac19 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:49:36.060595 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-3649274a-3bd2-4157-9e69-65ae447cac19 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:49:36.062078 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-3649274a-3bd2-4157-9e69-65ae447cac19 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:49:36.063211 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-3649274a-3bd2-4157-9e69-65ae447cac19 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672" status: 200 len: 1748 microversion: 2.20 time: 0.143765 Oct 27 15:49:36.063834 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 567/1063] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Oct 27 15:49:35 2021] GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672 => generated 1748 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 15:49:36.286338 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-452a0c6a-745d-4f9c-9cb0-aad92ccbe59d tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:49:36.287012 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-452a0c6a-745d-4f9c-9cb0-aad92ccbe59d tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] [instance: a79303e6-05ad-4901-96b7-ce845b4016f4] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:49:36.292772 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-452a0c6a-745d-4f9c-9cb0-aad92ccbe59d tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:49:36.293209 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-452a0c6a-745d-4f9c-9cb0-aad92ccbe59d tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:49:36.293958 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-452a0c6a-745d-4f9c-9cb0-aad92ccbe59d tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:49:36.294385 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-452a0c6a-745d-4f9c-9cb0-aad92ccbe59d tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:49:36.354006 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-452a0c6a-745d-4f9c-9cb0-aad92ccbe59d tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c757a383a434a4c9b1b928087af8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8818377e744d4f6ba65560705c191f0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:49:36.361451 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-452a0c6a-745d-4f9c-9cb0-aad92ccbe59d tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] 10.222.0.64 "GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4" status: 200 len: 1226 microversion: 2.1 time: 0.080414 Oct 27 15:49:36.362047 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 497/1064] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:49:36 2021] GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4 => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 15:49:37.060840 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-b5a4bab0-e413-4c06-9075-62b71a763331 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:49:37.061815 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-b5a4bab0-e413-4c06-9075-62b71a763331 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: 62c89161-c119-48b2-839d-712db798ff96] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:49:37.069589 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-b5a4bab0-e413-4c06-9075-62b71a763331 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:49:37.070048 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-b5a4bab0-e413-4c06-9075-62b71a763331 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:49:37.070869 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-b5a4bab0-e413-4c06-9075-62b71a763331 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:49:37.071321 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-b5a4bab0-e413-4c06-9075-62b71a763331 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:49:37.080923 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-abf3d8fc-e136-4ff3-8002-0d1f2e33c1e9 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:49:37.081587 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-abf3d8fc-e136-4ff3-8002-0d1f2e33c1e9 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:49:37.088046 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-abf3d8fc-e136-4ff3-8002-0d1f2e33c1e9 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:49:37.088496 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-abf3d8fc-e136-4ff3-8002-0d1f2e33c1e9 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:49:37.089317 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-abf3d8fc-e136-4ff3-8002-0d1f2e33c1e9 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:49:37.089752 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-abf3d8fc-e136-4ff3-8002-0d1f2e33c1e9 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:49:37.101863 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-b5a4bab0-e413-4c06-9075-62b71a763331 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045007 Oct 27 15:49:37.102417 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 568/1065] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Oct 27 15:49:37 2021] GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 15:49:37.212804 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-abf3d8fc-e136-4ff3-8002-0d1f2e33c1e9 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:49:37.222088 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-abf3d8fc-e136-4ff3-8002-0d1f2e33c1e9 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:49:37.223739 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-abf3d8fc-e136-4ff3-8002-0d1f2e33c1e9 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:49:37.224952 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-abf3d8fc-e136-4ff3-8002-0d1f2e33c1e9 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672" status: 200 len: 1748 microversion: 2.20 time: 0.147741 Oct 27 15:49:37.225507 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 498/1066] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Oct 27 15:49:37 2021] GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672 => generated 1748 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 15:49:37.379330 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-c40ec5a4-3ddb-4fd0-b42d-e939501be2a2 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:49:37.380035 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-c40ec5a4-3ddb-4fd0-b42d-e939501be2a2 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] [instance: a79303e6-05ad-4901-96b7-ce845b4016f4] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:49:37.385791 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-c40ec5a4-3ddb-4fd0-b42d-e939501be2a2 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:49:37.386233 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-c40ec5a4-3ddb-4fd0-b42d-e939501be2a2 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:49:37.386991 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-c40ec5a4-3ddb-4fd0-b42d-e939501be2a2 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:49:37.387423 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-c40ec5a4-3ddb-4fd0-b42d-e939501be2a2 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:49:37.449820 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-c40ec5a4-3ddb-4fd0-b42d-e939501be2a2 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c757a383a434a4c9b1b928087af8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8818377e744d4f6ba65560705c191f0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:49:37.457159 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-c40ec5a4-3ddb-4fd0-b42d-e939501be2a2 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] 10.222.0.64 "GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4" status: 200 len: 1226 microversion: 2.1 time: 0.082006 Oct 27 15:49:37.457709 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 569/1067] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:49:37 2021] GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4 => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 15:49:38.114025 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-d7e3bf46-c24b-4443-8226-d5711fe0b670 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:49:38.114922 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-d7e3bf46-c24b-4443-8226-d5711fe0b670 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: 62c89161-c119-48b2-839d-712db798ff96] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:49:38.121061 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-d7e3bf46-c24b-4443-8226-d5711fe0b670 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:49:38.121500 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-d7e3bf46-c24b-4443-8226-d5711fe0b670 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:49:38.122255 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-d7e3bf46-c24b-4443-8226-d5711fe0b670 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:49:38.122684 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-d7e3bf46-c24b-4443-8226-d5711fe0b670 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:49:38.150726 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-d7e3bf46-c24b-4443-8226-d5711fe0b670 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041082 Oct 27 15:49:38.151269 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 499/1068] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Oct 27 15:49:38 2021] GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 15:49:38.243637 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-eb264a0a-d05a-4d46-8259-46927f2f854d tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:49:38.244270 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-eb264a0a-d05a-4d46-8259-46927f2f854d tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:49:38.250431 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-eb264a0a-d05a-4d46-8259-46927f2f854d tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:49:38.250872 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-eb264a0a-d05a-4d46-8259-46927f2f854d tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:49:38.251700 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-eb264a0a-d05a-4d46-8259-46927f2f854d tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:49:38.252167 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-eb264a0a-d05a-4d46-8259-46927f2f854d tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:49:38.374046 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-eb264a0a-d05a-4d46-8259-46927f2f854d tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:49:38.382260 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-eb264a0a-d05a-4d46-8259-46927f2f854d tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:49:38.383752 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-eb264a0a-d05a-4d46-8259-46927f2f854d tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:49:38.384943 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-eb264a0a-d05a-4d46-8259-46927f2f854d tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672" status: 200 len: 1748 microversion: 2.20 time: 0.145048 Oct 27 15:49:38.385496 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 570/1069] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Oct 27 15:49:38 2021] GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672 => generated 1748 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 15:49:38.474618 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-ed081d71-2819-48fd-ac6b-3a4b60ec439d tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:49:38.475265 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-ed081d71-2819-48fd-ac6b-3a4b60ec439d tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] [instance: a79303e6-05ad-4901-96b7-ce845b4016f4] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:49:38.481359 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-ed081d71-2819-48fd-ac6b-3a4b60ec439d tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:49:38.481838 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-ed081d71-2819-48fd-ac6b-3a4b60ec439d tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:49:38.482638 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-ed081d71-2819-48fd-ac6b-3a4b60ec439d tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:49:38.483090 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-ed081d71-2819-48fd-ac6b-3a4b60ec439d tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:49:38.543232 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-ed081d71-2819-48fd-ac6b-3a4b60ec439d tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c757a383a434a4c9b1b928087af8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8818377e744d4f6ba65560705c191f0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:49:38.550519 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-ed081d71-2819-48fd-ac6b-3a4b60ec439d tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] 10.222.0.64 "GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4" status: 200 len: 1226 microversion: 2.1 time: 0.080426 Oct 27 15:49:38.551077 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 500/1070] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:49:38 2021] GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4 => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 15:49:39.162979 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-86740c04-d0b2-4cb3-99d3-531c39679fbb tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:49:39.163915 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-86740c04-d0b2-4cb3-99d3-531c39679fbb tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: 62c89161-c119-48b2-839d-712db798ff96] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:49:39.169758 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-86740c04-d0b2-4cb3-99d3-531c39679fbb tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:49:39.170144 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-86740c04-d0b2-4cb3-99d3-531c39679fbb tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:49:39.170939 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-86740c04-d0b2-4cb3-99d3-531c39679fbb tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:49:39.171371 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-86740c04-d0b2-4cb3-99d3-531c39679fbb tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:49:39.199918 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-86740c04-d0b2-4cb3-99d3-531c39679fbb tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041270 Oct 27 15:49:39.200458 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 571/1071] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Oct 27 15:49:39 2021] GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 15:49:39.403102 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-04985453-d2cb-46a6-a050-e3f3751aed16 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:49:39.403791 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-04985453-d2cb-46a6-a050-e3f3751aed16 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:49:39.411273 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-04985453-d2cb-46a6-a050-e3f3751aed16 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:49:39.411766 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-04985453-d2cb-46a6-a050-e3f3751aed16 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:49:39.412659 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-04985453-d2cb-46a6-a050-e3f3751aed16 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:49:39.413124 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-04985453-d2cb-46a6-a050-e3f3751aed16 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:49:39.539549 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-04985453-d2cb-46a6-a050-e3f3751aed16 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:49:39.547741 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-04985453-d2cb-46a6-a050-e3f3751aed16 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:49:39.549263 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-04985453-d2cb-46a6-a050-e3f3751aed16 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:49:39.550405 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-04985453-d2cb-46a6-a050-e3f3751aed16 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672" status: 200 len: 1748 microversion: 2.20 time: 0.151434 Oct 27 15:49:39.550962 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 501/1072] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Oct 27 15:49:39 2021] GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672 => generated 1748 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 15:49:39.567704 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-434944a4-fada-4e90-8981-fc37f0b88128 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:49:39.568399 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-434944a4-fada-4e90-8981-fc37f0b88128 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] [instance: a79303e6-05ad-4901-96b7-ce845b4016f4] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:49:39.574596 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-434944a4-fada-4e90-8981-fc37f0b88128 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:49:39.575068 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-434944a4-fada-4e90-8981-fc37f0b88128 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:49:39.575831 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-434944a4-fada-4e90-8981-fc37f0b88128 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:49:39.576285 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-434944a4-fada-4e90-8981-fc37f0b88128 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:49:39.637997 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-434944a4-fada-4e90-8981-fc37f0b88128 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c757a383a434a4c9b1b928087af8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8818377e744d4f6ba65560705c191f0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:49:39.646778 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-434944a4-fada-4e90-8981-fc37f0b88128 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] 10.222.0.64 "GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4" status: 200 len: 1226 microversion: 2.1 time: 0.083343 Oct 27 15:49:39.647331 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 572/1073] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:49:39 2021] GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4 => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 15:49:40.211422 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-543b1c2e-aece-42cb-8957-b590d51128fb tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:49:40.212348 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-543b1c2e-aece-42cb-8957-b590d51128fb tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: 62c89161-c119-48b2-839d-712db798ff96] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:49:40.218130 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-543b1c2e-aece-42cb-8957-b590d51128fb tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:49:40.218572 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-543b1c2e-aece-42cb-8957-b590d51128fb tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:49:40.219571 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-543b1c2e-aece-42cb-8957-b590d51128fb tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:49:40.220033 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-543b1c2e-aece-42cb-8957-b590d51128fb tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:49:40.249559 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-543b1c2e-aece-42cb-8957-b590d51128fb tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041897 Oct 27 15:49:40.250106 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 502/1074] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Oct 27 15:49:40 2021] GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 15:49:40.568298 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-73f82b28-6f4e-4e4f-9076-82f61b4f7510 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:49:40.568876 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-73f82b28-6f4e-4e4f-9076-82f61b4f7510 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:49:40.574752 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-73f82b28-6f4e-4e4f-9076-82f61b4f7510 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:49:40.575196 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-73f82b28-6f4e-4e4f-9076-82f61b4f7510 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:49:40.576021 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-73f82b28-6f4e-4e4f-9076-82f61b4f7510 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:49:40.576454 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-73f82b28-6f4e-4e4f-9076-82f61b4f7510 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:49:40.663452 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-eaf76a82-3bd6-42fc-9226-e1e8cc23f62e tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:49:40.664084 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-eaf76a82-3bd6-42fc-9226-e1e8cc23f62e tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] [instance: a79303e6-05ad-4901-96b7-ce845b4016f4] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:49:40.669883 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-eaf76a82-3bd6-42fc-9226-e1e8cc23f62e tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:49:40.670329 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-eaf76a82-3bd6-42fc-9226-e1e8cc23f62e tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:49:40.671092 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-eaf76a82-3bd6-42fc-9226-e1e8cc23f62e tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:49:40.671525 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-eaf76a82-3bd6-42fc-9226-e1e8cc23f62e tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:49:40.707484 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-73f82b28-6f4e-4e4f-9076-82f61b4f7510 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:49:40.716175 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-73f82b28-6f4e-4e4f-9076-82f61b4f7510 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:49:40.717675 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-73f82b28-6f4e-4e4f-9076-82f61b4f7510 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:49:40.718850 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-73f82b28-6f4e-4e4f-9076-82f61b4f7510 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672" status: 200 len: 1748 microversion: 2.20 time: 0.155059 Oct 27 15:49:40.719880 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 573/1075] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Oct 27 15:49:40 2021] GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672 => generated 1748 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 15:49:40.737111 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-eaf76a82-3bd6-42fc-9226-e1e8cc23f62e tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c757a383a434a4c9b1b928087af8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8818377e744d4f6ba65560705c191f0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:49:40.744495 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-eaf76a82-3bd6-42fc-9226-e1e8cc23f62e tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] 10.222.0.64 "GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4" status: 200 len: 1226 microversion: 2.1 time: 0.085197 Oct 27 15:49:40.745053 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 503/1076] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:49:40 2021] GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4 => generated 1226 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 15:49:41.261815 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-37695b0c-1a30-4151-93a0-e0449e52d89e tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:49:41.262722 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-37695b0c-1a30-4151-93a0-e0449e52d89e tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: 62c89161-c119-48b2-839d-712db798ff96] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:49:41.268595 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-37695b0c-1a30-4151-93a0-e0449e52d89e tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:49:41.269206 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-37695b0c-1a30-4151-93a0-e0449e52d89e tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:49:41.270084 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-37695b0c-1a30-4151-93a0-e0449e52d89e tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:49:41.270521 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-37695b0c-1a30-4151-93a0-e0449e52d89e tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:49:41.303761 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-37695b0c-1a30-4151-93a0-e0449e52d89e tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045723 Oct 27 15:49:41.304382 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 574/1077] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Oct 27 15:49:41 2021] GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 15:49:41.737047 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-e3889173-e5da-44e8-a350-a357e7b63ea7 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:49:41.737645 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-e3889173-e5da-44e8-a350-a357e7b63ea7 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:49:41.744006 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-e3889173-e5da-44e8-a350-a357e7b63ea7 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:49:41.744445 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-e3889173-e5da-44e8-a350-a357e7b63ea7 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:49:41.745194 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-e3889173-e5da-44e8-a350-a357e7b63ea7 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:49:41.745619 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-e3889173-e5da-44e8-a350-a357e7b63ea7 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:49:41.760540 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-a0a5c2bc-de04-4b74-8e0f-cc83431920b0 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:49:41.761142 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-a0a5c2bc-de04-4b74-8e0f-cc83431920b0 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] [instance: a79303e6-05ad-4901-96b7-ce845b4016f4] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:49:41.767255 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-a0a5c2bc-de04-4b74-8e0f-cc83431920b0 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:49:41.767700 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-a0a5c2bc-de04-4b74-8e0f-cc83431920b0 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:49:41.768500 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-a0a5c2bc-de04-4b74-8e0f-cc83431920b0 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:49:41.768929 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-a0a5c2bc-de04-4b74-8e0f-cc83431920b0 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:49:41.829941 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-a0a5c2bc-de04-4b74-8e0f-cc83431920b0 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c757a383a434a4c9b1b928087af8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8818377e744d4f6ba65560705c191f0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:49:41.838019 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-a0a5c2bc-de04-4b74-8e0f-cc83431920b0 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] 10.222.0.64 "GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4" status: 200 len: 1226 microversion: 2.1 time: 0.081069 Oct 27 15:49:41.838571 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 575/1078] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:49:41 2021] GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4 => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 15:49:41.876032 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-e3889173-e5da-44e8-a350-a357e7b63ea7 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:49:41.885806 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-e3889173-e5da-44e8-a350-a357e7b63ea7 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:49:41.887293 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-e3889173-e5da-44e8-a350-a357e7b63ea7 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:49:41.888511 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-e3889173-e5da-44e8-a350-a357e7b63ea7 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672" status: 200 len: 1748 microversion: 2.20 time: 0.155181 Oct 27 15:49:41.889100 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 504/1079] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Oct 27 15:49:41 2021] GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672 => generated 1748 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 15:49:42.314578 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-3f94a597-f7db-4dc3-aedb-65f6b532b92f tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:49:42.315490 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-3f94a597-f7db-4dc3-aedb-65f6b532b92f tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: 62c89161-c119-48b2-839d-712db798ff96] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:49:42.321978 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-3f94a597-f7db-4dc3-aedb-65f6b532b92f tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:49:42.322422 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-3f94a597-f7db-4dc3-aedb-65f6b532b92f tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:49:42.323198 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-3f94a597-f7db-4dc3-aedb-65f6b532b92f tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:49:42.323632 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-3f94a597-f7db-4dc3-aedb-65f6b532b92f tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:49:42.352583 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-3f94a597-f7db-4dc3-aedb-65f6b532b92f tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041848 Oct 27 15:49:42.353171 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 576/1080] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Oct 27 15:49:42 2021] GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 15:49:42.862522 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-12c88c93-e14d-46f5-9523-a201d074a05b tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:49:42.863291 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-12c88c93-e14d-46f5-9523-a201d074a05b tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] [instance: a79303e6-05ad-4901-96b7-ce845b4016f4] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:49:42.869473 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-12c88c93-e14d-46f5-9523-a201d074a05b tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:49:42.869906 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-12c88c93-e14d-46f5-9523-a201d074a05b tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:49:42.870656 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-12c88c93-e14d-46f5-9523-a201d074a05b tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:49:42.871096 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-12c88c93-e14d-46f5-9523-a201d074a05b tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:49:42.906525 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-61907284-ead7-4536-9205-ccd6d3a10fca tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:49:42.907147 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-61907284-ead7-4536-9205-ccd6d3a10fca tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:49:42.914590 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-61907284-ead7-4536-9205-ccd6d3a10fca tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:49:42.915073 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-61907284-ead7-4536-9205-ccd6d3a10fca tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:49:42.915907 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-61907284-ead7-4536-9205-ccd6d3a10fca tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:49:42.916370 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-61907284-ead7-4536-9205-ccd6d3a10fca tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:49:42.931127 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-12c88c93-e14d-46f5-9523-a201d074a05b tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c757a383a434a4c9b1b928087af8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8818377e744d4f6ba65560705c191f0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:49:42.938438 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-12c88c93-e14d-46f5-9523-a201d074a05b tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] 10.222.0.64 "GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4" status: 200 len: 1226 microversion: 2.1 time: 0.079538 Oct 27 15:49:42.939206 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 505/1081] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:49:42 2021] GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4 => generated 1226 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 15:49:43.038569 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-61907284-ead7-4536-9205-ccd6d3a10fca tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:49:43.046651 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-61907284-ead7-4536-9205-ccd6d3a10fca tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:49:43.048232 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-61907284-ead7-4536-9205-ccd6d3a10fca tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:49:43.049375 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-61907284-ead7-4536-9205-ccd6d3a10fca tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672" status: 200 len: 1748 microversion: 2.20 time: 0.146773 Oct 27 15:49:43.049914 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 577/1082] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Oct 27 15:49:42 2021] GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672 => generated 1748 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 15:49:43.365094 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-931c0535-b311-4f7f-a567-733256e66c6a tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:49:43.365999 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-931c0535-b311-4f7f-a567-733256e66c6a tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: 62c89161-c119-48b2-839d-712db798ff96] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:49:43.371717 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-931c0535-b311-4f7f-a567-733256e66c6a tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:49:43.372185 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-931c0535-b311-4f7f-a567-733256e66c6a tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:49:43.372936 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-931c0535-b311-4f7f-a567-733256e66c6a tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:49:43.373359 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-931c0535-b311-4f7f-a567-733256e66c6a tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:49:43.404149 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-931c0535-b311-4f7f-a567-733256e66c6a tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043893 Oct 27 15:49:43.404689 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 506/1083] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Oct 27 15:49:43 2021] GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 15:49:43.957112 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-ee603780-e7d9-47a7-8895-e46e2cc1595e tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:49:43.958218 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-ee603780-e7d9-47a7-8895-e46e2cc1595e tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] [instance: a79303e6-05ad-4901-96b7-ce845b4016f4] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:49:43.964498 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-ee603780-e7d9-47a7-8895-e46e2cc1595e tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:49:43.964937 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-ee603780-e7d9-47a7-8895-e46e2cc1595e tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:49:43.965698 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-ee603780-e7d9-47a7-8895-e46e2cc1595e tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:49:43.966125 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-ee603780-e7d9-47a7-8895-e46e2cc1595e tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:49:44.026005 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-ee603780-e7d9-47a7-8895-e46e2cc1595e tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c757a383a434a4c9b1b928087af8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8818377e744d4f6ba65560705c191f0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:49:44.033237 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-ee603780-e7d9-47a7-8895-e46e2cc1595e tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] 10.222.0.64 "GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4" status: 200 len: 1226 microversion: 2.1 time: 0.080995 Oct 27 15:49:44.033795 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 578/1084] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:49:43 2021] GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4 => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 15:49:44.067204 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-4d5221cb-9508-4cfa-be5d-e6ea9ff383ce tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:49:44.067804 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-4d5221cb-9508-4cfa-be5d-e6ea9ff383ce tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:49:44.074069 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-4d5221cb-9508-4cfa-be5d-e6ea9ff383ce tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:49:44.074511 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-4d5221cb-9508-4cfa-be5d-e6ea9ff383ce tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:49:44.075270 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-4d5221cb-9508-4cfa-be5d-e6ea9ff383ce tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:49:44.075699 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-4d5221cb-9508-4cfa-be5d-e6ea9ff383ce tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:49:44.199433 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-4d5221cb-9508-4cfa-be5d-e6ea9ff383ce tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:49:44.209159 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-4d5221cb-9508-4cfa-be5d-e6ea9ff383ce tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:49:44.210671 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-4d5221cb-9508-4cfa-be5d-e6ea9ff383ce tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:49:44.211823 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-4d5221cb-9508-4cfa-be5d-e6ea9ff383ce tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672" status: 200 len: 1748 microversion: 2.20 time: 0.148312 Oct 27 15:49:44.212400 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 507/1085] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Oct 27 15:49:44 2021] GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672 => generated 1748 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 15:49:44.416437 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-fac6cb80-c517-45aa-adda-a7c86c43b77d tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:49:44.417390 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-fac6cb80-c517-45aa-adda-a7c86c43b77d tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: 62c89161-c119-48b2-839d-712db798ff96] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:49:44.423399 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-fac6cb80-c517-45aa-adda-a7c86c43b77d tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:49:44.423839 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-fac6cb80-c517-45aa-adda-a7c86c43b77d tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:49:44.424628 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-fac6cb80-c517-45aa-adda-a7c86c43b77d tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:49:44.425065 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-fac6cb80-c517-45aa-adda-a7c86c43b77d tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:49:44.452661 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-fac6cb80-c517-45aa-adda-a7c86c43b77d tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040075 Oct 27 15:49:44.453130 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 579/1086] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Oct 27 15:49:44 2021] GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 15:49:45.050361 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-fad4f5d7-397d-4571-bab2-d35e93717779 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:49:45.052117 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-fad4f5d7-397d-4571-bab2-d35e93717779 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] [instance: a79303e6-05ad-4901-96b7-ce845b4016f4] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:49:45.058146 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-fad4f5d7-397d-4571-bab2-d35e93717779 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:49:45.058607 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-fad4f5d7-397d-4571-bab2-d35e93717779 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:49:45.059421 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-fad4f5d7-397d-4571-bab2-d35e93717779 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:49:45.059908 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-fad4f5d7-397d-4571-bab2-d35e93717779 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:49:45.123387 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-fad4f5d7-397d-4571-bab2-d35e93717779 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c757a383a434a4c9b1b928087af8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8818377e744d4f6ba65560705c191f0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:49:45.132461 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-fad4f5d7-397d-4571-bab2-d35e93717779 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] 10.222.0.64 "GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4" status: 200 len: 1226 microversion: 2.1 time: 0.085705 Oct 27 15:49:45.133073 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 508/1087] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:49:45 2021] GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4 => generated 1226 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 15:49:45.231300 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-3b52d3a6-2546-422e-b6d3-62a85db224cc tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:49:45.231920 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-3b52d3a6-2546-422e-b6d3-62a85db224cc tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:49:45.238743 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-3b52d3a6-2546-422e-b6d3-62a85db224cc tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:49:45.239276 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-3b52d3a6-2546-422e-b6d3-62a85db224cc tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:49:45.240059 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-3b52d3a6-2546-422e-b6d3-62a85db224cc tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:49:45.240488 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-3b52d3a6-2546-422e-b6d3-62a85db224cc tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:49:45.371731 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-3b52d3a6-2546-422e-b6d3-62a85db224cc tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:49:45.379963 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-3b52d3a6-2546-422e-b6d3-62a85db224cc tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:49:45.381472 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-3b52d3a6-2546-422e-b6d3-62a85db224cc tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:49:45.382633 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-3b52d3a6-2546-422e-b6d3-62a85db224cc tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672" status: 200 len: 1748 microversion: 2.20 time: 0.155300 Oct 27 15:49:45.383191 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 580/1088] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Oct 27 15:49:45 2021] GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672 => generated 1748 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 15:49:45.464380 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-40c61b3a-dca6-4a49-b9c5-a8a85e3d9662 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:49:45.465281 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-40c61b3a-dca6-4a49-b9c5-a8a85e3d9662 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: 62c89161-c119-48b2-839d-712db798ff96] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:49:45.471345 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-40c61b3a-dca6-4a49-b9c5-a8a85e3d9662 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:49:45.471789 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-40c61b3a-dca6-4a49-b9c5-a8a85e3d9662 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:49:45.473203 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-40c61b3a-dca6-4a49-b9c5-a8a85e3d9662 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:49:45.473708 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-40c61b3a-dca6-4a49-b9c5-a8a85e3d9662 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:49:45.501879 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-40c61b3a-dca6-4a49-b9c5-a8a85e3d9662 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042070 Oct 27 15:49:45.502358 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 509/1089] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Oct 27 15:49:45 2021] GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 15:49:46.151340 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-6842be87-da60-40cd-a08c-25a52ca56031 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:49:46.151971 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-6842be87-da60-40cd-a08c-25a52ca56031 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] [instance: a79303e6-05ad-4901-96b7-ce845b4016f4] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:49:46.157786 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-6842be87-da60-40cd-a08c-25a52ca56031 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:49:46.158231 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-6842be87-da60-40cd-a08c-25a52ca56031 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:49:46.158992 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-6842be87-da60-40cd-a08c-25a52ca56031 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:49:46.159424 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-6842be87-da60-40cd-a08c-25a52ca56031 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:49:46.219945 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-6842be87-da60-40cd-a08c-25a52ca56031 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c757a383a434a4c9b1b928087af8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8818377e744d4f6ba65560705c191f0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:49:46.227227 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-6842be87-da60-40cd-a08c-25a52ca56031 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] 10.222.0.64 "GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4" status: 200 len: 1226 microversion: 2.1 time: 0.079574 Oct 27 15:49:46.227779 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 581/1090] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:49:46 2021] GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4 => generated 1226 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 15:49:46.401247 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-32961311-66ed-405a-bbd5-f40f8822c3c1 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:49:46.401877 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-32961311-66ed-405a-bbd5-f40f8822c3c1 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:49:46.408128 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-32961311-66ed-405a-bbd5-f40f8822c3c1 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:49:46.408575 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-32961311-66ed-405a-bbd5-f40f8822c3c1 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:49:46.409332 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-32961311-66ed-405a-bbd5-f40f8822c3c1 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:49:46.409767 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-32961311-66ed-405a-bbd5-f40f8822c3c1 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:49:46.514381 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-e44c2592-fd35-4592-897f-2e312302acdb tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:49:46.515316 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-e44c2592-fd35-4592-897f-2e312302acdb tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: 62c89161-c119-48b2-839d-712db798ff96] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:49:46.521666 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-e44c2592-fd35-4592-897f-2e312302acdb tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:49:46.522121 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-e44c2592-fd35-4592-897f-2e312302acdb tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:49:46.522886 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-e44c2592-fd35-4592-897f-2e312302acdb tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:49:46.523319 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-e44c2592-fd35-4592-897f-2e312302acdb tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:49:46.528670 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-32961311-66ed-405a-bbd5-f40f8822c3c1 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:49:46.537131 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-32961311-66ed-405a-bbd5-f40f8822c3c1 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:49:46.538634 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-32961311-66ed-405a-bbd5-f40f8822c3c1 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:49:46.539789 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-32961311-66ed-405a-bbd5-f40f8822c3c1 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672" status: 200 len: 1748 microversion: 2.20 time: 0.142254 Oct 27 15:49:46.540440 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 510/1091] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Oct 27 15:49:46 2021] GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672 => generated 1748 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 15:49:46.552424 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-e44c2592-fd35-4592-897f-2e312302acdb tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041815 Oct 27 15:49:46.552973 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 582/1092] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Oct 27 15:49:46 2021] GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 15:49:47.244165 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-b73daf60-b237-4892-a49f-fe4c33317153 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:49:47.244766 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-b73daf60-b237-4892-a49f-fe4c33317153 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] [instance: a79303e6-05ad-4901-96b7-ce845b4016f4] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:49:47.250662 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-b73daf60-b237-4892-a49f-fe4c33317153 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:49:47.251270 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-b73daf60-b237-4892-a49f-fe4c33317153 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:49:47.252062 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-b73daf60-b237-4892-a49f-fe4c33317153 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:49:47.252496 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-b73daf60-b237-4892-a49f-fe4c33317153 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:49:47.313440 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-b73daf60-b237-4892-a49f-fe4c33317153 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c757a383a434a4c9b1b928087af8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8818377e744d4f6ba65560705c191f0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:49:47.320818 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-b73daf60-b237-4892-a49f-fe4c33317153 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] 10.222.0.64 "GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4" status: 200 len: 1226 microversion: 2.1 time: 0.080598 Oct 27 15:49:47.321382 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 511/1093] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:49:47 2021] GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4 => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 15:49:47.557762 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-502ba8fd-cfc1-44ec-85f8-7ca5e71a6016 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:49:47.558397 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-502ba8fd-cfc1-44ec-85f8-7ca5e71a6016 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:49:47.563371 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-8beb4023-a115-41ab-a384-71947eebfba6 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:49:47.564287 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-8beb4023-a115-41ab-a384-71947eebfba6 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: 62c89161-c119-48b2-839d-712db798ff96] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:49:47.564646 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-502ba8fd-cfc1-44ec-85f8-7ca5e71a6016 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:49:47.565097 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-502ba8fd-cfc1-44ec-85f8-7ca5e71a6016 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:49:47.565864 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-502ba8fd-cfc1-44ec-85f8-7ca5e71a6016 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:49:47.566297 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-502ba8fd-cfc1-44ec-85f8-7ca5e71a6016 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:49:47.570773 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-8beb4023-a115-41ab-a384-71947eebfba6 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:49:47.571210 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-8beb4023-a115-41ab-a384-71947eebfba6 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:49:47.571994 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-8beb4023-a115-41ab-a384-71947eebfba6 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:49:47.572421 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-8beb4023-a115-41ab-a384-71947eebfba6 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:49:47.602640 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-8beb4023-a115-41ab-a384-71947eebfba6 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042901 Oct 27 15:49:47.603398 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 512/1094] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Oct 27 15:49:47 2021] GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 15:49:47.685423 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-502ba8fd-cfc1-44ec-85f8-7ca5e71a6016 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:49:47.694361 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-502ba8fd-cfc1-44ec-85f8-7ca5e71a6016 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:49:47.695921 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-502ba8fd-cfc1-44ec-85f8-7ca5e71a6016 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:49:47.697082 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-502ba8fd-cfc1-44ec-85f8-7ca5e71a6016 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672" status: 200 len: 1748 microversion: 2.20 time: 0.143158 Oct 27 15:49:47.697629 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 583/1095] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Oct 27 15:49:47 2021] GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672 => generated 1748 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 15:49:48.337462 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-9cfe2d82-a47c-456a-9fd4-c13a0ba0853c tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:49:48.338076 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-9cfe2d82-a47c-456a-9fd4-c13a0ba0853c tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] [instance: a79303e6-05ad-4901-96b7-ce845b4016f4] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:49:48.343930 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-9cfe2d82-a47c-456a-9fd4-c13a0ba0853c tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:49:48.344606 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-9cfe2d82-a47c-456a-9fd4-c13a0ba0853c tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:49:48.345373 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-9cfe2d82-a47c-456a-9fd4-c13a0ba0853c tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:49:48.345809 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-9cfe2d82-a47c-456a-9fd4-c13a0ba0853c tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:49:48.408537 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-9cfe2d82-a47c-456a-9fd4-c13a0ba0853c tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c757a383a434a4c9b1b928087af8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8818377e744d4f6ba65560705c191f0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:49:48.416429 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-9cfe2d82-a47c-456a-9fd4-c13a0ba0853c tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] 10.222.0.64 "GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4" status: 200 len: 1226 microversion: 2.1 time: 0.082882 Oct 27 15:49:48.416990 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 513/1096] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:49:48 2021] GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4 => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 15:49:48.613926 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-cae0291e-0081-41ff-8e73-3edb6a525e5c tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:49:48.615374 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-cae0291e-0081-41ff-8e73-3edb6a525e5c tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: 62c89161-c119-48b2-839d-712db798ff96] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:49:48.621560 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-cae0291e-0081-41ff-8e73-3edb6a525e5c tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:49:48.622017 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-cae0291e-0081-41ff-8e73-3edb6a525e5c tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:49:48.622774 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-cae0291e-0081-41ff-8e73-3edb6a525e5c tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:49:48.623204 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-cae0291e-0081-41ff-8e73-3edb6a525e5c tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:49:48.652453 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-cae0291e-0081-41ff-8e73-3edb6a525e5c tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042328 Oct 27 15:49:48.652994 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 584/1097] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Oct 27 15:49:48 2021] GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 15:49:48.717036 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-c564cc66-c39f-402e-b8f6-80e178b1c8df tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:49:48.717679 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-c564cc66-c39f-402e-b8f6-80e178b1c8df tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:49:48.725147 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-c564cc66-c39f-402e-b8f6-80e178b1c8df tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:49:48.725710 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-c564cc66-c39f-402e-b8f6-80e178b1c8df tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:49:48.726495 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-c564cc66-c39f-402e-b8f6-80e178b1c8df tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:49:48.726929 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-c564cc66-c39f-402e-b8f6-80e178b1c8df tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:49:48.851934 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-c564cc66-c39f-402e-b8f6-80e178b1c8df tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:49:48.860848 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-c564cc66-c39f-402e-b8f6-80e178b1c8df tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:49:48.862333 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-c564cc66-c39f-402e-b8f6-80e178b1c8df tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:49:48.864357 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-c564cc66-c39f-402e-b8f6-80e178b1c8df tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672" status: 200 len: 1748 microversion: 2.20 time: 0.152452 Oct 27 15:49:48.865078 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 514/1098] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Oct 27 15:49:48 2021] GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672 => generated 1748 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 15:49:49.432868 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-5d6961d1-6144-47ef-8593-cd3cfc6ca55a tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:49:49.433471 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-5d6961d1-6144-47ef-8593-cd3cfc6ca55a tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] [instance: a79303e6-05ad-4901-96b7-ce845b4016f4] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:49:49.439305 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-5d6961d1-6144-47ef-8593-cd3cfc6ca55a tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:49:49.439741 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-5d6961d1-6144-47ef-8593-cd3cfc6ca55a tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:49:49.440532 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-5d6961d1-6144-47ef-8593-cd3cfc6ca55a tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:49:49.440961 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-5d6961d1-6144-47ef-8593-cd3cfc6ca55a tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:49:49.500034 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-5d6961d1-6144-47ef-8593-cd3cfc6ca55a tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c757a383a434a4c9b1b928087af8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8818377e744d4f6ba65560705c191f0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:49:49.507371 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-5d6961d1-6144-47ef-8593-cd3cfc6ca55a tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] 10.222.0.64 "GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4" status: 200 len: 1226 microversion: 2.1 time: 0.078206 Oct 27 15:49:49.508017 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 585/1099] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:49:49 2021] GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4 => generated 1226 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 15:49:49.664436 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-10245fef-d590-4bde-b3f6-995414af3c8c tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:49:49.665328 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-10245fef-d590-4bde-b3f6-995414af3c8c tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: 62c89161-c119-48b2-839d-712db798ff96] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:49:49.670999 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-10245fef-d590-4bde-b3f6-995414af3c8c tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:49:49.671462 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-10245fef-d590-4bde-b3f6-995414af3c8c tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:49:49.672235 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-10245fef-d590-4bde-b3f6-995414af3c8c tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:49:49.672659 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-10245fef-d590-4bde-b3f6-995414af3c8c tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:49:49.701310 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-10245fef-d590-4bde-b3f6-995414af3c8c tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041241 Oct 27 15:49:49.701877 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 515/1100] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Oct 27 15:49:49 2021] GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 15:49:49.884785 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-5dc3820d-89bd-42ef-8b09-6c416be1f6fe tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:49:49.885430 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-5dc3820d-89bd-42ef-8b09-6c416be1f6fe tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:49:49.892078 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-5dc3820d-89bd-42ef-8b09-6c416be1f6fe tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:49:49.892362 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-5dc3820d-89bd-42ef-8b09-6c416be1f6fe tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:49:49.893192 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-5dc3820d-89bd-42ef-8b09-6c416be1f6fe tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:49:49.893641 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-5dc3820d-89bd-42ef-8b09-6c416be1f6fe tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:49:50.020747 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-5dc3820d-89bd-42ef-8b09-6c416be1f6fe tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:49:50.030778 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-5dc3820d-89bd-42ef-8b09-6c416be1f6fe tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:49:50.032302 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-5dc3820d-89bd-42ef-8b09-6c416be1f6fe tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:49:50.033481 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-5dc3820d-89bd-42ef-8b09-6c416be1f6fe tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672" status: 200 len: 1748 microversion: 2.20 time: 0.153095 Oct 27 15:49:50.034026 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 586/1101] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Oct 27 15:49:49 2021] GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672 => generated 1748 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 15:49:50.528515 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-db5c19fb-ee9e-4e58-84c2-3a00a616321a tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:49:50.529340 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-db5c19fb-ee9e-4e58-84c2-3a00a616321a tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] [instance: a79303e6-05ad-4901-96b7-ce845b4016f4] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:49:50.535643 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-db5c19fb-ee9e-4e58-84c2-3a00a616321a tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:49:50.536118 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-db5c19fb-ee9e-4e58-84c2-3a00a616321a tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:49:50.537372 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-db5c19fb-ee9e-4e58-84c2-3a00a616321a tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:49:50.537808 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-db5c19fb-ee9e-4e58-84c2-3a00a616321a tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:49:50.596081 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-db5c19fb-ee9e-4e58-84c2-3a00a616321a tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c757a383a434a4c9b1b928087af8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8818377e744d4f6ba65560705c191f0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:49:50.604002 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-db5c19fb-ee9e-4e58-84c2-3a00a616321a tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] 10.222.0.64 "GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4" status: 200 len: 1226 microversion: 2.1 time: 0.080679 Oct 27 15:49:50.604563 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 516/1102] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:49:50 2021] GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4 => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 15:49:50.713077 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-d3111a4c-6e5f-4d8f-bf16-a21c5b9c8bce tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:49:50.713977 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-d3111a4c-6e5f-4d8f-bf16-a21c5b9c8bce tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: 62c89161-c119-48b2-839d-712db798ff96] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:49:50.720208 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-d3111a4c-6e5f-4d8f-bf16-a21c5b9c8bce tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:49:50.720645 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-d3111a4c-6e5f-4d8f-bf16-a21c5b9c8bce tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:49:50.721403 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-d3111a4c-6e5f-4d8f-bf16-a21c5b9c8bce tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:49:50.721822 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-d3111a4c-6e5f-4d8f-bf16-a21c5b9c8bce tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:49:50.751187 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-d3111a4c-6e5f-4d8f-bf16-a21c5b9c8bce tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042207 Oct 27 15:49:50.751721 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 587/1103] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Oct 27 15:49:50 2021] GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 15:49:51.051239 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-8e166ff7-6fbb-4662-8428-7f157a275c09 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:49:51.051890 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-8e166ff7-6fbb-4662-8428-7f157a275c09 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:49:51.057687 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-8e166ff7-6fbb-4662-8428-7f157a275c09 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:49:51.058127 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-8e166ff7-6fbb-4662-8428-7f157a275c09 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:49:51.058891 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-8e166ff7-6fbb-4662-8428-7f157a275c09 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:49:51.059324 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-8e166ff7-6fbb-4662-8428-7f157a275c09 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:49:51.182218 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-8e166ff7-6fbb-4662-8428-7f157a275c09 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:49:51.190313 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-8e166ff7-6fbb-4662-8428-7f157a275c09 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:49:51.191802 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-8e166ff7-6fbb-4662-8428-7f157a275c09 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:49:51.193029 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-8e166ff7-6fbb-4662-8428-7f157a275c09 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672" status: 200 len: 1748 microversion: 2.20 time: 0.145519 Oct 27 15:49:51.193806 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 517/1104] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Oct 27 15:49:51 2021] GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672 => generated 1748 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 15:49:51.621112 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-b051125e-c19d-4182-83b2-571de25b8fb9 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:49:51.621728 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-b051125e-c19d-4182-83b2-571de25b8fb9 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] [instance: a79303e6-05ad-4901-96b7-ce845b4016f4] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:49:51.627964 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-b051125e-c19d-4182-83b2-571de25b8fb9 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:49:51.628414 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-b051125e-c19d-4182-83b2-571de25b8fb9 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:49:51.629178 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-b051125e-c19d-4182-83b2-571de25b8fb9 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:49:51.629613 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-b051125e-c19d-4182-83b2-571de25b8fb9 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:49:51.689802 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-b051125e-c19d-4182-83b2-571de25b8fb9 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c757a383a434a4c9b1b928087af8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8818377e744d4f6ba65560705c191f0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:49:51.697853 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-b051125e-c19d-4182-83b2-571de25b8fb9 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] 10.222.0.64 "GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4" status: 200 len: 1226 microversion: 2.1 time: 0.080550 Oct 27 15:49:51.698405 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 588/1105] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:49:51 2021] GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4 => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 15:49:51.762632 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-c3e77b95-77f9-47b4-91d7-edab197acaff tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:49:51.763539 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-c3e77b95-77f9-47b4-91d7-edab197acaff tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: 62c89161-c119-48b2-839d-712db798ff96] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:49:51.769691 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-c3e77b95-77f9-47b4-91d7-edab197acaff tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:49:51.770131 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-c3e77b95-77f9-47b4-91d7-edab197acaff tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:49:51.771035 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-c3e77b95-77f9-47b4-91d7-edab197acaff tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:49:51.771512 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-c3e77b95-77f9-47b4-91d7-edab197acaff tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:49:51.799905 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-c3e77b95-77f9-47b4-91d7-edab197acaff tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040987 Oct 27 15:49:51.800534 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 518/1106] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Oct 27 15:49:51 2021] GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 15:49:52.210912 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-461a00ef-d0e5-4348-ab78-14deafcf878a tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:49:52.211518 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-461a00ef-d0e5-4348-ab78-14deafcf878a tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:49:52.217375 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-461a00ef-d0e5-4348-ab78-14deafcf878a tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:49:52.217817 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-461a00ef-d0e5-4348-ab78-14deafcf878a tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:49:52.218573 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-461a00ef-d0e5-4348-ab78-14deafcf878a tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:49:52.219002 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-461a00ef-d0e5-4348-ab78-14deafcf878a tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:49:52.338405 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-461a00ef-d0e5-4348-ab78-14deafcf878a tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:49:52.346683 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-461a00ef-d0e5-4348-ab78-14deafcf878a tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:49:52.348206 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-461a00ef-d0e5-4348-ab78-14deafcf878a tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:49:52.349971 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-461a00ef-d0e5-4348-ab78-14deafcf878a tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672" status: 200 len: 1748 microversion: 2.20 time: 0.142771 Oct 27 15:49:52.350530 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 589/1107] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Oct 27 15:49:52 2021] GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672 => generated 1748 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 15:49:52.714613 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-29f5b38c-a21d-400e-ad96-6a1cc5234d52 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:49:52.715218 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-29f5b38c-a21d-400e-ad96-6a1cc5234d52 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] [instance: a79303e6-05ad-4901-96b7-ce845b4016f4] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:49:52.721251 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-29f5b38c-a21d-400e-ad96-6a1cc5234d52 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:49:52.721691 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-29f5b38c-a21d-400e-ad96-6a1cc5234d52 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:49:52.722448 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-29f5b38c-a21d-400e-ad96-6a1cc5234d52 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:49:52.722880 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-29f5b38c-a21d-400e-ad96-6a1cc5234d52 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:49:52.785372 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-29f5b38c-a21d-400e-ad96-6a1cc5234d52 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c757a383a434a4c9b1b928087af8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8818377e744d4f6ba65560705c191f0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:49:52.792804 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-29f5b38c-a21d-400e-ad96-6a1cc5234d52 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] 10.222.0.64 "GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4" status: 200 len: 1226 microversion: 2.1 time: 0.081893 Oct 27 15:49:52.793368 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 519/1108] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:49:52 2021] GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4 => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 15:49:52.811529 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-1df51e81-988b-4e62-a044-cf16b2be8d5e tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:49:52.812486 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-1df51e81-988b-4e62-a044-cf16b2be8d5e tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: 62c89161-c119-48b2-839d-712db798ff96] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:49:52.818168 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-1df51e81-988b-4e62-a044-cf16b2be8d5e tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:49:52.819103 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-1df51e81-988b-4e62-a044-cf16b2be8d5e tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:49:52.820146 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-1df51e81-988b-4e62-a044-cf16b2be8d5e tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:49:52.820583 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-1df51e81-988b-4e62-a044-cf16b2be8d5e tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:49:52.848524 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-1df51e81-988b-4e62-a044-cf16b2be8d5e tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040686 Oct 27 15:49:52.849064 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 590/1109] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Oct 27 15:49:52 2021] GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 15:49:53.368477 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-fe23d575-2921-41a8-8039-782222b818c8 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:49:53.369075 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-fe23d575-2921-41a8-8039-782222b818c8 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:49:53.374778 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-fe23d575-2921-41a8-8039-782222b818c8 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:49:53.375211 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-fe23d575-2921-41a8-8039-782222b818c8 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:49:53.375983 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-fe23d575-2921-41a8-8039-782222b818c8 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:49:53.376406 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-fe23d575-2921-41a8-8039-782222b818c8 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:49:53.497944 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-fe23d575-2921-41a8-8039-782222b818c8 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:49:53.505910 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-fe23d575-2921-41a8-8039-782222b818c8 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:49:53.507388 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-fe23d575-2921-41a8-8039-782222b818c8 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:49:53.508553 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-fe23d575-2921-41a8-8039-782222b818c8 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672" status: 200 len: 1748 microversion: 2.20 time: 0.144455 Oct 27 15:49:53.509098 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 520/1110] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Oct 27 15:49:53 2021] GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672 => generated 1748 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 15:49:53.810857 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-40ceb80f-d95a-4cbe-955a-641c86ad810b tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:49:53.811563 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-40ceb80f-d95a-4cbe-955a-641c86ad810b tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] [instance: a79303e6-05ad-4901-96b7-ce845b4016f4] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:49:53.818487 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-40ceb80f-d95a-4cbe-955a-641c86ad810b tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:49:53.818958 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-40ceb80f-d95a-4cbe-955a-641c86ad810b tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:49:53.819725 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-40ceb80f-d95a-4cbe-955a-641c86ad810b tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:49:53.820190 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-40ceb80f-d95a-4cbe-955a-641c86ad810b tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:49:53.859843 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-b89ab990-16ca-48c2-8689-b3442c884858 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:49:53.860757 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-b89ab990-16ca-48c2-8689-b3442c884858 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: 62c89161-c119-48b2-839d-712db798ff96] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:49:53.866859 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-b89ab990-16ca-48c2-8689-b3442c884858 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:49:53.867294 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-b89ab990-16ca-48c2-8689-b3442c884858 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:49:53.868080 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-b89ab990-16ca-48c2-8689-b3442c884858 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:49:53.868501 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-b89ab990-16ca-48c2-8689-b3442c884858 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:49:53.880807 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-40ceb80f-d95a-4cbe-955a-641c86ad810b tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c757a383a434a4c9b1b928087af8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8818377e744d4f6ba65560705c191f0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:49:53.888278 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-40ceb80f-d95a-4cbe-955a-641c86ad810b tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] 10.222.0.64 "GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4" status: 200 len: 1226 microversion: 2.1 time: 0.081566 Oct 27 15:49:53.889044 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 591/1111] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:49:53 2021] GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4 => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 15:49:53.900511 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-b89ab990-16ca-48c2-8689-b3442c884858 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044306 Oct 27 15:49:53.901069 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 521/1112] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Oct 27 15:49:53 2021] GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 15:49:54.526327 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-bc80f86a-e5fb-40ba-a2e8-17c8e395f583 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:49:54.526849 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-bc80f86a-e5fb-40ba-a2e8-17c8e395f583 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:49:54.532621 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-bc80f86a-e5fb-40ba-a2e8-17c8e395f583 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:49:54.533052 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-bc80f86a-e5fb-40ba-a2e8-17c8e395f583 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:49:54.533805 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-bc80f86a-e5fb-40ba-a2e8-17c8e395f583 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:49:54.534233 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-bc80f86a-e5fb-40ba-a2e8-17c8e395f583 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:49:54.656317 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-bc80f86a-e5fb-40ba-a2e8-17c8e395f583 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:49:54.664907 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-bc80f86a-e5fb-40ba-a2e8-17c8e395f583 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:49:54.666398 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-bc80f86a-e5fb-40ba-a2e8-17c8e395f583 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:49:54.667537 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-bc80f86a-e5fb-40ba-a2e8-17c8e395f583 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672" status: 200 len: 1748 microversion: 2.20 time: 0.145016 Oct 27 15:49:54.668115 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 592/1113] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Oct 27 15:49:54 2021] GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672 => generated 1748 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 15:49:54.905958 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-2a37d4e0-529f-4eb3-8e47-80f0805bbf3a tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:49:54.906572 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-2a37d4e0-529f-4eb3-8e47-80f0805bbf3a tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] [instance: a79303e6-05ad-4901-96b7-ce845b4016f4] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:49:54.911732 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-1645b0a8-8092-4d58-904f-1febf7dbf792 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:49:54.916829 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-1645b0a8-8092-4d58-904f-1febf7dbf792 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: 62c89161-c119-48b2-839d-712db798ff96] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:49:54.917015 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-2a37d4e0-529f-4eb3-8e47-80f0805bbf3a tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:49:54.917015 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-2a37d4e0-529f-4eb3-8e47-80f0805bbf3a tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:49:54.917015 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-2a37d4e0-529f-4eb3-8e47-80f0805bbf3a tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:49:54.917015 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-2a37d4e0-529f-4eb3-8e47-80f0805bbf3a tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:49:54.922327 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-1645b0a8-8092-4d58-904f-1febf7dbf792 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:49:54.922468 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-1645b0a8-8092-4d58-904f-1febf7dbf792 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:49:54.923187 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-1645b0a8-8092-4d58-904f-1febf7dbf792 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:49:54.923622 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-1645b0a8-8092-4d58-904f-1febf7dbf792 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:49:54.954627 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-1645b0a8-8092-4d58-904f-1febf7dbf792 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046648 Oct 27 15:49:54.955427 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 593/1114] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Oct 27 15:49:54 2021] GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 15:49:54.980219 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-2a37d4e0-529f-4eb3-8e47-80f0805bbf3a tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c757a383a434a4c9b1b928087af8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8818377e744d4f6ba65560705c191f0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:49:54.987743 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-2a37d4e0-529f-4eb3-8e47-80f0805bbf3a tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] 10.222.0.64 "GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4" status: 200 len: 1226 microversion: 2.1 time: 0.085474 Oct 27 15:49:54.988347 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 522/1115] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:49:54 2021] GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4 => generated 1226 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 15:49:55.685926 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-42ed52b6-0445-4b5f-951d-e7497df04f92 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:49:55.686531 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-42ed52b6-0445-4b5f-951d-e7497df04f92 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:49:55.692324 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-42ed52b6-0445-4b5f-951d-e7497df04f92 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:49:55.692773 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-42ed52b6-0445-4b5f-951d-e7497df04f92 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:49:55.693535 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-42ed52b6-0445-4b5f-951d-e7497df04f92 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:49:55.693986 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-42ed52b6-0445-4b5f-951d-e7497df04f92 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:49:55.812729 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-42ed52b6-0445-4b5f-951d-e7497df04f92 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:49:55.821958 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-42ed52b6-0445-4b5f-951d-e7497df04f92 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:49:55.823455 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-42ed52b6-0445-4b5f-951d-e7497df04f92 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:49:55.824645 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-42ed52b6-0445-4b5f-951d-e7497df04f92 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672" status: 200 len: 1748 microversion: 2.20 time: 0.142485 Oct 27 15:49:55.825211 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 594/1116] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Oct 27 15:49:55 2021] GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672 => generated 1748 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 15:49:55.966503 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-e52204f7-a47a-4d7d-8641-cc4a6b323dd6 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:49:55.967407 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-e52204f7-a47a-4d7d-8641-cc4a6b323dd6 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: 62c89161-c119-48b2-839d-712db798ff96] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:49:55.973473 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-e52204f7-a47a-4d7d-8641-cc4a6b323dd6 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:49:55.973914 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-e52204f7-a47a-4d7d-8641-cc4a6b323dd6 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:49:55.974674 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-e52204f7-a47a-4d7d-8641-cc4a6b323dd6 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:49:55.975104 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-e52204f7-a47a-4d7d-8641-cc4a6b323dd6 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:49:56.004876 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-ca88a8bb-8b51-406c-a0c4-31f09f05ee00 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:49:56.005448 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-e52204f7-a47a-4d7d-8641-cc4a6b323dd6 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042670 Oct 27 15:49:56.005577 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-ca88a8bb-8b51-406c-a0c4-31f09f05ee00 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] [instance: a79303e6-05ad-4901-96b7-ce845b4016f4] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:49:56.005901 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 523/1117] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Oct 27 15:49:55 2021] GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 15:49:56.012143 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-ca88a8bb-8b51-406c-a0c4-31f09f05ee00 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:49:56.012595 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-ca88a8bb-8b51-406c-a0c4-31f09f05ee00 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:49:56.013401 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-ca88a8bb-8b51-406c-a0c4-31f09f05ee00 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:49:56.013821 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-ca88a8bb-8b51-406c-a0c4-31f09f05ee00 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:49:56.073480 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-ca88a8bb-8b51-406c-a0c4-31f09f05ee00 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c757a383a434a4c9b1b928087af8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8818377e744d4f6ba65560705c191f0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:49:56.080802 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-ca88a8bb-8b51-406c-a0c4-31f09f05ee00 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] 10.222.0.64 "GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4" status: 200 len: 1226 microversion: 2.1 time: 0.080039 Oct 27 15:49:56.081365 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 595/1118] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:49:55 2021] GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4 => generated 1226 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 15:49:56.842512 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-61de122c-31f3-4abe-ae96-cc2e24366179 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:49:56.843113 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-61de122c-31f3-4abe-ae96-cc2e24366179 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:49:56.849173 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-61de122c-31f3-4abe-ae96-cc2e24366179 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:49:56.849614 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-61de122c-31f3-4abe-ae96-cc2e24366179 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:49:56.850379 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-61de122c-31f3-4abe-ae96-cc2e24366179 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:49:56.850810 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-61de122c-31f3-4abe-ae96-cc2e24366179 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:49:56.972975 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-61de122c-31f3-4abe-ae96-cc2e24366179 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:49:56.981985 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-61de122c-31f3-4abe-ae96-cc2e24366179 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:49:56.983463 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-61de122c-31f3-4abe-ae96-cc2e24366179 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:49:56.984653 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-61de122c-31f3-4abe-ae96-cc2e24366179 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672" status: 200 len: 1748 microversion: 2.20 time: 0.145865 Oct 27 15:49:56.985201 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 524/1119] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Oct 27 15:49:56 2021] GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672 => generated 1748 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 15:49:57.016760 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-3aab2e9b-d8ab-4f56-8aa3-41daf8129d99 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:49:57.017674 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-3aab2e9b-d8ab-4f56-8aa3-41daf8129d99 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: 62c89161-c119-48b2-839d-712db798ff96] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:49:57.024599 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-3aab2e9b-d8ab-4f56-8aa3-41daf8129d99 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:49:57.025045 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-3aab2e9b-d8ab-4f56-8aa3-41daf8129d99 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:49:57.025813 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-3aab2e9b-d8ab-4f56-8aa3-41daf8129d99 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:49:57.026245 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-3aab2e9b-d8ab-4f56-8aa3-41daf8129d99 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:49:57.054817 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-3aab2e9b-d8ab-4f56-8aa3-41daf8129d99 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041839 Oct 27 15:49:57.055375 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 596/1120] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Oct 27 15:49:57 2021] GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 15:49:57.097803 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-44a56d73-786c-4941-8f7d-5afc506e010c tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:49:57.098323 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-44a56d73-786c-4941-8f7d-5afc506e010c tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] [instance: a79303e6-05ad-4901-96b7-ce845b4016f4] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:49:57.105275 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-44a56d73-786c-4941-8f7d-5afc506e010c tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:49:57.105717 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-44a56d73-786c-4941-8f7d-5afc506e010c tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:49:57.106461 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-44a56d73-786c-4941-8f7d-5afc506e010c tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:49:57.106888 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-44a56d73-786c-4941-8f7d-5afc506e010c tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:49:57.166378 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-44a56d73-786c-4941-8f7d-5afc506e010c tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c757a383a434a4c9b1b928087af8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8818377e744d4f6ba65560705c191f0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:49:57.173679 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-44a56d73-786c-4941-8f7d-5afc506e010c tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] 10.222.0.64 "GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4" status: 200 len: 1226 microversion: 2.1 time: 0.079878 Oct 27 15:49:57.174231 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 525/1121] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:49:57 2021] GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4 => generated 1226 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 15:49:58.003137 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-707478e6-cc0a-48bf-8448-422520c42c6f tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:49:58.003741 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-707478e6-cc0a-48bf-8448-422520c42c6f tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:49:58.010168 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-707478e6-cc0a-48bf-8448-422520c42c6f tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:49:58.010616 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-707478e6-cc0a-48bf-8448-422520c42c6f tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:49:58.011376 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-707478e6-cc0a-48bf-8448-422520c42c6f tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:49:58.011810 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-707478e6-cc0a-48bf-8448-422520c42c6f tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:49:58.066245 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-42912daf-4b7a-4721-a62b-688dbec30140 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:49:58.067154 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-42912daf-4b7a-4721-a62b-688dbec30140 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: 62c89161-c119-48b2-839d-712db798ff96] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:49:58.074213 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-42912daf-4b7a-4721-a62b-688dbec30140 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:49:58.074663 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-42912daf-4b7a-4721-a62b-688dbec30140 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:49:58.075442 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-42912daf-4b7a-4721-a62b-688dbec30140 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:49:58.075930 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-42912daf-4b7a-4721-a62b-688dbec30140 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:49:58.110562 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-42912daf-4b7a-4721-a62b-688dbec30140 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047636 Oct 27 15:49:58.116940 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 526/1122] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Oct 27 15:49:58 2021] GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 15:49:58.141794 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-707478e6-cc0a-48bf-8448-422520c42c6f tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:49:58.150790 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-707478e6-cc0a-48bf-8448-422520c42c6f tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:49:58.152329 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-707478e6-cc0a-48bf-8448-422520c42c6f tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:49:58.153488 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-707478e6-cc0a-48bf-8448-422520c42c6f tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672" status: 200 len: 1748 microversion: 2.20 time: 0.154261 Oct 27 15:49:58.154043 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 597/1123] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Oct 27 15:49:57 2021] GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672 => generated 1748 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 15:49:58.189499 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-94a397cd-19a0-47a9-a3b1-2facafe3c465 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:49:58.190099 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-94a397cd-19a0-47a9-a3b1-2facafe3c465 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] [instance: a79303e6-05ad-4901-96b7-ce845b4016f4] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:49:58.196565 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-94a397cd-19a0-47a9-a3b1-2facafe3c465 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:49:58.196998 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-94a397cd-19a0-47a9-a3b1-2facafe3c465 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:49:58.197751 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-94a397cd-19a0-47a9-a3b1-2facafe3c465 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:49:58.198173 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-94a397cd-19a0-47a9-a3b1-2facafe3c465 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:49:58.256385 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-94a397cd-19a0-47a9-a3b1-2facafe3c465 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c757a383a434a4c9b1b928087af8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8818377e744d4f6ba65560705c191f0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:49:58.264651 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-94a397cd-19a0-47a9-a3b1-2facafe3c465 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] 10.222.0.64 "GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4" status: 200 len: 1226 microversion: 2.1 time: 0.078918 Oct 27 15:49:58.265212 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 527/1124] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:49:58 2021] GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4 => generated 1226 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 15:49:59.124407 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-6b20508f-0294-4125-9a1c-6580ebff450a tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:49:59.125218 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-6b20508f-0294-4125-9a1c-6580ebff450a tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: 62c89161-c119-48b2-839d-712db798ff96] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:49:59.131412 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-6b20508f-0294-4125-9a1c-6580ebff450a tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:49:59.131867 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-6b20508f-0294-4125-9a1c-6580ebff450a tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:49:59.133296 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-6b20508f-0294-4125-9a1c-6580ebff450a tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:49:59.133725 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-6b20508f-0294-4125-9a1c-6580ebff450a tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:49:59.164575 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-6b20508f-0294-4125-9a1c-6580ebff450a tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043957 Oct 27 15:49:59.165272 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 598/1125] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Oct 27 15:49:59 2021] GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 15:49:59.170825 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-61db18fa-703e-499e-b272-dae147afcc80 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:49:59.171426 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-61db18fa-703e-499e-b272-dae147afcc80 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:49:59.177666 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-61db18fa-703e-499e-b272-dae147afcc80 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:49:59.178112 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-61db18fa-703e-499e-b272-dae147afcc80 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:49:59.178863 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-61db18fa-703e-499e-b272-dae147afcc80 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:49:59.179793 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-61db18fa-703e-499e-b272-dae147afcc80 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:49:59.281583 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-3a815990-9ec9-4186-834a-1af4709b7a99 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:49:59.282187 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-3a815990-9ec9-4186-834a-1af4709b7a99 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] [instance: a79303e6-05ad-4901-96b7-ce845b4016f4] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:49:59.287999 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-3a815990-9ec9-4186-834a-1af4709b7a99 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:49:59.289209 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-3a815990-9ec9-4186-834a-1af4709b7a99 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:49:59.290173 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-3a815990-9ec9-4186-834a-1af4709b7a99 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:49:59.290613 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-3a815990-9ec9-4186-834a-1af4709b7a99 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:49:59.304769 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-61db18fa-703e-499e-b272-dae147afcc80 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:49:59.314260 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-61db18fa-703e-499e-b272-dae147afcc80 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:49:59.315756 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-61db18fa-703e-499e-b272-dae147afcc80 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:49:59.316955 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-61db18fa-703e-499e-b272-dae147afcc80 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672" status: 200 len: 1748 microversion: 2.20 time: 0.149771 Oct 27 15:49:59.317776 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 528/1126] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Oct 27 15:49:59 2021] GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672 => generated 1748 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 15:49:59.352642 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-3a815990-9ec9-4186-834a-1af4709b7a99 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c757a383a434a4c9b1b928087af8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8818377e744d4f6ba65560705c191f0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:49:59.360059 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-3a815990-9ec9-4186-834a-1af4709b7a99 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] 10.222.0.64 "GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4" status: 200 len: 1226 microversion: 2.1 time: 0.082141 Oct 27 15:49:59.360623 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 599/1127] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:49:59 2021] GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4 => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 15:50:00.176668 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-b0d7a926-0b9d-42f8-8da7-d545c986220a tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:50:00.177493 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-b0d7a926-0b9d-42f8-8da7-d545c986220a tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: 62c89161-c119-48b2-839d-712db798ff96] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:50:00.184192 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-b0d7a926-0b9d-42f8-8da7-d545c986220a tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:50:00.184631 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-b0d7a926-0b9d-42f8-8da7-d545c986220a tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:50:00.185392 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-b0d7a926-0b9d-42f8-8da7-d545c986220a tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:50:00.185823 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-b0d7a926-0b9d-42f8-8da7-d545c986220a tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:50:00.215011 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-b0d7a926-0b9d-42f8-8da7-d545c986220a tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042209 Oct 27 15:50:00.215576 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 529/1128] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Oct 27 15:50:00 2021] GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 15:50:00.334438 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-97df7fbb-d2fe-444e-8248-a54d98a26bb0 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:50:00.335025 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-97df7fbb-d2fe-444e-8248-a54d98a26bb0 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:50:00.341391 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-97df7fbb-d2fe-444e-8248-a54d98a26bb0 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:50:00.341838 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-97df7fbb-d2fe-444e-8248-a54d98a26bb0 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:50:00.342609 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-97df7fbb-d2fe-444e-8248-a54d98a26bb0 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:50:00.343042 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-97df7fbb-d2fe-444e-8248-a54d98a26bb0 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:50:00.377157 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-085468a5-1977-4896-90cc-4f67ddfecb2b tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:50:00.377787 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-085468a5-1977-4896-90cc-4f67ddfecb2b tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] [instance: a79303e6-05ad-4901-96b7-ce845b4016f4] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:50:00.384143 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-085468a5-1977-4896-90cc-4f67ddfecb2b tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:50:00.384584 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-085468a5-1977-4896-90cc-4f67ddfecb2b tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:50:00.385374 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-085468a5-1977-4896-90cc-4f67ddfecb2b tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:50:00.385806 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-085468a5-1977-4896-90cc-4f67ddfecb2b tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:50:00.454738 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-085468a5-1977-4896-90cc-4f67ddfecb2b tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c757a383a434a4c9b1b928087af8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8818377e744d4f6ba65560705c191f0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:50:00.467635 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-085468a5-1977-4896-90cc-4f67ddfecb2b tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] 10.222.0.64 "GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4" status: 200 len: 1226 microversion: 2.1 time: 0.093680 Oct 27 15:50:00.468691 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 530/1129] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:50:00 2021] GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4 => generated 1226 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 15:50:00.483958 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-97df7fbb-d2fe-444e-8248-a54d98a26bb0 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:50:00.492895 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-97df7fbb-d2fe-444e-8248-a54d98a26bb0 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:50:00.494393 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-97df7fbb-d2fe-444e-8248-a54d98a26bb0 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:50:00.495553 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-97df7fbb-d2fe-444e-8248-a54d98a26bb0 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672" status: 200 len: 1748 microversion: 2.20 time: 0.164918 Oct 27 15:50:00.496146 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 600/1130] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Oct 27 15:50:00 2021] GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672 => generated 1748 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 15:50:01.227310 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-c3061c88-08e7-4363-8d69-c55c6a016e58 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:50:01.228238 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-c3061c88-08e7-4363-8d69-c55c6a016e58 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: 62c89161-c119-48b2-839d-712db798ff96] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:50:01.234440 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-c3061c88-08e7-4363-8d69-c55c6a016e58 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:50:01.234879 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-c3061c88-08e7-4363-8d69-c55c6a016e58 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:50:01.235633 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-c3061c88-08e7-4363-8d69-c55c6a016e58 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:50:01.236098 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-c3061c88-08e7-4363-8d69-c55c6a016e58 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:50:01.267171 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-c3061c88-08e7-4363-8d69-c55c6a016e58 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044148 Oct 27 15:50:01.267730 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 531/1131] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Oct 27 15:50:01 2021] GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 15:50:01.490425 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-d42797fc-7e7c-4092-9767-ec0ad252223c tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:50:01.490989 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-d42797fc-7e7c-4092-9767-ec0ad252223c tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] [instance: a79303e6-05ad-4901-96b7-ce845b4016f4] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:50:01.497415 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-d42797fc-7e7c-4092-9767-ec0ad252223c tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:50:01.497863 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-d42797fc-7e7c-4092-9767-ec0ad252223c tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:50:01.498633 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-d42797fc-7e7c-4092-9767-ec0ad252223c tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:50:01.499068 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-d42797fc-7e7c-4092-9767-ec0ad252223c tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:50:01.520018 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-68e29025-6231-4473-96e1-4a2a745c3003 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:50:01.520794 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-68e29025-6231-4473-96e1-4a2a745c3003 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:50:01.527455 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-68e29025-6231-4473-96e1-4a2a745c3003 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:50:01.528062 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-68e29025-6231-4473-96e1-4a2a745c3003 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:50:01.530424 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-68e29025-6231-4473-96e1-4a2a745c3003 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:50:01.530868 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-68e29025-6231-4473-96e1-4a2a745c3003 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:50:01.559665 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-d42797fc-7e7c-4092-9767-ec0ad252223c tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c757a383a434a4c9b1b928087af8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8818377e744d4f6ba65560705c191f0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:50:01.567694 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-d42797fc-7e7c-4092-9767-ec0ad252223c tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] 10.222.0.64 "GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4" status: 200 len: 1226 microversion: 2.1 time: 0.081004 Oct 27 15:50:01.568383 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 601/1132] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:50:01 2021] GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4 => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 15:50:01.656131 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-68e29025-6231-4473-96e1-4a2a745c3003 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:50:01.664843 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-68e29025-6231-4473-96e1-4a2a745c3003 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:50:01.666331 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-68e29025-6231-4473-96e1-4a2a745c3003 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:50:01.667481 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-68e29025-6231-4473-96e1-4a2a745c3003 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672" status: 200 len: 1748 microversion: 2.20 time: 0.151223 Oct 27 15:50:01.668057 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 532/1133] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Oct 27 15:50:01 2021] GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672 => generated 1748 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 15:50:02.279265 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-1d3a3c39-cadd-4ccb-98d6-407ef352fca7 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:50:02.280203 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-1d3a3c39-cadd-4ccb-98d6-407ef352fca7 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: 62c89161-c119-48b2-839d-712db798ff96] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:50:02.286058 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-1d3a3c39-cadd-4ccb-98d6-407ef352fca7 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:50:02.286496 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-1d3a3c39-cadd-4ccb-98d6-407ef352fca7 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:50:02.287252 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-1d3a3c39-cadd-4ccb-98d6-407ef352fca7 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:50:02.287684 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-1d3a3c39-cadd-4ccb-98d6-407ef352fca7 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:50:02.316318 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-1d3a3c39-cadd-4ccb-98d6-407ef352fca7 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040843 Oct 27 15:50:02.316863 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 602/1134] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Oct 27 15:50:02 2021] GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 15:50:02.584661 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-abdb920a-4c28-4a28-9b7b-ee04659cdc96 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:50:02.585912 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-abdb920a-4c28-4a28-9b7b-ee04659cdc96 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] [instance: a79303e6-05ad-4901-96b7-ce845b4016f4] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:50:02.592166 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-abdb920a-4c28-4a28-9b7b-ee04659cdc96 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:50:02.592611 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-abdb920a-4c28-4a28-9b7b-ee04659cdc96 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:50:02.593376 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-abdb920a-4c28-4a28-9b7b-ee04659cdc96 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:50:02.593805 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-abdb920a-4c28-4a28-9b7b-ee04659cdc96 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:50:02.655066 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-abdb920a-4c28-4a28-9b7b-ee04659cdc96 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c757a383a434a4c9b1b928087af8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8818377e744d4f6ba65560705c191f0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:50:02.662475 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-abdb920a-4c28-4a28-9b7b-ee04659cdc96 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] 10.222.0.64 "GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4" status: 200 len: 1226 microversion: 2.1 time: 0.081631 Oct 27 15:50:02.663051 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 533/1135] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:50:02 2021] GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4 => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 15:50:02.685350 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-4d782839-2fc9-4b5b-a255-69d25a616bd0 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:50:02.685958 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-4d782839-2fc9-4b5b-a255-69d25a616bd0 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:50:02.692176 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-4d782839-2fc9-4b5b-a255-69d25a616bd0 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:50:02.692620 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-4d782839-2fc9-4b5b-a255-69d25a616bd0 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:50:02.693397 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-4d782839-2fc9-4b5b-a255-69d25a616bd0 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:50:02.693840 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-4d782839-2fc9-4b5b-a255-69d25a616bd0 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:50:02.818697 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-4d782839-2fc9-4b5b-a255-69d25a616bd0 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:50:02.828213 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-4d782839-2fc9-4b5b-a255-69d25a616bd0 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:50:02.829770 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-4d782839-2fc9-4b5b-a255-69d25a616bd0 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:50:02.830936 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-4d782839-2fc9-4b5b-a255-69d25a616bd0 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672" status: 200 len: 1748 microversion: 2.20 time: 0.149336 Oct 27 15:50:02.831488 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 603/1136] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Oct 27 15:50:02 2021] GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672 => generated 1748 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 15:50:03.328195 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-14d37144-8600-4091-9e07-2acb80f0630c tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:50:03.329100 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-14d37144-8600-4091-9e07-2acb80f0630c tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: 62c89161-c119-48b2-839d-712db798ff96] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:50:03.334872 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-14d37144-8600-4091-9e07-2acb80f0630c tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:50:03.336115 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-14d37144-8600-4091-9e07-2acb80f0630c tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:50:03.336884 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-14d37144-8600-4091-9e07-2acb80f0630c tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:50:03.337317 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-14d37144-8600-4091-9e07-2acb80f0630c tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:50:03.367076 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-14d37144-8600-4091-9e07-2acb80f0630c tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042164 Oct 27 15:50:03.367776 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 534/1137] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Oct 27 15:50:03 2021] GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 15:50:03.680216 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-16541562-35eb-4f53-ab8a-c5fcd1a893b5 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:50:03.680714 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-16541562-35eb-4f53-ab8a-c5fcd1a893b5 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] [instance: a79303e6-05ad-4901-96b7-ce845b4016f4] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:50:03.686527 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-16541562-35eb-4f53-ab8a-c5fcd1a893b5 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:50:03.687128 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-16541562-35eb-4f53-ab8a-c5fcd1a893b5 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:50:03.687725 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-16541562-35eb-4f53-ab8a-c5fcd1a893b5 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:50:03.688207 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-16541562-35eb-4f53-ab8a-c5fcd1a893b5 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:50:03.749846 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-16541562-35eb-4f53-ab8a-c5fcd1a893b5 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c757a383a434a4c9b1b928087af8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8818377e744d4f6ba65560705c191f0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:50:03.757969 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-16541562-35eb-4f53-ab8a-c5fcd1a893b5 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] 10.222.0.64 "GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4" status: 200 len: 1226 microversion: 2.1 time: 0.081867 Oct 27 15:50:03.758538 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 604/1138] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:50:03 2021] GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4 => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 15:50:03.849804 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-724a9622-f0e8-4d6b-b782-9a7e6b28f205 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:50:03.850378 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-724a9622-f0e8-4d6b-b782-9a7e6b28f205 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:50:03.857259 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-724a9622-f0e8-4d6b-b782-9a7e6b28f205 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:50:03.857695 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-724a9622-f0e8-4d6b-b782-9a7e6b28f205 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:50:03.858454 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-724a9622-f0e8-4d6b-b782-9a7e6b28f205 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:50:03.858880 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-724a9622-f0e8-4d6b-b782-9a7e6b28f205 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:50:03.983143 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-724a9622-f0e8-4d6b-b782-9a7e6b28f205 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:50:03.993389 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-724a9622-f0e8-4d6b-b782-9a7e6b28f205 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:50:03.994892 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-724a9622-f0e8-4d6b-b782-9a7e6b28f205 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:50:03.996123 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-724a9622-f0e8-4d6b-b782-9a7e6b28f205 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672" status: 200 len: 1748 microversion: 2.20 time: 0.149989 Oct 27 15:50:03.996674 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 535/1139] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Oct 27 15:50:03 2021] GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672 => generated 1748 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 15:50:04.378925 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-42395cea-25c8-4673-9866-ccfd3f2566e3 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:50:04.380022 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-42395cea-25c8-4673-9866-ccfd3f2566e3 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: 62c89161-c119-48b2-839d-712db798ff96] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:50:04.386317 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-42395cea-25c8-4673-9866-ccfd3f2566e3 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:50:04.386756 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-42395cea-25c8-4673-9866-ccfd3f2566e3 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:50:04.387519 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-42395cea-25c8-4673-9866-ccfd3f2566e3 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:50:04.387999 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-42395cea-25c8-4673-9866-ccfd3f2566e3 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:50:04.423012 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-42395cea-25c8-4673-9866-ccfd3f2566e3 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047858 Oct 27 15:50:04.423577 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 605/1140] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Oct 27 15:50:04 2021] GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 15:50:04.775658 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-25f37d76-daac-4ae0-9978-d6a4513119d4 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:50:04.776300 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-25f37d76-daac-4ae0-9978-d6a4513119d4 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] [instance: a79303e6-05ad-4901-96b7-ce845b4016f4] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:50:04.782115 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-25f37d76-daac-4ae0-9978-d6a4513119d4 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:50:04.782586 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-25f37d76-daac-4ae0-9978-d6a4513119d4 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:50:04.783346 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-25f37d76-daac-4ae0-9978-d6a4513119d4 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:50:04.783773 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-25f37d76-daac-4ae0-9978-d6a4513119d4 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:50:04.847556 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-25f37d76-daac-4ae0-9978-d6a4513119d4 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c757a383a434a4c9b1b928087af8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8818377e744d4f6ba65560705c191f0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:50:04.856189 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-25f37d76-daac-4ae0-9978-d6a4513119d4 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] 10.222.0.64 "GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4" status: 200 len: 1226 microversion: 2.1 time: 0.084715 Oct 27 15:50:04.856844 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 536/1141] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:50:04 2021] GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4 => generated 1226 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 15:50:05.014426 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-d8b01c37-a418-456c-a8e4-32fd9198695d tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:50:05.015080 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-d8b01c37-a418-456c-a8e4-32fd9198695d tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:50:05.021587 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-d8b01c37-a418-456c-a8e4-32fd9198695d tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:50:05.022081 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-d8b01c37-a418-456c-a8e4-32fd9198695d tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:50:05.022976 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-d8b01c37-a418-456c-a8e4-32fd9198695d tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:50:05.023477 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-d8b01c37-a418-456c-a8e4-32fd9198695d tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:50:05.145085 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-d8b01c37-a418-456c-a8e4-32fd9198695d tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:50:05.154086 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-d8b01c37-a418-456c-a8e4-32fd9198695d tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:50:05.155567 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-d8b01c37-a418-456c-a8e4-32fd9198695d tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:50:05.156741 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-d8b01c37-a418-456c-a8e4-32fd9198695d tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672" status: 200 len: 1748 microversion: 2.20 time: 0.146280 Oct 27 15:50:05.157293 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 606/1142] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Oct 27 15:50:05 2021] GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672 => generated 1748 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 15:50:05.434866 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-47e2583d-9c65-4694-8c63-8420fe2e0924 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:50:05.435683 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-47e2583d-9c65-4694-8c63-8420fe2e0924 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: 62c89161-c119-48b2-839d-712db798ff96] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:50:05.441473 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-47e2583d-9c65-4694-8c63-8420fe2e0924 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:50:05.441908 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-47e2583d-9c65-4694-8c63-8420fe2e0924 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:50:05.442663 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-47e2583d-9c65-4694-8c63-8420fe2e0924 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:50:05.443092 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-47e2583d-9c65-4694-8c63-8420fe2e0924 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:50:05.475237 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-47e2583d-9c65-4694-8c63-8420fe2e0924 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044153 Oct 27 15:50:05.475867 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 537/1143] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Oct 27 15:50:05 2021] GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 15:50:05.873182 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-dd6fe8d1-7fbe-44d5-9d3a-396470b6bcee tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:50:05.873787 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-dd6fe8d1-7fbe-44d5-9d3a-396470b6bcee tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] [instance: a79303e6-05ad-4901-96b7-ce845b4016f4] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:50:05.879615 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-dd6fe8d1-7fbe-44d5-9d3a-396470b6bcee tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:50:05.880084 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-dd6fe8d1-7fbe-44d5-9d3a-396470b6bcee tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:50:05.880841 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-dd6fe8d1-7fbe-44d5-9d3a-396470b6bcee tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:50:05.881263 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-dd6fe8d1-7fbe-44d5-9d3a-396470b6bcee tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:50:05.945144 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-dd6fe8d1-7fbe-44d5-9d3a-396470b6bcee tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c757a383a434a4c9b1b928087af8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8818377e744d4f6ba65560705c191f0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:50:05.952563 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-dd6fe8d1-7fbe-44d5-9d3a-396470b6bcee tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] 10.222.0.64 "GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4" status: 200 len: 1226 microversion: 2.1 time: 0.083046 Oct 27 15:50:05.953123 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 607/1144] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:50:05 2021] GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4 => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 15:50:06.175249 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-b52fa965-4ba8-47b6-9d54-c7dacaf84afc tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:50:06.175785 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-b52fa965-4ba8-47b6-9d54-c7dacaf84afc tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:50:06.182082 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-b52fa965-4ba8-47b6-9d54-c7dacaf84afc tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:50:06.182527 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-b52fa965-4ba8-47b6-9d54-c7dacaf84afc tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:50:06.183307 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-b52fa965-4ba8-47b6-9d54-c7dacaf84afc tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:50:06.183738 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-b52fa965-4ba8-47b6-9d54-c7dacaf84afc tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:50:06.303362 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-b52fa965-4ba8-47b6-9d54-c7dacaf84afc tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:50:06.311951 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-b52fa965-4ba8-47b6-9d54-c7dacaf84afc tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:50:06.313444 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-b52fa965-4ba8-47b6-9d54-c7dacaf84afc tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:50:06.314604 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-b52fa965-4ba8-47b6-9d54-c7dacaf84afc tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672" status: 200 len: 1748 microversion: 2.20 time: 0.143130 Oct 27 15:50:06.315146 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 538/1145] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Oct 27 15:50:06 2021] GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672 => generated 1748 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 15:50:06.486538 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-d61c7e65-b652-4b6a-8cde-e963c66373a9 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:50:06.487440 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-d61c7e65-b652-4b6a-8cde-e963c66373a9 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: 62c89161-c119-48b2-839d-712db798ff96] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:50:06.493693 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-d61c7e65-b652-4b6a-8cde-e963c66373a9 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:50:06.494132 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-d61c7e65-b652-4b6a-8cde-e963c66373a9 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:50:06.494886 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-d61c7e65-b652-4b6a-8cde-e963c66373a9 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:50:06.495310 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-d61c7e65-b652-4b6a-8cde-e963c66373a9 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:50:06.524153 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-d61c7e65-b652-4b6a-8cde-e963c66373a9 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041389 Oct 27 15:50:06.524698 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 608/1146] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Oct 27 15:50:06 2021] GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 15:50:06.969576 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-e36eaa67-9944-42c3-a69e-11382c866e6a tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:50:06.970175 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-e36eaa67-9944-42c3-a69e-11382c866e6a tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] [instance: a79303e6-05ad-4901-96b7-ce845b4016f4] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:50:06.976514 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-e36eaa67-9944-42c3-a69e-11382c866e6a tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:50:06.976985 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-e36eaa67-9944-42c3-a69e-11382c866e6a tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:50:06.977752 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-e36eaa67-9944-42c3-a69e-11382c866e6a tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:50:06.978213 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-e36eaa67-9944-42c3-a69e-11382c866e6a tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:50:07.037447 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-e36eaa67-9944-42c3-a69e-11382c866e6a tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c757a383a434a4c9b1b928087af8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8818377e744d4f6ba65560705c191f0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:50:07.044958 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-e36eaa67-9944-42c3-a69e-11382c866e6a tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] 10.222.0.64 "GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4" status: 200 len: 1226 microversion: 2.1 time: 0.079326 Oct 27 15:50:07.045522 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 539/1147] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:50:06 2021] GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4 => generated 1226 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 15:50:07.332537 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-fcdab806-f5e6-4411-9088-e6f8bf9ee86b tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:50:07.333136 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-fcdab806-f5e6-4411-9088-e6f8bf9ee86b tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:50:07.339658 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-fcdab806-f5e6-4411-9088-e6f8bf9ee86b tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:50:07.340134 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-fcdab806-f5e6-4411-9088-e6f8bf9ee86b tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:50:07.340890 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-fcdab806-f5e6-4411-9088-e6f8bf9ee86b tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:50:07.341326 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-fcdab806-f5e6-4411-9088-e6f8bf9ee86b tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:50:07.458808 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-fcdab806-f5e6-4411-9088-e6f8bf9ee86b tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:50:07.478280 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-fcdab806-f5e6-4411-9088-e6f8bf9ee86b tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:50:07.479801 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-fcdab806-f5e6-4411-9088-e6f8bf9ee86b tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:50:07.481015 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-fcdab806-f5e6-4411-9088-e6f8bf9ee86b tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672" status: 200 len: 1748 microversion: 2.20 time: 0.152308 Oct 27 15:50:07.481576 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 609/1148] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Oct 27 15:50:07 2021] GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672 => generated 1748 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 15:50:07.535432 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-d322613d-ff44-48dc-ba68-ed408597e139 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:50:07.536365 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-d322613d-ff44-48dc-ba68-ed408597e139 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: 62c89161-c119-48b2-839d-712db798ff96] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:50:07.543083 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-d322613d-ff44-48dc-ba68-ed408597e139 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:50:07.543603 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-d322613d-ff44-48dc-ba68-ed408597e139 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:50:07.544405 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-d322613d-ff44-48dc-ba68-ed408597e139 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:50:07.544834 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-d322613d-ff44-48dc-ba68-ed408597e139 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:50:07.573752 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-d322613d-ff44-48dc-ba68-ed408597e139 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042098 Oct 27 15:50:07.574300 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 540/1149] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Oct 27 15:50:07 2021] GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 15:50:08.061520 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-36e24cea-e024-4f25-b32f-6c9800f88b53 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:50:08.062121 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-36e24cea-e024-4f25-b32f-6c9800f88b53 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] [instance: a79303e6-05ad-4901-96b7-ce845b4016f4] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:50:08.068286 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-36e24cea-e024-4f25-b32f-6c9800f88b53 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:50:08.068739 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-36e24cea-e024-4f25-b32f-6c9800f88b53 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:50:08.070085 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-36e24cea-e024-4f25-b32f-6c9800f88b53 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:50:08.070674 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-36e24cea-e024-4f25-b32f-6c9800f88b53 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:50:08.129195 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-36e24cea-e024-4f25-b32f-6c9800f88b53 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c757a383a434a4c9b1b928087af8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8818377e744d4f6ba65560705c191f0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:50:08.137148 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-36e24cea-e024-4f25-b32f-6c9800f88b53 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] 10.222.0.64 "GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4" status: 200 len: 1226 microversion: 2.1 time: 0.079257 Oct 27 15:50:08.137770 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 610/1150] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:50:08 2021] GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4 => generated 1226 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 15:50:08.498905 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-ccf8744a-1fd2-491b-a6c9-cee3bad5c98a tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:50:08.499520 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-ccf8744a-1fd2-491b-a6c9-cee3bad5c98a tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:50:08.505357 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-ccf8744a-1fd2-491b-a6c9-cee3bad5c98a tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:50:08.505801 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-ccf8744a-1fd2-491b-a6c9-cee3bad5c98a tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:50:08.506563 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-ccf8744a-1fd2-491b-a6c9-cee3bad5c98a tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:50:08.507017 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-ccf8744a-1fd2-491b-a6c9-cee3bad5c98a tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:50:08.584915 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-38fbb752-1c4d-473e-9048-b9f052f58975 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:50:08.586419 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-38fbb752-1c4d-473e-9048-b9f052f58975 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: 62c89161-c119-48b2-839d-712db798ff96] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:50:08.592386 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-38fbb752-1c4d-473e-9048-b9f052f58975 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:50:08.592825 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-38fbb752-1c4d-473e-9048-b9f052f58975 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:50:08.593614 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-38fbb752-1c4d-473e-9048-b9f052f58975 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:50:08.594308 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-38fbb752-1c4d-473e-9048-b9f052f58975 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:50:08.626021 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-38fbb752-1c4d-473e-9048-b9f052f58975 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044918 Oct 27 15:50:08.626581 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 611/1151] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Oct 27 15:50:08 2021] GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 15:50:08.629332 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-ccf8744a-1fd2-491b-a6c9-cee3bad5c98a tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:50:08.638885 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-ccf8744a-1fd2-491b-a6c9-cee3bad5c98a tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:50:08.640425 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-ccf8744a-1fd2-491b-a6c9-cee3bad5c98a tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:50:08.641565 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-ccf8744a-1fd2-491b-a6c9-cee3bad5c98a tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672" status: 200 len: 1748 microversion: 2.20 time: 0.146513 Oct 27 15:50:08.642111 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 541/1152] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Oct 27 15:50:08 2021] GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672 => generated 1748 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 15:50:09.154457 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-fe875abc-7ebb-4bbe-8140-18bf914063fc tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:50:09.155070 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-fe875abc-7ebb-4bbe-8140-18bf914063fc tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] [instance: a79303e6-05ad-4901-96b7-ce845b4016f4] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:50:09.161297 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-fe875abc-7ebb-4bbe-8140-18bf914063fc tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:50:09.161740 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-fe875abc-7ebb-4bbe-8140-18bf914063fc tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:50:09.162507 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-fe875abc-7ebb-4bbe-8140-18bf914063fc tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:50:09.162938 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-fe875abc-7ebb-4bbe-8140-18bf914063fc tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:50:09.222969 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-fe875abc-7ebb-4bbe-8140-18bf914063fc tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c757a383a434a4c9b1b928087af8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8818377e744d4f6ba65560705c191f0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:50:09.230399 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-fe875abc-7ebb-4bbe-8140-18bf914063fc tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] 10.222.0.64 "GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4" status: 200 len: 1226 microversion: 2.1 time: 0.079596 Oct 27 15:50:09.230963 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 612/1153] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:50:09 2021] GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4 => generated 1226 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 15:50:09.638009 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-7174c1a6-1df7-4637-b2ca-ebb4cd967ec1 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:50:09.638820 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-7174c1a6-1df7-4637-b2ca-ebb4cd967ec1 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: 62c89161-c119-48b2-839d-712db798ff96] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:50:09.644863 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-7174c1a6-1df7-4637-b2ca-ebb4cd967ec1 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:50:09.645304 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-7174c1a6-1df7-4637-b2ca-ebb4cd967ec1 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:50:09.646058 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-7174c1a6-1df7-4637-b2ca-ebb4cd967ec1 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:50:09.646482 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-7174c1a6-1df7-4637-b2ca-ebb4cd967ec1 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:50:09.660452 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-c0d8a62a-77d6-458e-8be6-f8cdaa47be84 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:50:09.660452 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-c0d8a62a-77d6-458e-8be6-f8cdaa47be84 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:50:09.666908 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-c0d8a62a-77d6-458e-8be6-f8cdaa47be84 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:50:09.667352 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-c0d8a62a-77d6-458e-8be6-f8cdaa47be84 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:50:09.668159 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-c0d8a62a-77d6-458e-8be6-f8cdaa47be84 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:50:09.668593 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-c0d8a62a-77d6-458e-8be6-f8cdaa47be84 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:50:09.680667 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-7174c1a6-1df7-4637-b2ca-ebb4cd967ec1 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046402 Oct 27 15:50:09.684284 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 542/1154] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Oct 27 15:50:09 2021] GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 15:50:09.794702 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-c0d8a62a-77d6-458e-8be6-f8cdaa47be84 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:50:09.803540 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-c0d8a62a-77d6-458e-8be6-f8cdaa47be84 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:50:09.805168 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-c0d8a62a-77d6-458e-8be6-f8cdaa47be84 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:50:09.806318 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-c0d8a62a-77d6-458e-8be6-f8cdaa47be84 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672" status: 200 len: 1748 microversion: 2.20 time: 0.150509 Oct 27 15:50:09.806872 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 613/1155] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Oct 27 15:50:09 2021] GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672 => generated 1748 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 15:50:10.246503 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-1f465f5e-2ebd-45af-9d48-e5d6fdc84e9f tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:50:10.247102 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-1f465f5e-2ebd-45af-9d48-e5d6fdc84e9f tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] [instance: a79303e6-05ad-4901-96b7-ce845b4016f4] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:50:10.252924 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-1f465f5e-2ebd-45af-9d48-e5d6fdc84e9f tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:50:10.253365 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-1f465f5e-2ebd-45af-9d48-e5d6fdc84e9f tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:50:10.254123 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-1f465f5e-2ebd-45af-9d48-e5d6fdc84e9f tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:50:10.254552 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-1f465f5e-2ebd-45af-9d48-e5d6fdc84e9f tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:50:10.321855 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-1f465f5e-2ebd-45af-9d48-e5d6fdc84e9f tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c757a383a434a4c9b1b928087af8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8818377e744d4f6ba65560705c191f0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:50:10.329316 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-1f465f5e-2ebd-45af-9d48-e5d6fdc84e9f tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] 10.222.0.64 "GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4" status: 200 len: 1226 microversion: 2.1 time: 0.086494 Oct 27 15:50:10.329872 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 543/1156] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:50:10 2021] GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4 => generated 1226 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 15:50:10.695686 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-41ffba27-4ea8-4d95-bf20-994eb9260de9 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:50:10.697250 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-41ffba27-4ea8-4d95-bf20-994eb9260de9 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: 62c89161-c119-48b2-839d-712db798ff96] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:50:10.704116 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-41ffba27-4ea8-4d95-bf20-994eb9260de9 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:50:10.704563 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-41ffba27-4ea8-4d95-bf20-994eb9260de9 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:50:10.705343 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-41ffba27-4ea8-4d95-bf20-994eb9260de9 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:50:10.705775 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-41ffba27-4ea8-4d95-bf20-994eb9260de9 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:50:10.738018 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-41ffba27-4ea8-4d95-bf20-994eb9260de9 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047221 Oct 27 15:50:10.738589 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 614/1157] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Oct 27 15:50:10 2021] GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 15:50:10.824227 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-6c639c21-30f2-48fb-8c7e-89b194596920 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:50:10.824825 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-6c639c21-30f2-48fb-8c7e-89b194596920 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:50:10.830914 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-6c639c21-30f2-48fb-8c7e-89b194596920 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:50:10.831367 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-6c639c21-30f2-48fb-8c7e-89b194596920 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:50:10.832150 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-6c639c21-30f2-48fb-8c7e-89b194596920 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:50:10.832581 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-6c639c21-30f2-48fb-8c7e-89b194596920 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:50:10.952639 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-6c639c21-30f2-48fb-8c7e-89b194596920 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:50:10.961152 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-6c639c21-30f2-48fb-8c7e-89b194596920 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:50:10.962645 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-6c639c21-30f2-48fb-8c7e-89b194596920 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:50:10.963797 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-6c639c21-30f2-48fb-8c7e-89b194596920 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672" status: 200 len: 1748 microversion: 2.20 time: 0.143298 Oct 27 15:50:10.964379 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 544/1158] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Oct 27 15:50:10 2021] GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672 => generated 1748 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 15:50:11.350717 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-d06548dd-771a-4654-86af-d57b7a769ec5 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:50:11.351354 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-d06548dd-771a-4654-86af-d57b7a769ec5 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] [instance: a79303e6-05ad-4901-96b7-ce845b4016f4] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:50:11.357250 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-d06548dd-771a-4654-86af-d57b7a769ec5 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:50:11.357703 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-d06548dd-771a-4654-86af-d57b7a769ec5 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:50:11.358466 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-d06548dd-771a-4654-86af-d57b7a769ec5 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:50:11.358896 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-d06548dd-771a-4654-86af-d57b7a769ec5 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:50:11.418518 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-d06548dd-771a-4654-86af-d57b7a769ec5 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c757a383a434a4c9b1b928087af8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8818377e744d4f6ba65560705c191f0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:50:11.425816 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-d06548dd-771a-4654-86af-d57b7a769ec5 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] 10.222.0.64 "GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4" status: 200 len: 1226 microversion: 2.1 time: 0.079003 Oct 27 15:50:11.426386 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 615/1159] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:50:11 2021] GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4 => generated 1226 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 15:50:11.749807 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-918179a8-b4b7-444b-99ff-7d70898a8d3e tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:50:11.750739 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-918179a8-b4b7-444b-99ff-7d70898a8d3e tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: 62c89161-c119-48b2-839d-712db798ff96] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:50:11.756544 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-918179a8-b4b7-444b-99ff-7d70898a8d3e tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:50:11.757111 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-918179a8-b4b7-444b-99ff-7d70898a8d3e tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:50:11.757884 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-918179a8-b4b7-444b-99ff-7d70898a8d3e tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:50:11.758310 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-918179a8-b4b7-444b-99ff-7d70898a8d3e tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:50:11.786138 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-918179a8-b4b7-444b-99ff-7d70898a8d3e tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040098 Oct 27 15:50:11.786684 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 545/1160] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Oct 27 15:50:11 2021] GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 15:50:11.982884 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-795ecb4b-ace1-4853-9a2e-04b6a7823fca tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:50:11.983564 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-795ecb4b-ace1-4853-9a2e-04b6a7823fca tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:50:11.990579 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-795ecb4b-ace1-4853-9a2e-04b6a7823fca tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:50:11.991149 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-795ecb4b-ace1-4853-9a2e-04b6a7823fca tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:50:11.992146 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-795ecb4b-ace1-4853-9a2e-04b6a7823fca tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:50:11.992647 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-795ecb4b-ace1-4853-9a2e-04b6a7823fca tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:50:12.120682 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-795ecb4b-ace1-4853-9a2e-04b6a7823fca tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:50:12.128766 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-795ecb4b-ace1-4853-9a2e-04b6a7823fca tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:50:12.130258 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-795ecb4b-ace1-4853-9a2e-04b6a7823fca tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:50:12.131406 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-795ecb4b-ace1-4853-9a2e-04b6a7823fca tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672" status: 200 len: 1748 microversion: 2.20 time: 0.153275 Oct 27 15:50:12.132743 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 616/1161] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Oct 27 15:50:11 2021] GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672 => generated 1748 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 15:50:12.444045 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-1c0e8500-10e7-4071-99bb-e2070991c0a2 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:50:12.444732 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-1c0e8500-10e7-4071-99bb-e2070991c0a2 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] [instance: a79303e6-05ad-4901-96b7-ce845b4016f4] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:50:12.451669 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-1c0e8500-10e7-4071-99bb-e2070991c0a2 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:50:12.452138 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-1c0e8500-10e7-4071-99bb-e2070991c0a2 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:50:12.452906 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-1c0e8500-10e7-4071-99bb-e2070991c0a2 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:50:12.453330 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-1c0e8500-10e7-4071-99bb-e2070991c0a2 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:50:12.513747 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-1c0e8500-10e7-4071-99bb-e2070991c0a2 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c757a383a434a4c9b1b928087af8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8818377e744d4f6ba65560705c191f0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:50:12.521211 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-1c0e8500-10e7-4071-99bb-e2070991c0a2 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] 10.222.0.64 "GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4" status: 200 len: 1226 microversion: 2.1 time: 0.081048 Oct 27 15:50:12.521771 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 546/1162] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:50:12 2021] GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4 => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 15:50:12.798555 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-18e1c7b4-37cc-4730-83be-859455460848 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:50:12.799491 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-18e1c7b4-37cc-4730-83be-859455460848 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: 62c89161-c119-48b2-839d-712db798ff96] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:50:12.805476 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-18e1c7b4-37cc-4730-83be-859455460848 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:50:12.805918 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-18e1c7b4-37cc-4730-83be-859455460848 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:50:12.806687 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-18e1c7b4-37cc-4730-83be-859455460848 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:50:12.807121 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-18e1c7b4-37cc-4730-83be-859455460848 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:50:12.835579 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-18e1c7b4-37cc-4730-83be-859455460848 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040344 Oct 27 15:50:12.836175 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 617/1163] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Oct 27 15:50:12 2021] GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 15:50:13.151287 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-6d079177-fbc6-4b62-99c7-b78520a8df69 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:50:13.151795 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-6d079177-fbc6-4b62-99c7-b78520a8df69 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:50:13.157598 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-6d079177-fbc6-4b62-99c7-b78520a8df69 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:50:13.158037 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-6d079177-fbc6-4b62-99c7-b78520a8df69 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:50:13.158786 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-6d079177-fbc6-4b62-99c7-b78520a8df69 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:50:13.159212 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-6d079177-fbc6-4b62-99c7-b78520a8df69 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:50:13.285474 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-6d079177-fbc6-4b62-99c7-b78520a8df69 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:50:13.294459 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-6d079177-fbc6-4b62-99c7-b78520a8df69 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:50:13.295943 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-6d079177-fbc6-4b62-99c7-b78520a8df69 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:50:13.297077 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-6d079177-fbc6-4b62-99c7-b78520a8df69 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672" status: 200 len: 1748 microversion: 2.20 time: 0.149601 Oct 27 15:50:13.297651 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 547/1164] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Oct 27 15:50:13 2021] GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672 => generated 1748 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 15:50:13.537851 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-6585aa56-8916-4999-b5fe-e9cc97b25aec tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:50:13.538495 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-6585aa56-8916-4999-b5fe-e9cc97b25aec tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] [instance: a79303e6-05ad-4901-96b7-ce845b4016f4] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:50:13.544554 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-6585aa56-8916-4999-b5fe-e9cc97b25aec tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:50:13.544978 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-6585aa56-8916-4999-b5fe-e9cc97b25aec tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:50:13.545736 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-6585aa56-8916-4999-b5fe-e9cc97b25aec tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:50:13.546167 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-6585aa56-8916-4999-b5fe-e9cc97b25aec tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:50:13.605842 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-6585aa56-8916-4999-b5fe-e9cc97b25aec tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c757a383a434a4c9b1b928087af8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8818377e744d4f6ba65560705c191f0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:50:13.613178 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-6585aa56-8916-4999-b5fe-e9cc97b25aec tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] 10.222.0.64 "GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4" status: 200 len: 1226 microversion: 2.1 time: 0.079022 Oct 27 15:50:13.613740 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 618/1165] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:50:13 2021] GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4 => generated 1226 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 15:50:13.847419 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-372e7236-4d03-4559-a465-47c9c2fc956c tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:50:13.848246 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-372e7236-4d03-4559-a465-47c9c2fc956c tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: 62c89161-c119-48b2-839d-712db798ff96] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:50:13.855100 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-372e7236-4d03-4559-a465-47c9c2fc956c tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:50:13.855535 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-372e7236-4d03-4559-a465-47c9c2fc956c tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:50:13.856322 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-372e7236-4d03-4559-a465-47c9c2fc956c tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:50:13.856747 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-372e7236-4d03-4559-a465-47c9c2fc956c tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:50:13.886636 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-372e7236-4d03-4559-a465-47c9c2fc956c tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043286 Oct 27 15:50:13.887500 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 548/1166] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Oct 27 15:50:13 2021] GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 15:50:14.315752 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-2cd910e7-9c46-42e1-87b8-633eeda8b468 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:50:14.316387 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-2cd910e7-9c46-42e1-87b8-633eeda8b468 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:50:14.322731 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-2cd910e7-9c46-42e1-87b8-633eeda8b468 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:50:14.323175 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-2cd910e7-9c46-42e1-87b8-633eeda8b468 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:50:14.323976 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-2cd910e7-9c46-42e1-87b8-633eeda8b468 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:50:14.324414 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-2cd910e7-9c46-42e1-87b8-633eeda8b468 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:50:14.447430 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-2cd910e7-9c46-42e1-87b8-633eeda8b468 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:50:14.455549 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-2cd910e7-9c46-42e1-87b8-633eeda8b468 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:50:14.457063 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-2cd910e7-9c46-42e1-87b8-633eeda8b468 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:50:14.458230 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-2cd910e7-9c46-42e1-87b8-633eeda8b468 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672" status: 200 len: 1748 microversion: 2.20 time: 0.146204 Oct 27 15:50:14.458774 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 619/1167] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Oct 27 15:50:14 2021] GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672 => generated 1748 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 15:50:14.631032 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-f2234af5-6989-4e9f-ad85-9f7bacaf8c00 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:50:14.631553 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-f2234af5-6989-4e9f-ad85-9f7bacaf8c00 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] [instance: a79303e6-05ad-4901-96b7-ce845b4016f4] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:50:14.637516 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-f2234af5-6989-4e9f-ad85-9f7bacaf8c00 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:50:14.638322 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-f2234af5-6989-4e9f-ad85-9f7bacaf8c00 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:50:14.639094 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-f2234af5-6989-4e9f-ad85-9f7bacaf8c00 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:50:14.639526 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-f2234af5-6989-4e9f-ad85-9f7bacaf8c00 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:50:14.700775 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-f2234af5-6989-4e9f-ad85-9f7bacaf8c00 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c757a383a434a4c9b1b928087af8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8818377e744d4f6ba65560705c191f0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:50:14.708133 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-f2234af5-6989-4e9f-ad85-9f7bacaf8c00 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] 10.222.0.64 "GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4" status: 200 len: 1226 microversion: 2.1 time: 0.081099 Oct 27 15:50:14.708706 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 549/1168] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:50:14 2021] GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4 => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 15:50:14.898912 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-40e0f9bd-7807-4f6a-a997-77c570f7fa7c tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:50:14.899713 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-40e0f9bd-7807-4f6a-a997-77c570f7fa7c tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: 62c89161-c119-48b2-839d-712db798ff96] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:50:14.906024 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-40e0f9bd-7807-4f6a-a997-77c570f7fa7c tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:50:14.906463 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-40e0f9bd-7807-4f6a-a997-77c570f7fa7c tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:50:14.907233 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-40e0f9bd-7807-4f6a-a997-77c570f7fa7c tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:50:14.907664 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-40e0f9bd-7807-4f6a-a997-77c570f7fa7c tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:50:14.938631 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-40e0f9bd-7807-4f6a-a997-77c570f7fa7c tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044137 Oct 27 15:50:14.939194 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 620/1169] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Oct 27 15:50:14 2021] GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 15:50:15.476957 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-ff5eb9e0-a8c6-425e-ac67-d939cf508e37 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:50:15.477567 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-ff5eb9e0-a8c6-425e-ac67-d939cf508e37 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:50:15.484292 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-ff5eb9e0-a8c6-425e-ac67-d939cf508e37 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:50:15.484736 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-ff5eb9e0-a8c6-425e-ac67-d939cf508e37 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:50:15.485506 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-ff5eb9e0-a8c6-425e-ac67-d939cf508e37 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:50:15.485962 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-ff5eb9e0-a8c6-425e-ac67-d939cf508e37 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:50:15.614029 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-ff5eb9e0-a8c6-425e-ac67-d939cf508e37 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:50:15.622824 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-ff5eb9e0-a8c6-425e-ac67-d939cf508e37 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:50:15.624356 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-ff5eb9e0-a8c6-425e-ac67-d939cf508e37 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:50:15.625518 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-ff5eb9e0-a8c6-425e-ac67-d939cf508e37 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672" status: 200 len: 1748 microversion: 2.20 time: 0.152286 Oct 27 15:50:15.626071 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 550/1170] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Oct 27 15:50:15 2021] GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672 => generated 1748 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 15:50:15.726758 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-d5c0b5da-8189-4d2e-a0da-39c28bb12c49 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:50:15.727419 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-d5c0b5da-8189-4d2e-a0da-39c28bb12c49 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] [instance: a79303e6-05ad-4901-96b7-ce845b4016f4] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:50:15.733271 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-d5c0b5da-8189-4d2e-a0da-39c28bb12c49 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:50:15.733709 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-d5c0b5da-8189-4d2e-a0da-39c28bb12c49 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:50:15.734469 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-d5c0b5da-8189-4d2e-a0da-39c28bb12c49 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:50:15.734897 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-d5c0b5da-8189-4d2e-a0da-39c28bb12c49 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:50:15.795625 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-d5c0b5da-8189-4d2e-a0da-39c28bb12c49 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c757a383a434a4c9b1b928087af8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8818377e744d4f6ba65560705c191f0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:50:15.803000 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-d5c0b5da-8189-4d2e-a0da-39c28bb12c49 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] 10.222.0.64 "GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4" status: 200 len: 1226 microversion: 2.1 time: 0.080698 Oct 27 15:50:15.804075 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 621/1171] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:50:15 2021] GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4 => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 15:50:15.950143 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-b9f800eb-6791-4438-ab09-01fc1d4a6bf9 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:50:15.951044 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-b9f800eb-6791-4438-ab09-01fc1d4a6bf9 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: 62c89161-c119-48b2-839d-712db798ff96] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:50:15.956932 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-b9f800eb-6791-4438-ab09-01fc1d4a6bf9 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:50:15.957374 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-b9f800eb-6791-4438-ab09-01fc1d4a6bf9 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:50:15.958134 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-b9f800eb-6791-4438-ab09-01fc1d4a6bf9 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:50:15.958562 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-b9f800eb-6791-4438-ab09-01fc1d4a6bf9 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:50:15.988403 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-b9f800eb-6791-4438-ab09-01fc1d4a6bf9 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041828 Oct 27 15:50:15.988875 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 551/1172] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Oct 27 15:50:15 2021] GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 15:50:16.644972 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-eb229308-417e-4c06-b71f-b0c5d2654fc5 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:50:16.645885 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-eb229308-417e-4c06-b71f-b0c5d2654fc5 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:50:16.653445 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-eb229308-417e-4c06-b71f-b0c5d2654fc5 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:50:16.653891 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-eb229308-417e-4c06-b71f-b0c5d2654fc5 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:50:16.654670 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-eb229308-417e-4c06-b71f-b0c5d2654fc5 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:50:16.655110 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-eb229308-417e-4c06-b71f-b0c5d2654fc5 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:50:16.777499 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-eb229308-417e-4c06-b71f-b0c5d2654fc5 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:50:16.785856 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-eb229308-417e-4c06-b71f-b0c5d2654fc5 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:50:16.787361 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-eb229308-417e-4c06-b71f-b0c5d2654fc5 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:50:16.788574 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-eb229308-417e-4c06-b71f-b0c5d2654fc5 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672" status: 200 len: 1748 microversion: 2.20 time: 0.147653 Oct 27 15:50:16.789123 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 622/1173] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Oct 27 15:50:16 2021] GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672 => generated 1748 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 15:50:16.820377 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-0b02dc13-bb32-4d60-bbeb-749b99b77079 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:50:16.821007 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-0b02dc13-bb32-4d60-bbeb-749b99b77079 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] [instance: a79303e6-05ad-4901-96b7-ce845b4016f4] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:50:16.827348 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-0b02dc13-bb32-4d60-bbeb-749b99b77079 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:50:16.827821 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-0b02dc13-bb32-4d60-bbeb-749b99b77079 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:50:16.828639 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-0b02dc13-bb32-4d60-bbeb-749b99b77079 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:50:16.829070 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-0b02dc13-bb32-4d60-bbeb-749b99b77079 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:50:16.890851 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-0b02dc13-bb32-4d60-bbeb-749b99b77079 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c757a383a434a4c9b1b928087af8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8818377e744d4f6ba65560705c191f0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:50:16.898532 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-0b02dc13-bb32-4d60-bbeb-749b99b77079 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] 10.222.0.64 "GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4" status: 200 len: 1226 microversion: 2.1 time: 0.082210 Oct 27 15:50:16.899023 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 552/1174] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:50:16 2021] GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4 => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 15:50:16.999734 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-5f85162c-502b-4b49-8d9d-02ef61990156 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:50:17.000687 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-5f85162c-502b-4b49-8d9d-02ef61990156 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: 62c89161-c119-48b2-839d-712db798ff96] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:50:17.006642 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-5f85162c-502b-4b49-8d9d-02ef61990156 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:50:17.007090 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-5f85162c-502b-4b49-8d9d-02ef61990156 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:50:17.007969 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-5f85162c-502b-4b49-8d9d-02ef61990156 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:50:17.008411 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-5f85162c-502b-4b49-8d9d-02ef61990156 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:50:17.037064 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-5f85162c-502b-4b49-8d9d-02ef61990156 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041054 Oct 27 15:50:17.037624 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 623/1175] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Oct 27 15:50:16 2021] GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 15:50:17.807191 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-274a3816-b196-483f-bb8b-6b8023407e34 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:50:17.807793 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-274a3816-b196-483f-bb8b-6b8023407e34 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:50:17.813691 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-274a3816-b196-483f-bb8b-6b8023407e34 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:50:17.814154 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-274a3816-b196-483f-bb8b-6b8023407e34 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:50:17.814896 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-274a3816-b196-483f-bb8b-6b8023407e34 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:50:17.815325 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-274a3816-b196-483f-bb8b-6b8023407e34 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:50:17.914632 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-dda3b9de-0d2f-4547-898b-8e877d8debb2 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:50:17.915353 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-dda3b9de-0d2f-4547-898b-8e877d8debb2 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] [instance: a79303e6-05ad-4901-96b7-ce845b4016f4] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:50:17.921777 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-dda3b9de-0d2f-4547-898b-8e877d8debb2 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:50:17.922226 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-dda3b9de-0d2f-4547-898b-8e877d8debb2 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:50:17.923007 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-dda3b9de-0d2f-4547-898b-8e877d8debb2 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:50:17.923466 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-dda3b9de-0d2f-4547-898b-8e877d8debb2 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:50:17.942721 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-274a3816-b196-483f-bb8b-6b8023407e34 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:50:17.953968 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-274a3816-b196-483f-bb8b-6b8023407e34 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:50:17.955454 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-274a3816-b196-483f-bb8b-6b8023407e34 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:50:17.956649 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-274a3816-b196-483f-bb8b-6b8023407e34 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672" status: 200 len: 1748 microversion: 2.20 time: 0.153740 Oct 27 15:50:17.957195 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 553/1176] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Oct 27 15:50:17 2021] GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672 => generated 1748 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 15:50:17.991887 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-dda3b9de-0d2f-4547-898b-8e877d8debb2 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c757a383a434a4c9b1b928087af8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8818377e744d4f6ba65560705c191f0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:50:17.999537 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-dda3b9de-0d2f-4547-898b-8e877d8debb2 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] 10.222.0.64 "GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4" status: 200 len: 1226 microversion: 2.1 time: 0.088866 Oct 27 15:50:18.000145 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 624/1177] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:50:17 2021] GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4 => generated 1226 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 15:50:18.049329 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-b53bfac0-d7fd-437f-840a-f72adda4a7f4 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:50:18.050225 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-b53bfac0-d7fd-437f-840a-f72adda4a7f4 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: 62c89161-c119-48b2-839d-712db798ff96] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:50:18.056794 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-b53bfac0-d7fd-437f-840a-f72adda4a7f4 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:50:18.057283 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-b53bfac0-d7fd-437f-840a-f72adda4a7f4 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:50:18.057998 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-b53bfac0-d7fd-437f-840a-f72adda4a7f4 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:50:18.058418 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-b53bfac0-d7fd-437f-840a-f72adda4a7f4 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:50:18.087414 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-b53bfac0-d7fd-437f-840a-f72adda4a7f4 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041939 Oct 27 15:50:18.088010 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 554/1178] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Oct 27 15:50:18 2021] GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 15:50:18.976870 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-2959ef40-e4e7-4f95-9946-37a894e2c588 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:50:18.977466 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-2959ef40-e4e7-4f95-9946-37a894e2c588 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:50:18.983663 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-2959ef40-e4e7-4f95-9946-37a894e2c588 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:50:18.984129 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-2959ef40-e4e7-4f95-9946-37a894e2c588 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:50:18.984894 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-2959ef40-e4e7-4f95-9946-37a894e2c588 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:50:18.985324 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-2959ef40-e4e7-4f95-9946-37a894e2c588 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:50:19.016469 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-ca5d3caa-4b60-414e-ba8d-a4252d369dd3 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:50:19.017342 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-ca5d3caa-4b60-414e-ba8d-a4252d369dd3 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] [instance: a79303e6-05ad-4901-96b7-ce845b4016f4] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:50:19.023290 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-ca5d3caa-4b60-414e-ba8d-a4252d369dd3 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:50:19.023732 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-ca5d3caa-4b60-414e-ba8d-a4252d369dd3 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:50:19.024526 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-ca5d3caa-4b60-414e-ba8d-a4252d369dd3 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:50:19.024959 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-ca5d3caa-4b60-414e-ba8d-a4252d369dd3 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:50:19.087224 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-ca5d3caa-4b60-414e-ba8d-a4252d369dd3 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c757a383a434a4c9b1b928087af8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8818377e744d4f6ba65560705c191f0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:50:19.094699 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-ca5d3caa-4b60-414e-ba8d-a4252d369dd3 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] 10.222.0.64 "GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4" status: 200 len: 1226 microversion: 2.1 time: 0.081808 Oct 27 15:50:19.095549 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 555/1179] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:50:19 2021] GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4 => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 15:50:19.099757 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-b7dae5bb-f78a-4c9c-a897-842ea4cfa43a tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:50:19.101167 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-b7dae5bb-f78a-4c9c-a897-842ea4cfa43a tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: 62c89161-c119-48b2-839d-712db798ff96] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:50:19.106988 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-b7dae5bb-f78a-4c9c-a897-842ea4cfa43a tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:50:19.107434 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-b7dae5bb-f78a-4c9c-a897-842ea4cfa43a tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:50:19.108236 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-b7dae5bb-f78a-4c9c-a897-842ea4cfa43a tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:50:19.109503 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-b7dae5bb-f78a-4c9c-a897-842ea4cfa43a tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:50:19.111232 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-2959ef40-e4e7-4f95-9946-37a894e2c588 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:50:19.120021 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-2959ef40-e4e7-4f95-9946-37a894e2c588 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:50:19.121517 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-2959ef40-e4e7-4f95-9946-37a894e2c588 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:50:19.122674 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-2959ef40-e4e7-4f95-9946-37a894e2c588 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672" status: 200 len: 1748 microversion: 2.20 time: 0.150637 Oct 27 15:50:19.123224 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 625/1180] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Oct 27 15:50:18 2021] GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672 => generated 1748 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 15:50:19.141432 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-b7dae5bb-f78a-4c9c-a897-842ea4cfa43a tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044939 Oct 27 15:50:19.142165 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 556/1181] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Oct 27 15:50:19 2021] GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 15:50:20.112679 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-032d5a95-bbf8-409b-aa33-95a1dfc4912a tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:50:20.113273 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-032d5a95-bbf8-409b-aa33-95a1dfc4912a tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] [instance: a79303e6-05ad-4901-96b7-ce845b4016f4] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:50:20.120255 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-032d5a95-bbf8-409b-aa33-95a1dfc4912a tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:50:20.120699 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-032d5a95-bbf8-409b-aa33-95a1dfc4912a tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:50:20.121465 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-032d5a95-bbf8-409b-aa33-95a1dfc4912a tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:50:20.121899 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-032d5a95-bbf8-409b-aa33-95a1dfc4912a tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:50:20.142749 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-f9d41160-1c8f-4f6f-b267-24c841ea7f2f tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:50:20.143438 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-f9d41160-1c8f-4f6f-b267-24c841ea7f2f tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:50:20.150908 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-f9d41160-1c8f-4f6f-b267-24c841ea7f2f tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:50:20.151421 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-f9d41160-1c8f-4f6f-b267-24c841ea7f2f tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:50:20.152507 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-f9d41160-1c8f-4f6f-b267-24c841ea7f2f tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:50:20.153255 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-f9d41160-1c8f-4f6f-b267-24c841ea7f2f tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:50:20.189765 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-032d5a95-bbf8-409b-aa33-95a1dfc4912a tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c757a383a434a4c9b1b928087af8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8818377e744d4f6ba65560705c191f0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:50:20.198274 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-032d5a95-bbf8-409b-aa33-95a1dfc4912a tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] 10.222.0.64 "GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4" status: 200 len: 1226 microversion: 2.1 time: 0.089291 Oct 27 15:50:20.198842 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 626/1182] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:50:20 2021] GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4 => generated 1226 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 15:50:20.203233 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-3e315be3-fee1-495b-9e28-6c6e542d12cb tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:50:20.204295 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-3e315be3-fee1-495b-9e28-6c6e542d12cb tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: 62c89161-c119-48b2-839d-712db798ff96] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:50:20.210251 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-3e315be3-fee1-495b-9e28-6c6e542d12cb tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:50:20.210860 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-3e315be3-fee1-495b-9e28-6c6e542d12cb tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:50:20.211644 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-3e315be3-fee1-495b-9e28-6c6e542d12cb tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:50:20.212104 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-3e315be3-fee1-495b-9e28-6c6e542d12cb tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:50:20.242676 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-3e315be3-fee1-495b-9e28-6c6e542d12cb tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042775 Oct 27 15:50:20.243256 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 627/1183] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Oct 27 15:50:20 2021] GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 15:50:20.292741 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-f9d41160-1c8f-4f6f-b267-24c841ea7f2f tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:50:20.303398 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-f9d41160-1c8f-4f6f-b267-24c841ea7f2f tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:50:20.305659 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-f9d41160-1c8f-4f6f-b267-24c841ea7f2f tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:50:20.306807 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-f9d41160-1c8f-4f6f-b267-24c841ea7f2f tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672" status: 200 len: 1748 microversion: 2.20 time: 0.167850 Oct 27 15:50:20.307352 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 557/1184] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Oct 27 15:50:20 2021] GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672 => generated 1748 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 15:50:21.221275 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-12f0eaed-501b-4217-a48b-d32f6904d136 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:50:21.221883 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-12f0eaed-501b-4217-a48b-d32f6904d136 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] [instance: a79303e6-05ad-4901-96b7-ce845b4016f4] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:50:21.228269 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-12f0eaed-501b-4217-a48b-d32f6904d136 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:50:21.228717 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-12f0eaed-501b-4217-a48b-d32f6904d136 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:50:21.229494 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-12f0eaed-501b-4217-a48b-d32f6904d136 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:50:21.229927 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-12f0eaed-501b-4217-a48b-d32f6904d136 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:50:21.254041 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-16a3192c-e3a3-4aaa-b51c-41d1c69cc835 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:50:21.254980 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-16a3192c-e3a3-4aaa-b51c-41d1c69cc835 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: 62c89161-c119-48b2-839d-712db798ff96] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:50:21.262159 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-16a3192c-e3a3-4aaa-b51c-41d1c69cc835 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:50:21.262599 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-16a3192c-e3a3-4aaa-b51c-41d1c69cc835 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:50:21.263373 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-16a3192c-e3a3-4aaa-b51c-41d1c69cc835 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:50:21.263825 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-16a3192c-e3a3-4aaa-b51c-41d1c69cc835 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:50:21.292076 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-12f0eaed-501b-4217-a48b-d32f6904d136 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c757a383a434a4c9b1b928087af8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8818377e744d4f6ba65560705c191f0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:50:21.294465 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-16a3192c-e3a3-4aaa-b51c-41d1c69cc835 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044127 Oct 27 15:50:21.295102 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 558/1185] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Oct 27 15:50:21 2021] GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 15:50:21.300601 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-12f0eaed-501b-4217-a48b-d32f6904d136 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] 10.222.0.64 "GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4" status: 200 len: 1226 microversion: 2.1 time: 0.083358 Oct 27 15:50:21.301163 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 628/1186] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:50:21 2021] GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4 => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 15:50:21.325779 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-69a8072b-6763-4b10-9c8a-92aff0f8bc57 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:50:21.326407 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-69a8072b-6763-4b10-9c8a-92aff0f8bc57 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:50:21.332190 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-69a8072b-6763-4b10-9c8a-92aff0f8bc57 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:50:21.332630 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-69a8072b-6763-4b10-9c8a-92aff0f8bc57 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:50:21.333385 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-69a8072b-6763-4b10-9c8a-92aff0f8bc57 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:50:21.333809 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-69a8072b-6763-4b10-9c8a-92aff0f8bc57 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:50:21.457825 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-69a8072b-6763-4b10-9c8a-92aff0f8bc57 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:50:21.466653 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-69a8072b-6763-4b10-9c8a-92aff0f8bc57 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:50:21.468151 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-69a8072b-6763-4b10-9c8a-92aff0f8bc57 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:50:21.469553 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-69a8072b-6763-4b10-9c8a-92aff0f8bc57 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672" status: 200 len: 1748 microversion: 2.20 time: 0.147460 Oct 27 15:50:21.470102 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 559/1187] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Oct 27 15:50:21 2021] GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672 => generated 1748 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 15:50:22.306643 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-c9a732bb-7de4-4a3a-aa80-fb82c70723a1 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:50:22.307559 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-c9a732bb-7de4-4a3a-aa80-fb82c70723a1 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: 62c89161-c119-48b2-839d-712db798ff96] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:50:22.313595 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-c9a732bb-7de4-4a3a-aa80-fb82c70723a1 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:50:22.314048 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-c9a732bb-7de4-4a3a-aa80-fb82c70723a1 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:50:22.314827 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-c9a732bb-7de4-4a3a-aa80-fb82c70723a1 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:50:22.315253 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-c9a732bb-7de4-4a3a-aa80-fb82c70723a1 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:50:22.317562 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-87931c95-380f-4b67-a629-3aee6fc63e41 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:50:22.318215 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-87931c95-380f-4b67-a629-3aee6fc63e41 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] [instance: a79303e6-05ad-4901-96b7-ce845b4016f4] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:50:22.324991 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-87931c95-380f-4b67-a629-3aee6fc63e41 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:50:22.325427 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-87931c95-380f-4b67-a629-3aee6fc63e41 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:50:22.326183 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-87931c95-380f-4b67-a629-3aee6fc63e41 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:50:22.326606 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-87931c95-380f-4b67-a629-3aee6fc63e41 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:50:22.345790 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-c9a732bb-7de4-4a3a-aa80-fb82c70723a1 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043644 Oct 27 15:50:22.346362 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 629/1188] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Oct 27 15:50:22 2021] GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 15:50:22.390481 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-87931c95-380f-4b67-a629-3aee6fc63e41 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c757a383a434a4c9b1b928087af8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8818377e744d4f6ba65560705c191f0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:50:22.398122 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-87931c95-380f-4b67-a629-3aee6fc63e41 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] 10.222.0.64 "GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4" status: 200 len: 1226 microversion: 2.1 time: 0.084329 Oct 27 15:50:22.398681 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 560/1189] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:50:22 2021] GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4 => generated 1226 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 15:50:22.487780 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-108a31eb-3123-48b1-b525-2932794314d4 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:50:22.488410 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-108a31eb-3123-48b1-b525-2932794314d4 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:50:22.494791 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-108a31eb-3123-48b1-b525-2932794314d4 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:50:22.495238 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-108a31eb-3123-48b1-b525-2932794314d4 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:50:22.496035 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-108a31eb-3123-48b1-b525-2932794314d4 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:50:22.496472 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-108a31eb-3123-48b1-b525-2932794314d4 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:50:22.619366 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-108a31eb-3123-48b1-b525-2932794314d4 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:50:22.627635 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-108a31eb-3123-48b1-b525-2932794314d4 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:50:22.629234 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-108a31eb-3123-48b1-b525-2932794314d4 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:50:22.630393 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-108a31eb-3123-48b1-b525-2932794314d4 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672" status: 200 len: 1748 microversion: 2.20 time: 0.146378 Oct 27 15:50:22.630939 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 630/1190] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Oct 27 15:50:22 2021] GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672 => generated 1748 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 15:50:23.357924 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-c64905b2-a58d-4059-848c-d889bd0688cb tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:50:23.358820 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-c64905b2-a58d-4059-848c-d889bd0688cb tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: 62c89161-c119-48b2-839d-712db798ff96] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:50:23.366347 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-c64905b2-a58d-4059-848c-d889bd0688cb tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:50:23.367136 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-c64905b2-a58d-4059-848c-d889bd0688cb tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:50:23.368508 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-c64905b2-a58d-4059-848c-d889bd0688cb tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:50:23.369294 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-c64905b2-a58d-4059-848c-d889bd0688cb tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:50:23.398496 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-c64905b2-a58d-4059-848c-d889bd0688cb tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044375 Oct 27 15:50:23.399052 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 561/1191] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Oct 27 15:50:23 2021] GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 15:50:23.414417 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-3fa3a868-85c2-48e1-aad9-5573fccf1b46 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:50:23.415035 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-3fa3a868-85c2-48e1-aad9-5573fccf1b46 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] [instance: a79303e6-05ad-4901-96b7-ce845b4016f4] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:50:23.421398 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-3fa3a868-85c2-48e1-aad9-5573fccf1b46 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:50:23.421845 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-3fa3a868-85c2-48e1-aad9-5573fccf1b46 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:50:23.422611 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-3fa3a868-85c2-48e1-aad9-5573fccf1b46 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:50:23.423050 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-3fa3a868-85c2-48e1-aad9-5573fccf1b46 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:50:23.483939 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-3fa3a868-85c2-48e1-aad9-5573fccf1b46 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c757a383a434a4c9b1b928087af8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8818377e744d4f6ba65560705c191f0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:50:23.491785 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-3fa3a868-85c2-48e1-aad9-5573fccf1b46 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] 10.222.0.64 "GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4" status: 200 len: 1226 microversion: 2.1 time: 0.081268 Oct 27 15:50:23.492391 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 631/1192] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:50:23 2021] GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4 => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 15:50:23.649591 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-2d091e55-113a-4d85-a39b-754918bd75c1 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:50:23.650084 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-2d091e55-113a-4d85-a39b-754918bd75c1 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:50:23.655920 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-2d091e55-113a-4d85-a39b-754918bd75c1 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:50:23.656365 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-2d091e55-113a-4d85-a39b-754918bd75c1 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:50:23.657140 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-2d091e55-113a-4d85-a39b-754918bd75c1 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:50:23.657569 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-2d091e55-113a-4d85-a39b-754918bd75c1 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:50:23.777857 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-2d091e55-113a-4d85-a39b-754918bd75c1 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:50:23.786105 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-2d091e55-113a-4d85-a39b-754918bd75c1 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:50:23.788175 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-2d091e55-113a-4d85-a39b-754918bd75c1 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:50:23.789343 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-2d091e55-113a-4d85-a39b-754918bd75c1 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672" status: 200 len: 1748 microversion: 2.20 time: 0.143906 Oct 27 15:50:23.789896 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 562/1193] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Oct 27 15:50:23 2021] GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672 => generated 1748 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 15:50:24.410253 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-f042ed33-e10b-4f8e-9573-8f1203b95e0c tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:50:24.411155 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-f042ed33-e10b-4f8e-9573-8f1203b95e0c tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: 62c89161-c119-48b2-839d-712db798ff96] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:50:24.417152 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-f042ed33-e10b-4f8e-9573-8f1203b95e0c tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:50:24.417785 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-f042ed33-e10b-4f8e-9573-8f1203b95e0c tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:50:24.418342 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-f042ed33-e10b-4f8e-9573-8f1203b95e0c tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:50:24.418777 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-f042ed33-e10b-4f8e-9573-8f1203b95e0c tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:50:24.447465 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-f042ed33-e10b-4f8e-9573-8f1203b95e0c tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041038 Oct 27 15:50:24.448046 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 632/1194] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Oct 27 15:50:24 2021] GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 15:50:24.507953 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-9b0415b0-1a39-468f-91b9-bedb65aad4f7 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:50:24.508560 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-9b0415b0-1a39-468f-91b9-bedb65aad4f7 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] [instance: a79303e6-05ad-4901-96b7-ce845b4016f4] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:50:24.514720 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-9b0415b0-1a39-468f-91b9-bedb65aad4f7 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:50:24.515166 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-9b0415b0-1a39-468f-91b9-bedb65aad4f7 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:50:24.515950 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-9b0415b0-1a39-468f-91b9-bedb65aad4f7 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:50:24.516385 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-9b0415b0-1a39-468f-91b9-bedb65aad4f7 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:50:24.575429 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-9b0415b0-1a39-468f-91b9-bedb65aad4f7 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c757a383a434a4c9b1b928087af8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8818377e744d4f6ba65560705c191f0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:50:24.582718 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-9b0415b0-1a39-468f-91b9-bedb65aad4f7 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] 10.222.0.64 "GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4" status: 200 len: 1226 microversion: 2.1 time: 0.078968 Oct 27 15:50:24.583271 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 563/1195] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:50:24 2021] GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4 => generated 1226 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 15:50:24.807317 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-470f48ed-e4c1-4047-b6fc-86701673a600 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:50:24.807945 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-470f48ed-e4c1-4047-b6fc-86701673a600 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:50:24.813697 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-470f48ed-e4c1-4047-b6fc-86701673a600 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:50:24.814141 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-470f48ed-e4c1-4047-b6fc-86701673a600 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:50:24.814899 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-470f48ed-e4c1-4047-b6fc-86701673a600 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:50:24.815328 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-470f48ed-e4c1-4047-b6fc-86701673a600 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:50:24.936176 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-470f48ed-e4c1-4047-b6fc-86701673a600 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:50:24.944918 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-470f48ed-e4c1-4047-b6fc-86701673a600 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:50:24.946413 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-470f48ed-e4c1-4047-b6fc-86701673a600 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:50:24.947549 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-470f48ed-e4c1-4047-b6fc-86701673a600 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672" status: 200 len: 1748 microversion: 2.20 time: 0.144070 Oct 27 15:50:24.948139 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 633/1196] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Oct 27 15:50:24 2021] GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672 => generated 1748 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 15:50:25.458886 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-94f854eb-856c-491a-bfd2-9d3b2c4ba282 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:50:25.460306 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-94f854eb-856c-491a-bfd2-9d3b2c4ba282 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: 62c89161-c119-48b2-839d-712db798ff96] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:50:25.466206 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-94f854eb-856c-491a-bfd2-9d3b2c4ba282 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:50:25.466646 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-94f854eb-856c-491a-bfd2-9d3b2c4ba282 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:50:25.467412 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-94f854eb-856c-491a-bfd2-9d3b2c4ba282 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:50:25.467839 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-94f854eb-856c-491a-bfd2-9d3b2c4ba282 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:50:25.497130 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-94f854eb-856c-491a-bfd2-9d3b2c4ba282 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041982 Oct 27 15:50:25.497684 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 564/1197] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Oct 27 15:50:25 2021] GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 15:50:25.599961 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-4a412699-0f78-41b1-b59b-c48b6898f002 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:50:25.601264 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-4a412699-0f78-41b1-b59b-c48b6898f002 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] [instance: a79303e6-05ad-4901-96b7-ce845b4016f4] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:50:25.607519 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-4a412699-0f78-41b1-b59b-c48b6898f002 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:50:25.607993 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-4a412699-0f78-41b1-b59b-c48b6898f002 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:50:25.608810 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-4a412699-0f78-41b1-b59b-c48b6898f002 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:50:25.609244 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-4a412699-0f78-41b1-b59b-c48b6898f002 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:50:25.669345 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-4a412699-0f78-41b1-b59b-c48b6898f002 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c757a383a434a4c9b1b928087af8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8818377e744d4f6ba65560705c191f0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:50:25.676821 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-4a412699-0f78-41b1-b59b-c48b6898f002 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] 10.222.0.64 "GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4" status: 200 len: 1226 microversion: 2.1 time: 0.080562 Oct 27 15:50:25.677398 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 634/1198] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:50:25 2021] GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4 => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 15:50:25.964519 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-c69d6d95-671a-48f3-b96f-17f3f5c36d5f tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:50:25.965124 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-c69d6d95-671a-48f3-b96f-17f3f5c36d5f tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:50:25.971174 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-c69d6d95-671a-48f3-b96f-17f3f5c36d5f tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:50:25.971616 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-c69d6d95-671a-48f3-b96f-17f3f5c36d5f tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:50:25.972401 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-c69d6d95-671a-48f3-b96f-17f3f5c36d5f tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:50:25.972831 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-c69d6d95-671a-48f3-b96f-17f3f5c36d5f tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:50:26.097295 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-c69d6d95-671a-48f3-b96f-17f3f5c36d5f tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:50:26.106205 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-c69d6d95-671a-48f3-b96f-17f3f5c36d5f tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:50:26.107717 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-c69d6d95-671a-48f3-b96f-17f3f5c36d5f tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:50:26.108879 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-c69d6d95-671a-48f3-b96f-17f3f5c36d5f tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672" status: 200 len: 1748 microversion: 2.20 time: 0.148096 Oct 27 15:50:26.109431 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 565/1199] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Oct 27 15:50:25 2021] GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672 => generated 1748 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 15:50:26.508573 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-a25ffe58-1d8a-4e9d-a4eb-725c5673a767 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:50:26.509535 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-a25ffe58-1d8a-4e9d-a4eb-725c5673a767 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: 62c89161-c119-48b2-839d-712db798ff96] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:50:26.515402 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-a25ffe58-1d8a-4e9d-a4eb-725c5673a767 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:50:26.515873 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-a25ffe58-1d8a-4e9d-a4eb-725c5673a767 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:50:26.516634 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-a25ffe58-1d8a-4e9d-a4eb-725c5673a767 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:50:26.517068 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-a25ffe58-1d8a-4e9d-a4eb-725c5673a767 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:50:26.545407 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-a25ffe58-1d8a-4e9d-a4eb-725c5673a767 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040502 Oct 27 15:50:26.545881 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 635/1200] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Oct 27 15:50:26 2021] GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 15:50:26.694282 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-4dbf4fa8-9e71-46a8-a008-1f32bf7f97f5 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:50:26.694885 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-4dbf4fa8-9e71-46a8-a008-1f32bf7f97f5 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] [instance: a79303e6-05ad-4901-96b7-ce845b4016f4] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:50:26.701282 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-4dbf4fa8-9e71-46a8-a008-1f32bf7f97f5 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:50:26.701839 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-4dbf4fa8-9e71-46a8-a008-1f32bf7f97f5 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:50:26.703055 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-4dbf4fa8-9e71-46a8-a008-1f32bf7f97f5 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:50:26.703784 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-4dbf4fa8-9e71-46a8-a008-1f32bf7f97f5 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:50:26.770367 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-4dbf4fa8-9e71-46a8-a008-1f32bf7f97f5 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c757a383a434a4c9b1b928087af8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8818377e744d4f6ba65560705c191f0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:50:26.778099 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-4dbf4fa8-9e71-46a8-a008-1f32bf7f97f5 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] 10.222.0.64 "GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4" status: 200 len: 1226 microversion: 2.1 time: 0.087767 Oct 27 15:50:26.778663 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 566/1201] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:50:26 2021] GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4 => generated 1226 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 15:50:27.126865 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-433e15db-f92a-4450-8e2f-cdab5cecb404 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:50:27.127466 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-433e15db-f92a-4450-8e2f-cdab5cecb404 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:50:27.134678 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-433e15db-f92a-4450-8e2f-cdab5cecb404 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:50:27.135118 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-433e15db-f92a-4450-8e2f-cdab5cecb404 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:50:27.135894 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-433e15db-f92a-4450-8e2f-cdab5cecb404 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:50:27.136325 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-433e15db-f92a-4450-8e2f-cdab5cecb404 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:50:27.260101 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-433e15db-f92a-4450-8e2f-cdab5cecb404 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:50:27.268852 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-433e15db-f92a-4450-8e2f-cdab5cecb404 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:50:27.270349 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-433e15db-f92a-4450-8e2f-cdab5cecb404 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:50:27.271501 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-433e15db-f92a-4450-8e2f-cdab5cecb404 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672" status: 200 len: 1748 microversion: 2.20 time: 0.148417 Oct 27 15:50:27.272753 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 636/1202] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Oct 27 15:50:27 2021] GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672 => generated 1748 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 15:50:27.557348 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-75ab8a45-f80d-411f-956c-a3fa990623de tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:50:27.558166 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-75ab8a45-f80d-411f-956c-a3fa990623de tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: 62c89161-c119-48b2-839d-712db798ff96] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:50:27.564029 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-75ab8a45-f80d-411f-956c-a3fa990623de tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:50:27.564473 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-75ab8a45-f80d-411f-956c-a3fa990623de tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:50:27.565230 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-75ab8a45-f80d-411f-956c-a3fa990623de tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:50:27.565663 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-75ab8a45-f80d-411f-956c-a3fa990623de tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:50:27.594572 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-75ab8a45-f80d-411f-956c-a3fa990623de tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041566 Oct 27 15:50:27.595132 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 567/1203] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Oct 27 15:50:27 2021] GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 15:50:27.794922 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-c56cf496-772d-41e0-adc2-f432b44feae6 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:50:27.795540 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-c56cf496-772d-41e0-adc2-f432b44feae6 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] [instance: a79303e6-05ad-4901-96b7-ce845b4016f4] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:50:27.801342 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-c56cf496-772d-41e0-adc2-f432b44feae6 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:50:27.801784 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-c56cf496-772d-41e0-adc2-f432b44feae6 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:50:27.802544 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-c56cf496-772d-41e0-adc2-f432b44feae6 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:50:27.803015 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-c56cf496-772d-41e0-adc2-f432b44feae6 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:50:27.865068 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-c56cf496-772d-41e0-adc2-f432b44feae6 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c757a383a434a4c9b1b928087af8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8818377e744d4f6ba65560705c191f0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:50:27.875816 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-c56cf496-772d-41e0-adc2-f432b44feae6 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] 10.222.0.64 "GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4" status: 200 len: 1226 microversion: 2.1 time: 0.084423 Oct 27 15:50:27.876764 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 637/1204] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:50:27 2021] GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4 => generated 1226 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 15:50:28.292284 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-b74aa232-5d72-49f4-b38e-6036fd2e0ac3 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:50:28.293078 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-b74aa232-5d72-49f4-b38e-6036fd2e0ac3 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:50:28.299247 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-b74aa232-5d72-49f4-b38e-6036fd2e0ac3 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:50:28.299682 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-b74aa232-5d72-49f4-b38e-6036fd2e0ac3 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:50:28.300469 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-b74aa232-5d72-49f4-b38e-6036fd2e0ac3 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:50:28.300896 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-b74aa232-5d72-49f4-b38e-6036fd2e0ac3 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:50:28.434158 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-b74aa232-5d72-49f4-b38e-6036fd2e0ac3 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:50:28.442213 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-b74aa232-5d72-49f4-b38e-6036fd2e0ac3 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:50:28.444490 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-b74aa232-5d72-49f4-b38e-6036fd2e0ac3 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:50:28.445648 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-b74aa232-5d72-49f4-b38e-6036fd2e0ac3 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672" status: 200 len: 1748 microversion: 2.20 time: 0.158072 Oct 27 15:50:28.446203 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 568/1205] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Oct 27 15:50:28 2021] GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672 => generated 1748 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 15:50:28.606064 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-f988a523-ee05-4733-a132-035508b7a42d tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:50:28.606968 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-f988a523-ee05-4733-a132-035508b7a42d tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: 62c89161-c119-48b2-839d-712db798ff96] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:50:28.613185 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-f988a523-ee05-4733-a132-035508b7a42d tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:50:28.613630 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-f988a523-ee05-4733-a132-035508b7a42d tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:50:28.614398 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-f988a523-ee05-4733-a132-035508b7a42d tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:50:28.614831 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-f988a523-ee05-4733-a132-035508b7a42d tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:50:28.644647 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-f988a523-ee05-4733-a132-035508b7a42d tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042216 Oct 27 15:50:28.645112 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 638/1206] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Oct 27 15:50:28 2021] GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 15:50:28.988574 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-fd04c7c0-128c-4c58-9a70-6d6be9e0262f tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:50:28.989183 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-fd04c7c0-128c-4c58-9a70-6d6be9e0262f tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] [instance: a79303e6-05ad-4901-96b7-ce845b4016f4] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:50:28.995072 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-fd04c7c0-128c-4c58-9a70-6d6be9e0262f tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:50:28.995516 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-fd04c7c0-128c-4c58-9a70-6d6be9e0262f tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:50:28.996313 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-fd04c7c0-128c-4c58-9a70-6d6be9e0262f tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:50:28.996748 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-fd04c7c0-128c-4c58-9a70-6d6be9e0262f tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:50:29.058885 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-fd04c7c0-128c-4c58-9a70-6d6be9e0262f tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c757a383a434a4c9b1b928087af8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8818377e744d4f6ba65560705c191f0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:50:29.066189 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-fd04c7c0-128c-4c58-9a70-6d6be9e0262f tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] 10.222.0.64 "GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4" status: 200 len: 1226 microversion: 2.1 time: 0.177224 Oct 27 15:50:29.066757 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 569/1207] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:50:28 2021] GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4 => generated 1226 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 15:50:29.464434 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-895d7e89-6c51-4e3d-a59e-046cde6770c5 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:50:29.465038 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-895d7e89-6c51-4e3d-a59e-046cde6770c5 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:50:29.471139 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-895d7e89-6c51-4e3d-a59e-046cde6770c5 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:50:29.471581 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-895d7e89-6c51-4e3d-a59e-046cde6770c5 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:50:29.472370 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-895d7e89-6c51-4e3d-a59e-046cde6770c5 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:50:29.472797 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-895d7e89-6c51-4e3d-a59e-046cde6770c5 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:50:29.589682 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-895d7e89-6c51-4e3d-a59e-046cde6770c5 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:50:29.597961 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-895d7e89-6c51-4e3d-a59e-046cde6770c5 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:50:29.599453 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-895d7e89-6c51-4e3d-a59e-046cde6770c5 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:50:29.600714 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-895d7e89-6c51-4e3d-a59e-046cde6770c5 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672" status: 200 len: 1748 microversion: 2.20 time: 0.140044 Oct 27 15:50:29.601266 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 639/1208] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Oct 27 15:50:29 2021] GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672 => generated 1748 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 15:50:29.655975 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-35724f4b-2de6-4c2f-97e7-c3f374e18f1c tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:50:29.656928 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-35724f4b-2de6-4c2f-97e7-c3f374e18f1c tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: 62c89161-c119-48b2-839d-712db798ff96] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:50:29.663318 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-35724f4b-2de6-4c2f-97e7-c3f374e18f1c tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:50:29.663756 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-35724f4b-2de6-4c2f-97e7-c3f374e18f1c tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:50:29.664550 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-35724f4b-2de6-4c2f-97e7-c3f374e18f1c tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:50:29.664977 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-35724f4b-2de6-4c2f-97e7-c3f374e18f1c tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:50:29.695769 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-35724f4b-2de6-4c2f-97e7-c3f374e18f1c tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043596 Oct 27 15:50:29.696363 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 570/1209] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Oct 27 15:50:29 2021] GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 15:50:30.082296 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-69c67b02-c0bb-4e1e-b16a-072b47fc1e8c tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:50:30.082924 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-69c67b02-c0bb-4e1e-b16a-072b47fc1e8c tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] [instance: a79303e6-05ad-4901-96b7-ce845b4016f4] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:50:30.089222 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-69c67b02-c0bb-4e1e-b16a-072b47fc1e8c tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:50:30.089666 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-69c67b02-c0bb-4e1e-b16a-072b47fc1e8c tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:50:30.090422 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-69c67b02-c0bb-4e1e-b16a-072b47fc1e8c tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:50:30.090846 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-69c67b02-c0bb-4e1e-b16a-072b47fc1e8c tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:50:30.150831 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-69c67b02-c0bb-4e1e-b16a-072b47fc1e8c tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c757a383a434a4c9b1b928087af8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8818377e744d4f6ba65560705c191f0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:50:30.158059 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-69c67b02-c0bb-4e1e-b16a-072b47fc1e8c tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] 10.222.0.64 "GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4" status: 200 len: 1226 microversion: 2.1 time: 0.079487 Oct 27 15:50:30.158610 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 640/1210] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:50:30 2021] GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4 => generated 1226 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 15:50:30.618280 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-638467b3-52ff-46de-a0ba-4aec4a37e326 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:50:30.618898 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-638467b3-52ff-46de-a0ba-4aec4a37e326 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:50:30.624898 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-638467b3-52ff-46de-a0ba-4aec4a37e326 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:50:30.625339 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-638467b3-52ff-46de-a0ba-4aec4a37e326 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:50:30.626109 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-638467b3-52ff-46de-a0ba-4aec4a37e326 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:50:30.626538 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-638467b3-52ff-46de-a0ba-4aec4a37e326 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:50:30.707037 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-337f9ec5-c79a-4cb4-a049-5bac8bd7fd6c tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:50:30.708890 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-337f9ec5-c79a-4cb4-a049-5bac8bd7fd6c tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: 62c89161-c119-48b2-839d-712db798ff96] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:50:30.715216 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-337f9ec5-c79a-4cb4-a049-5bac8bd7fd6c tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:50:30.715805 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-337f9ec5-c79a-4cb4-a049-5bac8bd7fd6c tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:50:30.716678 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-337f9ec5-c79a-4cb4-a049-5bac8bd7fd6c tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:50:30.717113 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-337f9ec5-c79a-4cb4-a049-5bac8bd7fd6c tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:50:30.747796 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-337f9ec5-c79a-4cb4-a049-5bac8bd7fd6c tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044470 Oct 27 15:50:30.748406 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 641/1211] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Oct 27 15:50:30 2021] GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 15:50:30.752279 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-638467b3-52ff-46de-a0ba-4aec4a37e326 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:50:30.761647 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-638467b3-52ff-46de-a0ba-4aec4a37e326 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:50:30.763146 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-638467b3-52ff-46de-a0ba-4aec4a37e326 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:50:30.764336 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-638467b3-52ff-46de-a0ba-4aec4a37e326 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672" status: 200 len: 1748 microversion: 2.20 time: 0.150305 Oct 27 15:50:30.764922 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 571/1212] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Oct 27 15:50:30 2021] GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672 => generated 1748 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 15:50:31.174593 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-7acef695-4693-426a-8ac0-ccf1021f0941 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:50:31.175161 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-7acef695-4693-426a-8ac0-ccf1021f0941 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] [instance: a79303e6-05ad-4901-96b7-ce845b4016f4] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:50:31.181627 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-7acef695-4693-426a-8ac0-ccf1021f0941 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:50:31.182065 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-7acef695-4693-426a-8ac0-ccf1021f0941 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:50:31.182878 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-7acef695-4693-426a-8ac0-ccf1021f0941 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:50:31.183308 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-7acef695-4693-426a-8ac0-ccf1021f0941 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:50:31.248706 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-7acef695-4693-426a-8ac0-ccf1021f0941 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c757a383a434a4c9b1b928087af8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8818377e744d4f6ba65560705c191f0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:50:31.256634 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-7acef695-4693-426a-8ac0-ccf1021f0941 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] 10.222.0.64 "GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4" status: 200 len: 1226 microversion: 2.1 time: 0.085227 Oct 27 15:50:31.257269 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 642/1213] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:50:31 2021] GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4 => generated 1226 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 15:50:31.759259 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-8bb7d7d5-9e9e-4a8b-a5e2-51e612881936 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:50:31.760357 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-8bb7d7d5-9e9e-4a8b-a5e2-51e612881936 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: 62c89161-c119-48b2-839d-712db798ff96] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:50:31.767215 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-8bb7d7d5-9e9e-4a8b-a5e2-51e612881936 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:50:31.767663 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-8bb7d7d5-9e9e-4a8b-a5e2-51e612881936 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:50:31.768463 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-8bb7d7d5-9e9e-4a8b-a5e2-51e612881936 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:50:31.768897 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-8bb7d7d5-9e9e-4a8b-a5e2-51e612881936 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:50:31.782273 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-df2b4e49-9bee-45e2-bdb1-19cf1c8b4506 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:50:31.782872 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-df2b4e49-9bee-45e2-bdb1-19cf1c8b4506 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:50:31.789344 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-df2b4e49-9bee-45e2-bdb1-19cf1c8b4506 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:50:31.789785 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-df2b4e49-9bee-45e2-bdb1-19cf1c8b4506 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:50:31.790550 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-df2b4e49-9bee-45e2-bdb1-19cf1c8b4506 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:50:31.790986 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-df2b4e49-9bee-45e2-bdb1-19cf1c8b4506 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:50:31.799400 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-8bb7d7d5-9e9e-4a8b-a5e2-51e612881936 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043933 Oct 27 15:50:31.800004 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 572/1214] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Oct 27 15:50:31 2021] GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 15:50:31.916169 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-df2b4e49-9bee-45e2-bdb1-19cf1c8b4506 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:50:31.921680 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-df2b4e49-9bee-45e2-bdb1-19cf1c8b4506 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:50:31.923173 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-df2b4e49-9bee-45e2-bdb1-19cf1c8b4506 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:50:31.924364 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-df2b4e49-9bee-45e2-bdb1-19cf1c8b4506 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672" status: 200 len: 1748 microversion: 2.20 time: 0.145831 Oct 27 15:50:31.924921 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 643/1215] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Oct 27 15:50:31 2021] GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672 => generated 1748 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 15:50:32.273226 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-8609948c-900e-4348-8773-de4a93a59ead tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:50:32.273832 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-8609948c-900e-4348-8773-de4a93a59ead tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] [instance: a79303e6-05ad-4901-96b7-ce845b4016f4] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:50:32.279649 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-8609948c-900e-4348-8773-de4a93a59ead tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:50:32.280162 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-8609948c-900e-4348-8773-de4a93a59ead tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:50:32.281097 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-8609948c-900e-4348-8773-de4a93a59ead tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:50:32.281610 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-8609948c-900e-4348-8773-de4a93a59ead tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:50:32.340132 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-8609948c-900e-4348-8773-de4a93a59ead tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c757a383a434a4c9b1b928087af8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8818377e744d4f6ba65560705c191f0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:50:32.347564 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-8609948c-900e-4348-8773-de4a93a59ead tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] 10.222.0.64 "GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4" status: 200 len: 1226 microversion: 2.1 time: 0.078066 Oct 27 15:50:32.348166 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 573/1216] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:50:32 2021] GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4 => generated 1226 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 15:50:32.811531 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-d1bdab55-2b73-468c-9980-49844262bfe6 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:50:32.812590 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-d1bdab55-2b73-468c-9980-49844262bfe6 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: 62c89161-c119-48b2-839d-712db798ff96] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:50:32.818725 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-d1bdab55-2b73-468c-9980-49844262bfe6 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:50:32.819168 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-d1bdab55-2b73-468c-9980-49844262bfe6 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:50:32.820031 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-d1bdab55-2b73-468c-9980-49844262bfe6 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:50:32.820492 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-d1bdab55-2b73-468c-9980-49844262bfe6 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:50:32.849259 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-d1bdab55-2b73-468c-9980-49844262bfe6 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041476 Oct 27 15:50:32.849805 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 644/1217] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Oct 27 15:50:32 2021] GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 15:50:32.941576 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-e12ca6fe-c669-49eb-a8be-0097e1b347c2 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:50:32.942182 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-e12ca6fe-c669-49eb-a8be-0097e1b347c2 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:50:32.948445 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-e12ca6fe-c669-49eb-a8be-0097e1b347c2 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:50:32.948890 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-e12ca6fe-c669-49eb-a8be-0097e1b347c2 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:50:32.949652 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-e12ca6fe-c669-49eb-a8be-0097e1b347c2 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:50:32.950085 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-e12ca6fe-c669-49eb-a8be-0097e1b347c2 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:50:33.067231 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-e12ca6fe-c669-49eb-a8be-0097e1b347c2 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:50:33.075407 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-e12ca6fe-c669-49eb-a8be-0097e1b347c2 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:50:33.076963 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-e12ca6fe-c669-49eb-a8be-0097e1b347c2 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:50:33.078109 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-e12ca6fe-c669-49eb-a8be-0097e1b347c2 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672" status: 200 len: 1748 microversion: 2.20 time: 0.140305 Oct 27 15:50:33.078666 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 574/1218] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Oct 27 15:50:32 2021] GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672 => generated 1748 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 15:50:33.364246 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-6185f822-c8ae-43b6-ae02-8ba2e8f5581e tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:50:33.364768 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-6185f822-c8ae-43b6-ae02-8ba2e8f5581e tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] [instance: a79303e6-05ad-4901-96b7-ce845b4016f4] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:50:33.371625 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-6185f822-c8ae-43b6-ae02-8ba2e8f5581e tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:50:33.372172 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-6185f822-c8ae-43b6-ae02-8ba2e8f5581e tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:50:33.373052 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-6185f822-c8ae-43b6-ae02-8ba2e8f5581e tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:50:33.373482 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-6185f822-c8ae-43b6-ae02-8ba2e8f5581e tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:50:33.436108 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-6185f822-c8ae-43b6-ae02-8ba2e8f5581e tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c757a383a434a4c9b1b928087af8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8818377e744d4f6ba65560705c191f0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:50:33.443212 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-6185f822-c8ae-43b6-ae02-8ba2e8f5581e tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] 10.222.0.64 "GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4" status: 200 len: 1226 microversion: 2.1 time: 0.082766 Oct 27 15:50:33.443768 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 645/1219] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:50:33 2021] GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4 => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 15:50:33.860915 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-39d29f54-e4e8-4476-9224-3a1a3dcb2d1b tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:50:33.861812 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-39d29f54-e4e8-4476-9224-3a1a3dcb2d1b tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: 62c89161-c119-48b2-839d-712db798ff96] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:50:33.867611 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-39d29f54-e4e8-4476-9224-3a1a3dcb2d1b tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:50:33.868088 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-39d29f54-e4e8-4476-9224-3a1a3dcb2d1b tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:50:33.868838 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-39d29f54-e4e8-4476-9224-3a1a3dcb2d1b tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:50:33.869262 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-39d29f54-e4e8-4476-9224-3a1a3dcb2d1b tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:50:33.899168 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-39d29f54-e4e8-4476-9224-3a1a3dcb2d1b tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041039 Oct 27 15:50:33.899711 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 575/1220] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Oct 27 15:50:33 2021] GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 15:50:34.098064 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-d0423d49-9540-42f0-beed-9a4161681126 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:50:34.098621 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-d0423d49-9540-42f0-beed-9a4161681126 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:50:34.105044 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-d0423d49-9540-42f0-beed-9a4161681126 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:50:34.105492 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-d0423d49-9540-42f0-beed-9a4161681126 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:50:34.106262 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-d0423d49-9540-42f0-beed-9a4161681126 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:50:34.106697 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-d0423d49-9540-42f0-beed-9a4161681126 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:50:34.227434 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-d0423d49-9540-42f0-beed-9a4161681126 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:50:34.235684 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-d0423d49-9540-42f0-beed-9a4161681126 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:50:34.237222 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-d0423d49-9540-42f0-beed-9a4161681126 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:50:34.238378 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-d0423d49-9540-42f0-beed-9a4161681126 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672" status: 200 len: 1748 microversion: 2.20 time: 0.144226 Oct 27 15:50:34.238936 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 646/1221] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Oct 27 15:50:34 2021] GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672 => generated 1748 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 15:50:34.459892 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-d7060f8d-c968-4d4d-b700-68a613d4d2ff tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:50:34.460512 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-d7060f8d-c968-4d4d-b700-68a613d4d2ff tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] [instance: a79303e6-05ad-4901-96b7-ce845b4016f4] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:50:34.466975 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-d7060f8d-c968-4d4d-b700-68a613d4d2ff tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:50:34.467408 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-d7060f8d-c968-4d4d-b700-68a613d4d2ff tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:50:34.468258 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-d7060f8d-c968-4d4d-b700-68a613d4d2ff tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:50:34.468940 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-d7060f8d-c968-4d4d-b700-68a613d4d2ff tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:50:34.536121 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-d7060f8d-c968-4d4d-b700-68a613d4d2ff tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c757a383a434a4c9b1b928087af8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8818377e744d4f6ba65560705c191f0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:50:34.543737 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-d7060f8d-c968-4d4d-b700-68a613d4d2ff tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] 10.222.0.64 "GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4" status: 200 len: 1226 microversion: 2.1 time: 0.087507 Oct 27 15:50:34.544328 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 576/1222] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:50:34 2021] GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4 => generated 1226 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 15:50:34.910678 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-d46c7207-65b1-441b-8deb-82d11d578282 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:50:34.911573 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-d46c7207-65b1-441b-8deb-82d11d578282 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: 62c89161-c119-48b2-839d-712db798ff96] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:50:34.918044 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-d46c7207-65b1-441b-8deb-82d11d578282 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:50:34.918490 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-d46c7207-65b1-441b-8deb-82d11d578282 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:50:34.919730 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-d46c7207-65b1-441b-8deb-82d11d578282 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:50:34.919730 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-d46c7207-65b1-441b-8deb-82d11d578282 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:50:34.948220 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-d46c7207-65b1-441b-8deb-82d11d578282 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041313 Oct 27 15:50:34.948764 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 647/1223] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Oct 27 15:50:34 2021] GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 15:50:35.256242 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-b2a4593d-bc00-4753-a4ff-6edfaddcf149 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:50:35.256870 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-b2a4593d-bc00-4753-a4ff-6edfaddcf149 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:50:35.262653 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-b2a4593d-bc00-4753-a4ff-6edfaddcf149 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:50:35.263094 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-b2a4593d-bc00-4753-a4ff-6edfaddcf149 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:50:35.263864 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-b2a4593d-bc00-4753-a4ff-6edfaddcf149 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:50:35.264295 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-b2a4593d-bc00-4753-a4ff-6edfaddcf149 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:50:35.383542 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-b2a4593d-bc00-4753-a4ff-6edfaddcf149 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:50:35.391610 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-b2a4593d-bc00-4753-a4ff-6edfaddcf149 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:50:35.393136 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-b2a4593d-bc00-4753-a4ff-6edfaddcf149 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:50:35.394275 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-b2a4593d-bc00-4753-a4ff-6edfaddcf149 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672" status: 200 len: 1748 microversion: 2.20 time: 0.141767 Oct 27 15:50:35.394834 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 577/1224] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Oct 27 15:50:35 2021] GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672 => generated 1748 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 15:50:35.559274 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-8ae04d6d-6d20-4e9d-88f6-e7e0daa81826 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:50:35.559811 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-8ae04d6d-6d20-4e9d-88f6-e7e0daa81826 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] [instance: a79303e6-05ad-4901-96b7-ce845b4016f4] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:50:35.565934 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-8ae04d6d-6d20-4e9d-88f6-e7e0daa81826 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:50:35.566370 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-8ae04d6d-6d20-4e9d-88f6-e7e0daa81826 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:50:35.567122 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-8ae04d6d-6d20-4e9d-88f6-e7e0daa81826 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:50:35.567549 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-8ae04d6d-6d20-4e9d-88f6-e7e0daa81826 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:50:35.626036 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-8ae04d6d-6d20-4e9d-88f6-e7e0daa81826 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c757a383a434a4c9b1b928087af8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8818377e744d4f6ba65560705c191f0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:50:35.633845 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-8ae04d6d-6d20-4e9d-88f6-e7e0daa81826 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] 10.222.0.64 "GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4" status: 200 len: 1226 microversion: 2.1 time: 0.078311 Oct 27 15:50:35.634393 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 648/1225] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:50:35 2021] GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4 => generated 1226 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 15:50:35.959379 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-d611971f-430c-4220-9979-b2074203c7a1 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:50:35.960328 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-d611971f-430c-4220-9979-b2074203c7a1 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: 62c89161-c119-48b2-839d-712db798ff96] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:50:35.966680 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-d611971f-430c-4220-9979-b2074203c7a1 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:50:35.967117 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-d611971f-430c-4220-9979-b2074203c7a1 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:50:35.967893 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-d611971f-430c-4220-9979-b2074203c7a1 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:50:35.968324 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-d611971f-430c-4220-9979-b2074203c7a1 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:50:35.996681 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-d611971f-430c-4220-9979-b2074203c7a1 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041306 Oct 27 15:50:35.997225 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 578/1226] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Oct 27 15:50:35 2021] GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 15:50:36.412724 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-1b6e18d8-6b67-4776-89c8-70af1c012cdd tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:50:36.413323 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-1b6e18d8-6b67-4776-89c8-70af1c012cdd tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:50:36.419895 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-1b6e18d8-6b67-4776-89c8-70af1c012cdd tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:50:36.420339 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-1b6e18d8-6b67-4776-89c8-70af1c012cdd tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:50:36.421086 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-1b6e18d8-6b67-4776-89c8-70af1c012cdd tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:50:36.421515 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-1b6e18d8-6b67-4776-89c8-70af1c012cdd tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:50:36.541280 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-1b6e18d8-6b67-4776-89c8-70af1c012cdd tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:50:36.549282 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-1b6e18d8-6b67-4776-89c8-70af1c012cdd tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:50:36.550756 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-1b6e18d8-6b67-4776-89c8-70af1c012cdd tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:50:36.551924 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-1b6e18d8-6b67-4776-89c8-70af1c012cdd tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672" status: 200 len: 1748 microversion: 2.20 time: 0.142906 Oct 27 15:50:36.552477 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 649/1227] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Oct 27 15:50:36 2021] GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672 => generated 1748 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 15:50:36.650730 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-2daf51f0-6355-4f19-a5c4-c8b41adcf891 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:50:36.651331 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-2daf51f0-6355-4f19-a5c4-c8b41adcf891 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] [instance: a79303e6-05ad-4901-96b7-ce845b4016f4] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:50:36.657033 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-2daf51f0-6355-4f19-a5c4-c8b41adcf891 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:50:36.657478 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-2daf51f0-6355-4f19-a5c4-c8b41adcf891 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:50:36.658226 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-2daf51f0-6355-4f19-a5c4-c8b41adcf891 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:50:36.658655 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-2daf51f0-6355-4f19-a5c4-c8b41adcf891 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:50:36.717574 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-2daf51f0-6355-4f19-a5c4-c8b41adcf891 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c757a383a434a4c9b1b928087af8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8818377e744d4f6ba65560705c191f0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:50:36.725164 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-2daf51f0-6355-4f19-a5c4-c8b41adcf891 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] 10.222.0.64 "GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4" status: 200 len: 1226 microversion: 2.1 time: 0.078742 Oct 27 15:50:36.725728 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 579/1228] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:50:36 2021] GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4 => generated 1226 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 15:50:37.007155 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-d1cfde7c-0b50-4327-af24-bcbceda5e91e tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:50:37.008767 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-d1cfde7c-0b50-4327-af24-bcbceda5e91e tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: 62c89161-c119-48b2-839d-712db798ff96] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:50:37.014893 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-d1cfde7c-0b50-4327-af24-bcbceda5e91e tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:50:37.015320 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-d1cfde7c-0b50-4327-af24-bcbceda5e91e tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:50:37.016109 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-d1cfde7c-0b50-4327-af24-bcbceda5e91e tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:50:37.016534 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-d1cfde7c-0b50-4327-af24-bcbceda5e91e tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:50:37.044714 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-d1cfde7c-0b50-4327-af24-bcbceda5e91e tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041364 Oct 27 15:50:37.045251 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 650/1229] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Oct 27 15:50:37 2021] GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 15:50:37.571723 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-5921a1cd-c999-4750-8ada-05ac169e6693 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:50:37.572501 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-5921a1cd-c999-4750-8ada-05ac169e6693 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:50:37.579920 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-5921a1cd-c999-4750-8ada-05ac169e6693 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:50:37.580414 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-5921a1cd-c999-4750-8ada-05ac169e6693 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:50:37.581356 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-5921a1cd-c999-4750-8ada-05ac169e6693 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:50:37.581910 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-5921a1cd-c999-4750-8ada-05ac169e6693 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:50:37.703143 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-5921a1cd-c999-4750-8ada-05ac169e6693 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:50:37.711486 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-5921a1cd-c999-4750-8ada-05ac169e6693 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:50:37.713017 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-5921a1cd-c999-4750-8ada-05ac169e6693 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:50:37.714173 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-5921a1cd-c999-4750-8ada-05ac169e6693 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672" status: 200 len: 1748 microversion: 2.20 time: 0.148089 Oct 27 15:50:37.714720 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 580/1230] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Oct 27 15:50:37 2021] GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672 => generated 1748 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 15:50:37.743180 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-9d797cd3-4606-4e11-ad42-e9d74a96d5f7 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:50:37.743777 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-9d797cd3-4606-4e11-ad42-e9d74a96d5f7 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] [instance: a79303e6-05ad-4901-96b7-ce845b4016f4] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:50:37.749673 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-9d797cd3-4606-4e11-ad42-e9d74a96d5f7 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:50:37.750120 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-9d797cd3-4606-4e11-ad42-e9d74a96d5f7 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:50:37.750886 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-9d797cd3-4606-4e11-ad42-e9d74a96d5f7 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:50:37.751317 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-9d797cd3-4606-4e11-ad42-e9d74a96d5f7 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:50:37.814616 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-9d797cd3-4606-4e11-ad42-e9d74a96d5f7 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c757a383a434a4c9b1b928087af8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8818377e744d4f6ba65560705c191f0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:50:37.822187 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-9d797cd3-4606-4e11-ad42-e9d74a96d5f7 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] 10.222.0.64 "GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4" status: 200 len: 1226 microversion: 2.1 time: 0.083852 Oct 27 15:50:37.822684 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 651/1231] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:50:37 2021] GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4 => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 15:50:38.056325 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-3a7f19a6-ac55-4c78-8d28-9cc646267c66 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:50:38.057219 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-3a7f19a6-ac55-4c78-8d28-9cc646267c66 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: 62c89161-c119-48b2-839d-712db798ff96] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:50:38.063001 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-3a7f19a6-ac55-4c78-8d28-9cc646267c66 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:50:38.063437 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-3a7f19a6-ac55-4c78-8d28-9cc646267c66 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:50:38.064225 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-3a7f19a6-ac55-4c78-8d28-9cc646267c66 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:50:38.064648 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-3a7f19a6-ac55-4c78-8d28-9cc646267c66 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:50:38.094274 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-3a7f19a6-ac55-4c78-8d28-9cc646267c66 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041582 Oct 27 15:50:38.094752 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 581/1232] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Oct 27 15:50:38 2021] GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 15:50:38.734531 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-1c6b8983-e771-47ac-86ea-f7b07d73b7ad tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:50:38.735116 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-1c6b8983-e771-47ac-86ea-f7b07d73b7ad tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:50:38.741259 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-1c6b8983-e771-47ac-86ea-f7b07d73b7ad tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:50:38.741901 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-1c6b8983-e771-47ac-86ea-f7b07d73b7ad tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:50:38.742614 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-1c6b8983-e771-47ac-86ea-f7b07d73b7ad tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:50:38.743047 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-1c6b8983-e771-47ac-86ea-f7b07d73b7ad tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:50:38.838599 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-af0ee410-954d-43da-8ba6-31ba1715e8e9 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:50:38.839256 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-af0ee410-954d-43da-8ba6-31ba1715e8e9 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] [instance: a79303e6-05ad-4901-96b7-ce845b4016f4] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:50:38.845604 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-af0ee410-954d-43da-8ba6-31ba1715e8e9 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:50:38.846049 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-af0ee410-954d-43da-8ba6-31ba1715e8e9 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:50:38.846812 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-af0ee410-954d-43da-8ba6-31ba1715e8e9 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:50:38.847245 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-af0ee410-954d-43da-8ba6-31ba1715e8e9 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:50:38.862918 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-1c6b8983-e771-47ac-86ea-f7b07d73b7ad tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:50:38.871747 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-1c6b8983-e771-47ac-86ea-f7b07d73b7ad tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:50:38.873272 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-1c6b8983-e771-47ac-86ea-f7b07d73b7ad tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:50:38.874465 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-1c6b8983-e771-47ac-86ea-f7b07d73b7ad tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672" status: 200 len: 1748 microversion: 2.20 time: 0.143658 Oct 27 15:50:38.875021 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 652/1233] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Oct 27 15:50:38 2021] GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672 => generated 1748 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 15:50:38.911114 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-af0ee410-954d-43da-8ba6-31ba1715e8e9 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c757a383a434a4c9b1b928087af8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8818377e744d4f6ba65560705c191f0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:50:38.918733 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-af0ee410-954d-43da-8ba6-31ba1715e8e9 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] 10.222.0.64 "GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4" status: 200 len: 1226 microversion: 2.1 time: 0.084067 Oct 27 15:50:38.919689 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 582/1234] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:50:38 2021] GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4 => generated 1226 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 15:50:39.106560 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-684679e3-3dac-455e-b694-35ec3297ed66 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:50:39.107360 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-684679e3-3dac-455e-b694-35ec3297ed66 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: 62c89161-c119-48b2-839d-712db798ff96] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:50:39.113081 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-684679e3-3dac-455e-b694-35ec3297ed66 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:50:39.113520 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-684679e3-3dac-455e-b694-35ec3297ed66 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:50:39.114272 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-684679e3-3dac-455e-b694-35ec3297ed66 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:50:39.114696 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-684679e3-3dac-455e-b694-35ec3297ed66 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:50:39.143266 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-684679e3-3dac-455e-b694-35ec3297ed66 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040486 Oct 27 15:50:39.143811 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 653/1235] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Oct 27 15:50:39 2021] GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 15:50:39.893625 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-d9a58316-7d5f-431f-bff2-446256313b24 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:50:39.894274 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-d9a58316-7d5f-431f-bff2-446256313b24 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:50:39.901232 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-d9a58316-7d5f-431f-bff2-446256313b24 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:50:39.901678 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-d9a58316-7d5f-431f-bff2-446256313b24 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:50:39.902449 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-d9a58316-7d5f-431f-bff2-446256313b24 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:50:39.902885 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-d9a58316-7d5f-431f-bff2-446256313b24 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:50:39.935530 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-1929b900-fb67-4aa5-9619-57b6871d497c tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:50:39.936178 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-1929b900-fb67-4aa5-9619-57b6871d497c tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] [instance: a79303e6-05ad-4901-96b7-ce845b4016f4] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:50:39.942526 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-1929b900-fb67-4aa5-9619-57b6871d497c tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:50:39.942982 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-1929b900-fb67-4aa5-9619-57b6871d497c tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:50:39.943758 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-1929b900-fb67-4aa5-9619-57b6871d497c tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:50:39.944228 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-1929b900-fb67-4aa5-9619-57b6871d497c tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:50:40.004697 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-1929b900-fb67-4aa5-9619-57b6871d497c tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c757a383a434a4c9b1b928087af8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8818377e744d4f6ba65560705c191f0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:50:40.012754 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-1929b900-fb67-4aa5-9619-57b6871d497c tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] 10.222.0.64 "GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4" status: 200 len: 1226 microversion: 2.1 time: 0.080889 Oct 27 15:50:40.013323 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 654/1236] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:50:39 2021] GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4 => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 15:50:40.025169 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-d9a58316-7d5f-431f-bff2-446256313b24 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:50:40.033115 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-d9a58316-7d5f-431f-bff2-446256313b24 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:50:40.034587 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-d9a58316-7d5f-431f-bff2-446256313b24 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:50:40.035713 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-d9a58316-7d5f-431f-bff2-446256313b24 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672" status: 200 len: 1748 microversion: 2.20 time: 0.145909 Oct 27 15:50:40.036277 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 583/1237] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Oct 27 15:50:39 2021] GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672 => generated 1748 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 15:50:40.155454 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-dae6d648-280d-4dab-8f44-94c758757411 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:50:40.156314 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-dae6d648-280d-4dab-8f44-94c758757411 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: 62c89161-c119-48b2-839d-712db798ff96] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:50:40.162069 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-dae6d648-280d-4dab-8f44-94c758757411 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:50:40.162514 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-dae6d648-280d-4dab-8f44-94c758757411 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:50:40.163274 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-dae6d648-280d-4dab-8f44-94c758757411 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:50:40.163944 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-dae6d648-280d-4dab-8f44-94c758757411 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:50:40.191627 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-dae6d648-280d-4dab-8f44-94c758757411 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039996 Oct 27 15:50:40.192208 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 655/1238] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Oct 27 15:50:40 2021] GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 15:50:41.029741 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-6350e061-ee80-4202-9b65-04669061e27d tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:50:41.030336 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-6350e061-ee80-4202-9b65-04669061e27d tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] [instance: a79303e6-05ad-4901-96b7-ce845b4016f4] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:50:41.036658 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-6350e061-ee80-4202-9b65-04669061e27d tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:50:41.037100 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-6350e061-ee80-4202-9b65-04669061e27d tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:50:41.037856 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-6350e061-ee80-4202-9b65-04669061e27d tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:50:41.038284 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-6350e061-ee80-4202-9b65-04669061e27d tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:50:41.052618 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-c7e30b1a-017e-451d-9d30-b564df85f1a3 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:50:41.053216 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-c7e30b1a-017e-451d-9d30-b564df85f1a3 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:50:41.060322 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-c7e30b1a-017e-451d-9d30-b564df85f1a3 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:50:41.060766 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-c7e30b1a-017e-451d-9d30-b564df85f1a3 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:50:41.061528 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-c7e30b1a-017e-451d-9d30-b564df85f1a3 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:50:41.061963 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-c7e30b1a-017e-451d-9d30-b564df85f1a3 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:50:41.099083 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-6350e061-ee80-4202-9b65-04669061e27d tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c757a383a434a4c9b1b928087af8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8818377e744d4f6ba65560705c191f0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:50:41.107377 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-6350e061-ee80-4202-9b65-04669061e27d tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] 10.222.0.64 "GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4" status: 200 len: 1226 microversion: 2.1 time: 0.081306 Oct 27 15:50:41.108059 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 584/1239] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:50:41 2021] GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4 => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 15:50:41.187119 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-c7e30b1a-017e-451d-9d30-b564df85f1a3 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:50:41.196044 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-c7e30b1a-017e-451d-9d30-b564df85f1a3 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:50:41.197923 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-c7e30b1a-017e-451d-9d30-b564df85f1a3 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:50:41.199564 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-c7e30b1a-017e-451d-9d30-b564df85f1a3 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672" status: 200 len: 1748 microversion: 2.20 time: 0.150231 Oct 27 15:50:41.200251 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 656/1240] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Oct 27 15:50:41 2021] GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672 => generated 1748 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 15:50:41.204690 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-dfa5f7c8-c705-40c1-971b-fb35a06eeb4d tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:50:41.205590 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-dfa5f7c8-c705-40c1-971b-fb35a06eeb4d tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: 62c89161-c119-48b2-839d-712db798ff96] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:50:41.212002 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-dfa5f7c8-c705-40c1-971b-fb35a06eeb4d tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:50:41.212447 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-dfa5f7c8-c705-40c1-971b-fb35a06eeb4d tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:50:41.213219 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-dfa5f7c8-c705-40c1-971b-fb35a06eeb4d tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:50:41.213651 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-dfa5f7c8-c705-40c1-971b-fb35a06eeb4d tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:50:41.242894 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-dfa5f7c8-c705-40c1-971b-fb35a06eeb4d tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043447 Oct 27 15:50:41.243446 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 585/1241] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Oct 27 15:50:41 2021] GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 15:50:42.124735 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-800e4ab9-effb-43fa-ad16-2bc4900a48cf tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:50:42.125342 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-800e4ab9-effb-43fa-ad16-2bc4900a48cf tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] [instance: a79303e6-05ad-4901-96b7-ce845b4016f4] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:50:42.131532 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-800e4ab9-effb-43fa-ad16-2bc4900a48cf tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:50:42.132016 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-800e4ab9-effb-43fa-ad16-2bc4900a48cf tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:50:42.133420 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-800e4ab9-effb-43fa-ad16-2bc4900a48cf tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:50:42.133853 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-800e4ab9-effb-43fa-ad16-2bc4900a48cf tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:50:42.196155 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-800e4ab9-effb-43fa-ad16-2bc4900a48cf tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c757a383a434a4c9b1b928087af8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8818377e744d4f6ba65560705c191f0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:50:42.203414 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-800e4ab9-effb-43fa-ad16-2bc4900a48cf tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] 10.222.0.64 "GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4" status: 200 len: 1226 microversion: 2.1 time: 0.082366 Oct 27 15:50:42.203994 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 657/1242] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:50:42 2021] GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4 => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 15:50:42.217624 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-a65413e8-5bd9-48bf-966f-aeda6d7fc5ed tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:50:42.218230 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-a65413e8-5bd9-48bf-966f-aeda6d7fc5ed tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:50:42.224805 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-a65413e8-5bd9-48bf-966f-aeda6d7fc5ed tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:50:42.225253 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-a65413e8-5bd9-48bf-966f-aeda6d7fc5ed tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:50:42.226053 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-a65413e8-5bd9-48bf-966f-aeda6d7fc5ed tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:50:42.226564 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-a65413e8-5bd9-48bf-966f-aeda6d7fc5ed tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:50:42.254247 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-53fbc722-c7ae-4231-b0ed-9fadb453f485 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:50:42.255184 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-53fbc722-c7ae-4231-b0ed-9fadb453f485 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: 62c89161-c119-48b2-839d-712db798ff96] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:50:42.261482 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-53fbc722-c7ae-4231-b0ed-9fadb453f485 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:50:42.261931 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-53fbc722-c7ae-4231-b0ed-9fadb453f485 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:50:42.262695 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-53fbc722-c7ae-4231-b0ed-9fadb453f485 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:50:42.263128 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-53fbc722-c7ae-4231-b0ed-9fadb453f485 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:50:42.293691 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-53fbc722-c7ae-4231-b0ed-9fadb453f485 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043158 Oct 27 15:50:42.294442 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 658/1243] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Oct 27 15:50:42 2021] GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 15:50:42.345692 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-a65413e8-5bd9-48bf-966f-aeda6d7fc5ed tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:50:42.354837 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-a65413e8-5bd9-48bf-966f-aeda6d7fc5ed tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:50:42.356356 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-a65413e8-5bd9-48bf-966f-aeda6d7fc5ed tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:50:42.357495 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-a65413e8-5bd9-48bf-966f-aeda6d7fc5ed tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672" status: 200 len: 1748 microversion: 2.20 time: 0.143723 Oct 27 15:50:42.358050 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 586/1244] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Oct 27 15:50:42 2021] GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672 => generated 1748 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 15:50:43.221078 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-2851ba14-9891-4028-aa38-c330f120c08b tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:50:43.221686 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-2851ba14-9891-4028-aa38-c330f120c08b tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] [instance: a79303e6-05ad-4901-96b7-ce845b4016f4] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:50:43.228106 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-2851ba14-9891-4028-aa38-c330f120c08b tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:50:43.228549 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-2851ba14-9891-4028-aa38-c330f120c08b tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:50:43.229312 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-2851ba14-9891-4028-aa38-c330f120c08b tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:50:43.229747 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-2851ba14-9891-4028-aa38-c330f120c08b tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:50:43.290575 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-2851ba14-9891-4028-aa38-c330f120c08b tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c757a383a434a4c9b1b928087af8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8818377e744d4f6ba65560705c191f0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:50:43.297824 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-2851ba14-9891-4028-aa38-c330f120c08b tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] 10.222.0.64 "GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4" status: 200 len: 1226 microversion: 2.1 time: 0.080682 Oct 27 15:50:43.298603 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 659/1245] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:50:43 2021] GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4 => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 15:50:43.305258 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-561d1ab4-dc03-4bb5-8a33-2aa9b2c51b69 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:50:43.306249 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-561d1ab4-dc03-4bb5-8a33-2aa9b2c51b69 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: 62c89161-c119-48b2-839d-712db798ff96] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:50:43.312450 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-561d1ab4-dc03-4bb5-8a33-2aa9b2c51b69 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:50:43.312892 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-561d1ab4-dc03-4bb5-8a33-2aa9b2c51b69 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:50:43.313643 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-561d1ab4-dc03-4bb5-8a33-2aa9b2c51b69 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:50:43.314077 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-561d1ab4-dc03-4bb5-8a33-2aa9b2c51b69 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:50:43.342291 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-561d1ab4-dc03-4bb5-8a33-2aa9b2c51b69 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041348 Oct 27 15:50:43.342838 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 587/1246] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Oct 27 15:50:43 2021] GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 15:50:43.375381 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-a574598f-a4f3-4906-985d-b33c5db21196 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:50:43.376008 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-a574598f-a4f3-4906-985d-b33c5db21196 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:50:43.381783 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-a574598f-a4f3-4906-985d-b33c5db21196 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:50:43.382881 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-a574598f-a4f3-4906-985d-b33c5db21196 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:50:43.383581 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-a574598f-a4f3-4906-985d-b33c5db21196 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:50:43.384037 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-a574598f-a4f3-4906-985d-b33c5db21196 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:50:43.501433 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-a574598f-a4f3-4906-985d-b33c5db21196 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:50:43.509956 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-a574598f-a4f3-4906-985d-b33c5db21196 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:50:43.511432 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-a574598f-a4f3-4906-985d-b33c5db21196 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:50:43.512599 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-a574598f-a4f3-4906-985d-b33c5db21196 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672" status: 200 len: 1748 microversion: 2.20 time: 0.140976 Oct 27 15:50:43.513146 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 660/1247] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Oct 27 15:50:43 2021] GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672 => generated 1748 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 15:50:44.314629 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-c0b3316f-ff19-43f2-8ba8-436363d8939d tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:50:44.315227 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-c0b3316f-ff19-43f2-8ba8-436363d8939d tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] [instance: a79303e6-05ad-4901-96b7-ce845b4016f4] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:50:44.321956 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-c0b3316f-ff19-43f2-8ba8-436363d8939d tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:50:44.322393 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-c0b3316f-ff19-43f2-8ba8-436363d8939d tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:50:44.323149 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-c0b3316f-ff19-43f2-8ba8-436363d8939d tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:50:44.323575 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-c0b3316f-ff19-43f2-8ba8-436363d8939d tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:50:44.354950 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-276be2be-927c-4bbc-922b-6f534f2b6f69 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:50:44.355952 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-276be2be-927c-4bbc-922b-6f534f2b6f69 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: 62c89161-c119-48b2-839d-712db798ff96] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:50:44.362784 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-276be2be-927c-4bbc-922b-6f534f2b6f69 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:50:44.363230 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-276be2be-927c-4bbc-922b-6f534f2b6f69 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:50:44.364074 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-276be2be-927c-4bbc-922b-6f534f2b6f69 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:50:44.364517 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-276be2be-927c-4bbc-922b-6f534f2b6f69 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:50:44.389398 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-c0b3316f-ff19-43f2-8ba8-436363d8939d tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c757a383a434a4c9b1b928087af8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8818377e744d4f6ba65560705c191f0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:50:44.395643 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-276be2be-927c-4bbc-922b-6f534f2b6f69 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045323 Oct 27 15:50:44.396250 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 661/1248] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Oct 27 15:50:44 2021] GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 15:50:44.397173 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-c0b3316f-ff19-43f2-8ba8-436363d8939d tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] 10.222.0.64 "GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4" status: 200 len: 1226 microversion: 2.1 time: 0.086070 Oct 27 15:50:44.398232 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 588/1249] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:50:44 2021] GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4 => generated 1226 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 15:50:44.530598 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-2da2b79c-a950-4d02-9792-3784b1c9bb25 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:50:44.531119 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-2da2b79c-a950-4d02-9792-3784b1c9bb25 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:50:44.536994 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-2da2b79c-a950-4d02-9792-3784b1c9bb25 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:50:44.537440 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-2da2b79c-a950-4d02-9792-3784b1c9bb25 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:50:44.538205 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-2da2b79c-a950-4d02-9792-3784b1c9bb25 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:50:44.539133 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-2da2b79c-a950-4d02-9792-3784b1c9bb25 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:50:44.661416 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-2da2b79c-a950-4d02-9792-3784b1c9bb25 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:50:44.669979 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-2da2b79c-a950-4d02-9792-3784b1c9bb25 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:50:44.671476 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-2da2b79c-a950-4d02-9792-3784b1c9bb25 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:50:44.672690 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-2da2b79c-a950-4d02-9792-3784b1c9bb25 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672" status: 200 len: 1748 microversion: 2.20 time: 0.145919 Oct 27 15:50:44.673245 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 662/1250] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Oct 27 15:50:44 2021] GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672 => generated 1748 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 15:50:45.407450 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-e30fded4-103c-497b-87a3-9d59ffeb543f tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:50:45.408403 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-e30fded4-103c-497b-87a3-9d59ffeb543f tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: 62c89161-c119-48b2-839d-712db798ff96] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:50:45.414685 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-af5373d6-6258-47e7-9550-afff73daa218 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:50:45.415295 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-af5373d6-6258-47e7-9550-afff73daa218 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] [instance: a79303e6-05ad-4901-96b7-ce845b4016f4] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:50:45.415556 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-e30fded4-103c-497b-87a3-9d59ffeb543f tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:50:45.416032 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-e30fded4-103c-497b-87a3-9d59ffeb543f tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:50:45.416828 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-e30fded4-103c-497b-87a3-9d59ffeb543f tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:50:45.417220 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-e30fded4-103c-497b-87a3-9d59ffeb543f tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:50:45.421403 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-af5373d6-6258-47e7-9550-afff73daa218 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:50:45.421848 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-af5373d6-6258-47e7-9550-afff73daa218 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:50:45.422617 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-af5373d6-6258-47e7-9550-afff73daa218 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:50:45.423052 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-af5373d6-6258-47e7-9550-afff73daa218 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:50:45.446806 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-e30fded4-103c-497b-87a3-9d59ffeb543f tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043033 Oct 27 15:50:45.447371 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 589/1251] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Oct 27 15:50:45 2021] GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 15:50:45.485719 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-af5373d6-6258-47e7-9550-afff73daa218 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c757a383a434a4c9b1b928087af8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8818377e744d4f6ba65560705c191f0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:50:45.494237 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-af5373d6-6258-47e7-9550-afff73daa218 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] 10.222.0.64 "GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4" status: 200 len: 1226 microversion: 2.1 time: 0.083880 Oct 27 15:50:45.494799 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 663/1252] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:50:45 2021] GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4 => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 15:50:45.690632 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-00dd15f6-5af6-4cc7-a4e7-27528a2a506e tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:50:45.691228 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-00dd15f6-5af6-4cc7-a4e7-27528a2a506e tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:50:45.697645 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-00dd15f6-5af6-4cc7-a4e7-27528a2a506e tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:50:45.698088 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-00dd15f6-5af6-4cc7-a4e7-27528a2a506e tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:50:45.698879 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-00dd15f6-5af6-4cc7-a4e7-27528a2a506e tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:50:45.699313 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-00dd15f6-5af6-4cc7-a4e7-27528a2a506e tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:50:45.822870 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-00dd15f6-5af6-4cc7-a4e7-27528a2a506e tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:50:45.830911 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-00dd15f6-5af6-4cc7-a4e7-27528a2a506e tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:50:45.832432 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-00dd15f6-5af6-4cc7-a4e7-27528a2a506e tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:50:45.833558 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-00dd15f6-5af6-4cc7-a4e7-27528a2a506e tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672" status: 200 len: 1748 microversion: 2.20 time: 0.146672 Oct 27 15:50:45.834105 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 590/1253] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Oct 27 15:50:45 2021] GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672 => generated 1748 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 15:50:46.458453 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-49b92772-946d-4d8d-9987-d43b8fd0a27d tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:50:46.459362 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-49b92772-946d-4d8d-9987-d43b8fd0a27d tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: 62c89161-c119-48b2-839d-712db798ff96] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:50:46.466248 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-49b92772-946d-4d8d-9987-d43b8fd0a27d tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:50:46.466692 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-49b92772-946d-4d8d-9987-d43b8fd0a27d tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:50:46.467476 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-49b92772-946d-4d8d-9987-d43b8fd0a27d tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:50:46.467936 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-49b92772-946d-4d8d-9987-d43b8fd0a27d tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:50:46.497892 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-49b92772-946d-4d8d-9987-d43b8fd0a27d tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043146 Oct 27 15:50:46.498457 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 664/1254] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Oct 27 15:50:46 2021] GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 15:50:46.518122 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-ee134a9f-8375-4e67-b3a7-74b5ce2bb8c3 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:50:46.518744 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-ee134a9f-8375-4e67-b3a7-74b5ce2bb8c3 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] [instance: a79303e6-05ad-4901-96b7-ce845b4016f4] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:50:46.525379 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-ee134a9f-8375-4e67-b3a7-74b5ce2bb8c3 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:50:46.525822 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-ee134a9f-8375-4e67-b3a7-74b5ce2bb8c3 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:50:46.526574 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-ee134a9f-8375-4e67-b3a7-74b5ce2bb8c3 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:50:46.526999 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-ee134a9f-8375-4e67-b3a7-74b5ce2bb8c3 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:50:46.585894 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-ee134a9f-8375-4e67-b3a7-74b5ce2bb8c3 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c757a383a434a4c9b1b928087af8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8818377e744d4f6ba65560705c191f0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:50:46.593120 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-ee134a9f-8375-4e67-b3a7-74b5ce2bb8c3 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] 10.222.0.64 "GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4" status: 200 len: 1226 microversion: 2.1 time: 0.078634 Oct 27 15:50:46.593957 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 591/1255] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:50:46 2021] GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4 => generated 1226 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 15:50:46.852391 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-663ff67b-165a-4a7b-873b-d24095d886b5 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:50:46.852931 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-663ff67b-165a-4a7b-873b-d24095d886b5 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:50:46.858948 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-663ff67b-165a-4a7b-873b-d24095d886b5 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:50:46.859389 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-663ff67b-165a-4a7b-873b-d24095d886b5 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:50:46.860182 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-663ff67b-165a-4a7b-873b-d24095d886b5 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:50:46.860613 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-663ff67b-165a-4a7b-873b-d24095d886b5 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:50:46.980596 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-663ff67b-165a-4a7b-873b-d24095d886b5 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:50:46.988576 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-663ff67b-165a-4a7b-873b-d24095d886b5 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:50:46.990065 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-663ff67b-165a-4a7b-873b-d24095d886b5 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:50:46.991199 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-663ff67b-165a-4a7b-873b-d24095d886b5 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672" status: 200 len: 1748 microversion: 2.20 time: 0.142760 Oct 27 15:50:46.992278 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 665/1256] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Oct 27 15:50:46 2021] GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672 => generated 1748 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 15:50:47.509316 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-38063bf5-ee15-4046-a7dc-8c3b5f30931b tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:50:47.510219 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-38063bf5-ee15-4046-a7dc-8c3b5f30931b tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: 62c89161-c119-48b2-839d-712db798ff96] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:50:47.515954 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-38063bf5-ee15-4046-a7dc-8c3b5f30931b tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:50:47.516393 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-38063bf5-ee15-4046-a7dc-8c3b5f30931b tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:50:47.517139 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-38063bf5-ee15-4046-a7dc-8c3b5f30931b tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:50:47.517570 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-38063bf5-ee15-4046-a7dc-8c3b5f30931b tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:50:47.547258 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-38063bf5-ee15-4046-a7dc-8c3b5f30931b tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041886 Oct 27 15:50:47.547914 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 592/1257] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Oct 27 15:50:47 2021] GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 15:50:47.610321 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-33523334-16a2-4148-a713-fbb49356edde tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:50:47.610925 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-33523334-16a2-4148-a713-fbb49356edde tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] [instance: a79303e6-05ad-4901-96b7-ce845b4016f4] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:50:47.617853 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-33523334-16a2-4148-a713-fbb49356edde tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:50:47.618296 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-33523334-16a2-4148-a713-fbb49356edde tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:50:47.619060 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-33523334-16a2-4148-a713-fbb49356edde tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:50:47.619494 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-33523334-16a2-4148-a713-fbb49356edde tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:50:47.677790 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-33523334-16a2-4148-a713-fbb49356edde tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c757a383a434a4c9b1b928087af8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8818377e744d4f6ba65560705c191f0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:50:47.685830 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-33523334-16a2-4148-a713-fbb49356edde tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] 10.222.0.64 "GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4" status: 200 len: 1226 microversion: 2.1 time: 0.079175 Oct 27 15:50:47.686394 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 666/1258] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:50:47 2021] GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4 => generated 1226 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 15:50:48.009439 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-8f42a912-1f82-46fd-a019-d9acbe597e15 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:50:48.010036 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-8f42a912-1f82-46fd-a019-d9acbe597e15 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:50:48.015753 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-8f42a912-1f82-46fd-a019-d9acbe597e15 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:50:48.016224 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-8f42a912-1f82-46fd-a019-d9acbe597e15 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:50:48.016976 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-8f42a912-1f82-46fd-a019-d9acbe597e15 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:50:48.017407 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-8f42a912-1f82-46fd-a019-d9acbe597e15 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:50:48.137339 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-8f42a912-1f82-46fd-a019-d9acbe597e15 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:50:48.145347 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-8f42a912-1f82-46fd-a019-d9acbe597e15 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:50:48.146830 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-8f42a912-1f82-46fd-a019-d9acbe597e15 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:50:48.148672 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-8f42a912-1f82-46fd-a019-d9acbe597e15 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672" status: 200 len: 1748 microversion: 2.20 time: 0.142846 Oct 27 15:50:48.149224 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 593/1259] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Oct 27 15:50:48 2021] GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672 => generated 1748 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 15:50:48.559147 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-d8e69b58-8d59-420e-b30f-4a3ddba826e6 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:50:48.559998 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-d8e69b58-8d59-420e-b30f-4a3ddba826e6 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: 62c89161-c119-48b2-839d-712db798ff96] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:50:48.565774 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-d8e69b58-8d59-420e-b30f-4a3ddba826e6 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:50:48.566250 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-d8e69b58-8d59-420e-b30f-4a3ddba826e6 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:50:48.567010 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-d8e69b58-8d59-420e-b30f-4a3ddba826e6 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:50:48.567441 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-d8e69b58-8d59-420e-b30f-4a3ddba826e6 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:50:48.596532 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-d8e69b58-8d59-420e-b30f-4a3ddba826e6 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041366 Oct 27 15:50:48.597068 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 667/1260] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Oct 27 15:50:48 2021] GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 15:50:48.702071 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-5a6731e9-7acb-421e-9d5a-714419b40ccc tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:50:48.702673 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-5a6731e9-7acb-421e-9d5a-714419b40ccc tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] [instance: a79303e6-05ad-4901-96b7-ce845b4016f4] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:50:48.708819 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-5a6731e9-7acb-421e-9d5a-714419b40ccc tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:50:48.709270 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-5a6731e9-7acb-421e-9d5a-714419b40ccc tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:50:48.710029 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-5a6731e9-7acb-421e-9d5a-714419b40ccc tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:50:48.710493 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-5a6731e9-7acb-421e-9d5a-714419b40ccc tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:50:48.769358 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-5a6731e9-7acb-421e-9d5a-714419b40ccc tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c757a383a434a4c9b1b928087af8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8818377e744d4f6ba65560705c191f0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:50:48.777173 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-5a6731e9-7acb-421e-9d5a-714419b40ccc tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] 10.222.0.64 "GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4" status: 200 len: 1226 microversion: 2.1 time: 0.078714 Oct 27 15:50:48.777726 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 594/1261] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:50:48 2021] GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4 => generated 1226 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 15:50:49.167673 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-a9ef625b-4470-4123-bd73-127c61dc209a tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:50:49.168301 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-a9ef625b-4470-4123-bd73-127c61dc209a tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:50:49.174680 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-a9ef625b-4470-4123-bd73-127c61dc209a tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:50:49.175057 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-a9ef625b-4470-4123-bd73-127c61dc209a tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:50:49.175826 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-a9ef625b-4470-4123-bd73-127c61dc209a tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:50:49.176274 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-a9ef625b-4470-4123-bd73-127c61dc209a tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:50:49.295215 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-a9ef625b-4470-4123-bd73-127c61dc209a tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:50:49.303190 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-a9ef625b-4470-4123-bd73-127c61dc209a tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:50:49.304719 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-a9ef625b-4470-4123-bd73-127c61dc209a tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:50:49.306481 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-a9ef625b-4470-4123-bd73-127c61dc209a tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672" status: 200 len: 1748 microversion: 2.20 time: 0.143538 Oct 27 15:50:49.307046 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 668/1262] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Oct 27 15:50:49 2021] GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672 => generated 1748 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 15:50:49.607821 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-facaed74-7ff2-4100-a9d9-0d58999b92b2 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:50:49.608799 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-facaed74-7ff2-4100-a9d9-0d58999b92b2 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: 62c89161-c119-48b2-839d-712db798ff96] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:50:49.614692 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-facaed74-7ff2-4100-a9d9-0d58999b92b2 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:50:49.615137 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-facaed74-7ff2-4100-a9d9-0d58999b92b2 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:50:49.615923 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-facaed74-7ff2-4100-a9d9-0d58999b92b2 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:50:49.616525 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-facaed74-7ff2-4100-a9d9-0d58999b92b2 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:50:49.644110 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-facaed74-7ff2-4100-a9d9-0d58999b92b2 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040052 Oct 27 15:50:49.644677 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 595/1263] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Oct 27 15:50:49 2021] GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 15:50:49.793510 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-c78c67fe-4894-44d5-99f9-5fd106176d0a tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:50:49.794146 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-c78c67fe-4894-44d5-99f9-5fd106176d0a tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] [instance: a79303e6-05ad-4901-96b7-ce845b4016f4] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:50:49.799869 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-c78c67fe-4894-44d5-99f9-5fd106176d0a tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:50:49.800324 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-c78c67fe-4894-44d5-99f9-5fd106176d0a tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:50:49.801082 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-c78c67fe-4894-44d5-99f9-5fd106176d0a tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:50:49.801514 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-c78c67fe-4894-44d5-99f9-5fd106176d0a tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:50:49.863070 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-c78c67fe-4894-44d5-99f9-5fd106176d0a tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c757a383a434a4c9b1b928087af8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8818377e744d4f6ba65560705c191f0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:50:49.870328 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-c78c67fe-4894-44d5-99f9-5fd106176d0a tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] 10.222.0.64 "GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4" status: 200 len: 1226 microversion: 2.1 time: 0.080504 Oct 27 15:50:49.870893 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 669/1264] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:50:49 2021] GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4 => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 15:50:50.324859 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-40914324-8e15-45d7-ad61-6e584d7320da tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:50:50.325458 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-40914324-8e15-45d7-ad61-6e584d7320da tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:50:50.331607 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-40914324-8e15-45d7-ad61-6e584d7320da tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:50:50.332074 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-40914324-8e15-45d7-ad61-6e584d7320da tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:50:50.332822 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-40914324-8e15-45d7-ad61-6e584d7320da tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:50:50.333243 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-40914324-8e15-45d7-ad61-6e584d7320da tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:50:50.453434 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-40914324-8e15-45d7-ad61-6e584d7320da tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:50:50.462580 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-40914324-8e15-45d7-ad61-6e584d7320da tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:50:50.464097 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-40914324-8e15-45d7-ad61-6e584d7320da tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:50:50.465237 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-40914324-8e15-45d7-ad61-6e584d7320da tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672" status: 200 len: 1748 microversion: 2.20 time: 0.144140 Oct 27 15:50:50.465784 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 596/1265] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Oct 27 15:50:50 2021] GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672 => generated 1748 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 15:50:50.655832 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-2f403c1c-69d8-446b-b1b4-70204cf81841 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:50:50.656678 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-2f403c1c-69d8-446b-b1b4-70204cf81841 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: 62c89161-c119-48b2-839d-712db798ff96] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:50:50.662891 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-2f403c1c-69d8-446b-b1b4-70204cf81841 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:50:50.663812 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-2f403c1c-69d8-446b-b1b4-70204cf81841 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:50:50.664593 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-2f403c1c-69d8-446b-b1b4-70204cf81841 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:50:50.665021 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-2f403c1c-69d8-446b-b1b4-70204cf81841 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:50:50.693475 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-2f403c1c-69d8-446b-b1b4-70204cf81841 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041437 Oct 27 15:50:50.694015 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 670/1266] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Oct 27 15:50:50 2021] GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 15:50:50.887103 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-3d067553-8ea9-40d1-903a-c6055a6bc5c4 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:50:50.887791 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-3d067553-8ea9-40d1-903a-c6055a6bc5c4 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] [instance: a79303e6-05ad-4901-96b7-ce845b4016f4] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:50:50.894435 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-3d067553-8ea9-40d1-903a-c6055a6bc5c4 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:50:50.894867 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-3d067553-8ea9-40d1-903a-c6055a6bc5c4 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:50:50.895638 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-3d067553-8ea9-40d1-903a-c6055a6bc5c4 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:50:50.896104 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-3d067553-8ea9-40d1-903a-c6055a6bc5c4 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:50:50.958675 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-3d067553-8ea9-40d1-903a-c6055a6bc5c4 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c757a383a434a4c9b1b928087af8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8818377e744d4f6ba65560705c191f0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:50:50.966268 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-3d067553-8ea9-40d1-903a-c6055a6bc5c4 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] 10.222.0.64 "GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4" status: 200 len: 1226 microversion: 2.1 time: 0.082988 Oct 27 15:50:50.966909 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 597/1267] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:50:50 2021] GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4 => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 15:50:51.483774 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-c4ef35b4-e7af-4ab2-aeca-f3c87927002e tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:50:51.484594 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-c4ef35b4-e7af-4ab2-aeca-f3c87927002e tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:50:51.492915 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-c4ef35b4-e7af-4ab2-aeca-f3c87927002e tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:50:51.493360 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-c4ef35b4-e7af-4ab2-aeca-f3c87927002e tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:50:51.494137 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-c4ef35b4-e7af-4ab2-aeca-f3c87927002e tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:50:51.494572 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-c4ef35b4-e7af-4ab2-aeca-f3c87927002e tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:50:51.614838 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-c4ef35b4-e7af-4ab2-aeca-f3c87927002e tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:50:51.623062 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-c4ef35b4-e7af-4ab2-aeca-f3c87927002e tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:50:51.624601 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-c4ef35b4-e7af-4ab2-aeca-f3c87927002e tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:50:51.625756 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-c4ef35b4-e7af-4ab2-aeca-f3c87927002e tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672" status: 200 len: 1748 microversion: 2.20 time: 0.145733 Oct 27 15:50:51.626319 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 671/1268] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Oct 27 15:50:51 2021] GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672 => generated 1748 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 15:50:51.710414 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-9ccba25c-b564-4739-aee6-228ef5489820 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:50:51.711437 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-9ccba25c-b564-4739-aee6-228ef5489820 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: 62c89161-c119-48b2-839d-712db798ff96] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:50:51.717786 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-9ccba25c-b564-4739-aee6-228ef5489820 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:50:51.718488 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-9ccba25c-b564-4739-aee6-228ef5489820 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:50:51.719253 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-9ccba25c-b564-4739-aee6-228ef5489820 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:50:51.719687 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-9ccba25c-b564-4739-aee6-228ef5489820 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:50:51.749759 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-9ccba25c-b564-4739-aee6-228ef5489820 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043470 Oct 27 15:50:51.750224 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 598/1269] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Oct 27 15:50:51 2021] GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 15:50:51.985982 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-379a1520-0ac2-404b-b909-68cb1cf9974b tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:50:51.986583 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-379a1520-0ac2-404b-b909-68cb1cf9974b tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] [instance: a79303e6-05ad-4901-96b7-ce845b4016f4] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:50:51.993167 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-379a1520-0ac2-404b-b909-68cb1cf9974b tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:50:51.993608 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-379a1520-0ac2-404b-b909-68cb1cf9974b tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:50:51.994380 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-379a1520-0ac2-404b-b909-68cb1cf9974b tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:50:51.994790 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-379a1520-0ac2-404b-b909-68cb1cf9974b tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:50:52.053642 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-379a1520-0ac2-404b-b909-68cb1cf9974b tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c757a383a434a4c9b1b928087af8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8818377e744d4f6ba65560705c191f0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:50:52.060868 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-379a1520-0ac2-404b-b909-68cb1cf9974b tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] 10.222.0.64 "GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4" status: 200 len: 1226 microversion: 2.1 time: 0.078603 Oct 27 15:50:52.061426 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 672/1270] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:50:51 2021] GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4 => generated 1226 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 15:50:52.643035 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-32b021d2-4788-46cc-9edf-f755e63d0659 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:50:52.643553 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-32b021d2-4788-46cc-9edf-f755e63d0659 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:50:52.650405 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-32b021d2-4788-46cc-9edf-f755e63d0659 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:50:52.650842 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-32b021d2-4788-46cc-9edf-f755e63d0659 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:50:52.651592 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-32b021d2-4788-46cc-9edf-f755e63d0659 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:50:52.652050 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-32b021d2-4788-46cc-9edf-f755e63d0659 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:50:52.761847 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-82252027-7bbe-4968-bac4-dd27d3efb920 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:50:52.762780 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-82252027-7bbe-4968-bac4-dd27d3efb920 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: 62c89161-c119-48b2-839d-712db798ff96] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:50:52.768514 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-82252027-7bbe-4968-bac4-dd27d3efb920 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:50:52.768959 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-82252027-7bbe-4968-bac4-dd27d3efb920 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:50:52.769734 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-82252027-7bbe-4968-bac4-dd27d3efb920 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:50:52.770195 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-82252027-7bbe-4968-bac4-dd27d3efb920 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:50:52.774604 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-32b021d2-4788-46cc-9edf-f755e63d0659 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:50:52.782770 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-32b021d2-4788-46cc-9edf-f755e63d0659 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:50:52.784294 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-32b021d2-4788-46cc-9edf-f755e63d0659 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:50:52.785477 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-32b021d2-4788-46cc-9edf-f755e63d0659 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672" status: 200 len: 1748 microversion: 2.20 time: 0.146247 Oct 27 15:50:52.786039 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 599/1271] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Oct 27 15:50:52 2021] GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672 => generated 1748 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 15:50:52.799385 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-82252027-7bbe-4968-bac4-dd27d3efb920 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041275 Oct 27 15:50:52.799951 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 673/1272] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Oct 27 15:50:52 2021] GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 15:50:53.077563 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-d0c84d35-9f22-49cc-b857-6cf8ecac4070 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:50:53.078161 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-d0c84d35-9f22-49cc-b857-6cf8ecac4070 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] [instance: a79303e6-05ad-4901-96b7-ce845b4016f4] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:50:53.084106 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-d0c84d35-9f22-49cc-b857-6cf8ecac4070 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:50:53.084555 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-d0c84d35-9f22-49cc-b857-6cf8ecac4070 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:50:53.086103 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-d0c84d35-9f22-49cc-b857-6cf8ecac4070 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:50:53.086307 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-d0c84d35-9f22-49cc-b857-6cf8ecac4070 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:50:53.144984 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-d0c84d35-9f22-49cc-b857-6cf8ecac4070 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c757a383a434a4c9b1b928087af8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8818377e744d4f6ba65560705c191f0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:50:53.152672 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-d0c84d35-9f22-49cc-b857-6cf8ecac4070 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] 10.222.0.64 "GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4" status: 200 len: 1226 microversion: 2.1 time: 0.078747 Oct 27 15:50:53.153227 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 600/1273] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:50:53 2021] GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4 => generated 1226 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 15:50:53.803388 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-3e4b2730-fb36-4e5d-9450-ffb3e835a1e4 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:50:53.804441 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-3e4b2730-fb36-4e5d-9450-ffb3e835a1e4 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:50:53.810480 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-81740471-638b-43aa-be0c-666bf963a3b7 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:50:53.810968 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-3e4b2730-fb36-4e5d-9450-ffb3e835a1e4 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:50:53.811353 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-3e4b2730-fb36-4e5d-9450-ffb3e835a1e4 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:50:53.811491 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-81740471-638b-43aa-be0c-666bf963a3b7 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: 62c89161-c119-48b2-839d-712db798ff96] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:50:53.812133 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-3e4b2730-fb36-4e5d-9450-ffb3e835a1e4 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:50:53.812561 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-3e4b2730-fb36-4e5d-9450-ffb3e835a1e4 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:50:53.817438 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-81740471-638b-43aa-be0c-666bf963a3b7 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:50:53.817878 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-81740471-638b-43aa-be0c-666bf963a3b7 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:50:53.818637 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-81740471-638b-43aa-be0c-666bf963a3b7 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:50:53.819065 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-81740471-638b-43aa-be0c-666bf963a3b7 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:50:53.849215 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-81740471-638b-43aa-be0c-666bf963a3b7 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042300 Oct 27 15:50:53.849891 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 601/1274] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Oct 27 15:50:53 2021] GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 15:50:53.940186 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-3e4b2730-fb36-4e5d-9450-ffb3e835a1e4 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:50:53.948733 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-3e4b2730-fb36-4e5d-9450-ffb3e835a1e4 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:50:53.950221 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-3e4b2730-fb36-4e5d-9450-ffb3e835a1e4 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:50:53.951371 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-3e4b2730-fb36-4e5d-9450-ffb3e835a1e4 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672" status: 200 len: 1748 microversion: 2.20 time: 0.151706 Oct 27 15:50:53.951940 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 674/1275] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Oct 27 15:50:53 2021] GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672 => generated 1748 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 15:50:54.170816 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-33305c3c-361a-42ba-ba62-4cc009e27c8a tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:50:54.171737 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-33305c3c-361a-42ba-ba62-4cc009e27c8a tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] [instance: a79303e6-05ad-4901-96b7-ce845b4016f4] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:50:54.180991 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-33305c3c-361a-42ba-ba62-4cc009e27c8a tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:50:54.184130 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-33305c3c-361a-42ba-ba62-4cc009e27c8a tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:50:54.184929 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-33305c3c-361a-42ba-ba62-4cc009e27c8a tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:50:54.185360 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-33305c3c-361a-42ba-ba62-4cc009e27c8a tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:50:54.266419 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-33305c3c-361a-42ba-ba62-4cc009e27c8a tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c757a383a434a4c9b1b928087af8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8818377e744d4f6ba65560705c191f0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:50:54.274349 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-33305c3c-361a-42ba-ba62-4cc009e27c8a tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] 10.222.0.64 "GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4" status: 200 len: 1226 microversion: 2.1 time: 0.107771 Oct 27 15:50:54.274908 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 602/1276] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:50:54 2021] GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4 => generated 1226 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 15:50:54.862264 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-0cd2c007-d563-49c0-a88f-336e55ba52ae tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:50:54.863173 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-0cd2c007-d563-49c0-a88f-336e55ba52ae tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: 62c89161-c119-48b2-839d-712db798ff96] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:50:54.870087 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-0cd2c007-d563-49c0-a88f-336e55ba52ae tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:50:54.870530 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-0cd2c007-d563-49c0-a88f-336e55ba52ae tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:50:54.871316 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-0cd2c007-d563-49c0-a88f-336e55ba52ae tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:50:54.871738 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-0cd2c007-d563-49c0-a88f-336e55ba52ae tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:50:54.904226 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-0cd2c007-d563-49c0-a88f-336e55ba52ae tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045893 Oct 27 15:50:54.904780 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 675/1277] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Oct 27 15:50:54 2021] GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 15:50:54.971496 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-8ab4534d-e127-4238-8656-6cda0bd03098 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:50:54.972133 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-8ab4534d-e127-4238-8656-6cda0bd03098 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:50:54.978992 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-8ab4534d-e127-4238-8656-6cda0bd03098 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:50:54.979435 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-8ab4534d-e127-4238-8656-6cda0bd03098 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:50:54.980239 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-8ab4534d-e127-4238-8656-6cda0bd03098 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:50:54.980670 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-8ab4534d-e127-4238-8656-6cda0bd03098 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:50:55.106725 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-8ab4534d-e127-4238-8656-6cda0bd03098 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:50:55.115250 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-8ab4534d-e127-4238-8656-6cda0bd03098 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:50:55.117372 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-8ab4534d-e127-4238-8656-6cda0bd03098 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:50:55.118520 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-8ab4534d-e127-4238-8656-6cda0bd03098 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672" status: 200 len: 1748 microversion: 2.20 time: 0.150991 Oct 27 15:50:55.119093 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 603/1278] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Oct 27 15:50:54 2021] GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672 => generated 1748 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 15:50:55.291465 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-23e160db-cf75-4e7c-92eb-c1ab67da925b tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:50:55.292101 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-23e160db-cf75-4e7c-92eb-c1ab67da925b tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] [instance: a79303e6-05ad-4901-96b7-ce845b4016f4] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:50:55.297835 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-23e160db-cf75-4e7c-92eb-c1ab67da925b tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:50:55.298279 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-23e160db-cf75-4e7c-92eb-c1ab67da925b tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:50:55.299044 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-23e160db-cf75-4e7c-92eb-c1ab67da925b tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:50:55.299476 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-23e160db-cf75-4e7c-92eb-c1ab67da925b tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:50:55.358778 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-23e160db-cf75-4e7c-92eb-c1ab67da925b tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c757a383a434a4c9b1b928087af8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8818377e744d4f6ba65560705c191f0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:50:55.366939 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-23e160db-cf75-4e7c-92eb-c1ab67da925b tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] 10.222.0.64 "GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4" status: 200 len: 1226 microversion: 2.1 time: 0.079102 Oct 27 15:50:55.367911 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 676/1279] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:50:55 2021] GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4 => generated 1226 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 15:50:55.917361 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-66dda514-4739-49f1-b32a-d9701e069fb6 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:50:55.918264 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-66dda514-4739-49f1-b32a-d9701e069fb6 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: 62c89161-c119-48b2-839d-712db798ff96] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:50:55.924305 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-66dda514-4739-49f1-b32a-d9701e069fb6 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:50:55.924752 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-66dda514-4739-49f1-b32a-d9701e069fb6 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:50:55.925510 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-66dda514-4739-49f1-b32a-d9701e069fb6 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:50:55.925939 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-66dda514-4739-49f1-b32a-d9701e069fb6 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:50:55.955039 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-66dda514-4739-49f1-b32a-d9701e069fb6 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042048 Oct 27 15:50:55.955592 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 604/1280] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Oct 27 15:50:55 2021] GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 15:50:56.137358 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-caaed79c-b0b3-4ec5-a51b-79294d1e84a1 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:50:56.138076 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-caaed79c-b0b3-4ec5-a51b-79294d1e84a1 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:50:56.144411 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-caaed79c-b0b3-4ec5-a51b-79294d1e84a1 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:50:56.144852 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-caaed79c-b0b3-4ec5-a51b-79294d1e84a1 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:50:56.145615 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-caaed79c-b0b3-4ec5-a51b-79294d1e84a1 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:50:56.146045 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-caaed79c-b0b3-4ec5-a51b-79294d1e84a1 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:50:56.265402 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-caaed79c-b0b3-4ec5-a51b-79294d1e84a1 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:50:56.274542 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-caaed79c-b0b3-4ec5-a51b-79294d1e84a1 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:50:56.276062 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-caaed79c-b0b3-4ec5-a51b-79294d1e84a1 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:50:56.277212 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-caaed79c-b0b3-4ec5-a51b-79294d1e84a1 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672" status: 200 len: 1748 microversion: 2.20 time: 0.143735 Oct 27 15:50:56.277754 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 677/1281] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Oct 27 15:50:56 2021] GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672 => generated 1748 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 15:50:56.384600 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-11f0910a-c473-4002-a287-b24dce0ba32a tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:50:56.385332 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-11f0910a-c473-4002-a287-b24dce0ba32a tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] [instance: a79303e6-05ad-4901-96b7-ce845b4016f4] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:50:56.392543 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-11f0910a-c473-4002-a287-b24dce0ba32a tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:50:56.392984 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-11f0910a-c473-4002-a287-b24dce0ba32a tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:50:56.393765 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-11f0910a-c473-4002-a287-b24dce0ba32a tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:50:56.394191 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-11f0910a-c473-4002-a287-b24dce0ba32a tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:50:56.453487 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-11f0910a-c473-4002-a287-b24dce0ba32a tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c757a383a434a4c9b1b928087af8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8818377e744d4f6ba65560705c191f0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:50:56.461356 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-11f0910a-c473-4002-a287-b24dce0ba32a tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] 10.222.0.64 "GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4" status: 200 len: 1226 microversion: 2.1 time: 0.081536 Oct 27 15:50:56.461918 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 605/1282] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:50:56 2021] GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4 => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 15:50:56.967026 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-33127785-f400-4a34-a282-02ac52af4f81 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:50:56.967960 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-33127785-f400-4a34-a282-02ac52af4f81 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: 62c89161-c119-48b2-839d-712db798ff96] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:50:56.974045 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-33127785-f400-4a34-a282-02ac52af4f81 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:50:56.974492 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-33127785-f400-4a34-a282-02ac52af4f81 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:50:56.975258 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-33127785-f400-4a34-a282-02ac52af4f81 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:50:56.976473 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-33127785-f400-4a34-a282-02ac52af4f81 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:50:57.005781 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-33127785-f400-4a34-a282-02ac52af4f81 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042625 Oct 27 15:50:57.006344 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 678/1283] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Oct 27 15:50:56 2021] GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 15:50:57.143602 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 27 15:50:57.143883 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: Wed Oct 27 15:50:57 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Oct 27 15:50:57.294948 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-94ea5215-9008-43d9-b97d-722bb0a39c02 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:50:57.295539 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-94ea5215-9008-43d9-b97d-722bb0a39c02 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:50:57.301748 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-94ea5215-9008-43d9-b97d-722bb0a39c02 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:50:57.302186 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-94ea5215-9008-43d9-b97d-722bb0a39c02 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:50:57.302935 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-94ea5215-9008-43d9-b97d-722bb0a39c02 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:50:57.303358 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-94ea5215-9008-43d9-b97d-722bb0a39c02 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:50:57.426977 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-94ea5215-9008-43d9-b97d-722bb0a39c02 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:50:57.436739 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-94ea5215-9008-43d9-b97d-722bb0a39c02 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:50:57.438248 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-94ea5215-9008-43d9-b97d-722bb0a39c02 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:50:57.439396 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-94ea5215-9008-43d9-b97d-722bb0a39c02 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672" status: 200 len: 1748 microversion: 2.20 time: 0.148215 Oct 27 15:50:57.439967 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 606/1284] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Oct 27 15:50:57 2021] GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672 => generated 1748 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 15:50:57.479573 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-f5997420-d389-4dd5-ba32-6956096d537a tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:50:57.480267 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-f5997420-d389-4dd5-ba32-6956096d537a tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] [instance: a79303e6-05ad-4901-96b7-ce845b4016f4] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:50:57.486340 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-f5997420-d389-4dd5-ba32-6956096d537a tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:50:57.486779 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-f5997420-d389-4dd5-ba32-6956096d537a tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:50:57.487537 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-f5997420-d389-4dd5-ba32-6956096d537a tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:50:57.487996 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-f5997420-d389-4dd5-ba32-6956096d537a tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:50:57.550468 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-f5997420-d389-4dd5-ba32-6956096d537a tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c757a383a434a4c9b1b928087af8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8818377e744d4f6ba65560705c191f0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:50:57.561861 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-f5997420-d389-4dd5-ba32-6956096d537a tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] 10.222.0.64 "GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4" status: 200 len: 1226 microversion: 2.1 time: 0.086047 Oct 27 15:50:57.562571 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 679/1285] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:50:57 2021] GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4 => generated 1226 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 15:50:58.018340 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-5ef97d8f-fa2e-4d93-91f8-4269eb8557ad tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:50:58.019448 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-5ef97d8f-fa2e-4d93-91f8-4269eb8557ad tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: 62c89161-c119-48b2-839d-712db798ff96] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:50:58.027058 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-5ef97d8f-fa2e-4d93-91f8-4269eb8557ad tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:50:58.027594 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-5ef97d8f-fa2e-4d93-91f8-4269eb8557ad tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:50:58.028494 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-5ef97d8f-fa2e-4d93-91f8-4269eb8557ad tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:50:58.028997 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-5ef97d8f-fa2e-4d93-91f8-4269eb8557ad tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:50:58.057497 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-5ef97d8f-fa2e-4d93-91f8-4269eb8557ad tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043748 Oct 27 15:50:58.058044 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 607/1286] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Oct 27 15:50:58 2021] GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 15:50:58.457366 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-0730032d-c5ee-4e2c-b2cd-1137b9d477d9 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:50:58.457965 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-0730032d-c5ee-4e2c-b2cd-1137b9d477d9 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:50:58.463891 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-0730032d-c5ee-4e2c-b2cd-1137b9d477d9 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:50:58.464334 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-0730032d-c5ee-4e2c-b2cd-1137b9d477d9 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:50:58.465451 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-0730032d-c5ee-4e2c-b2cd-1137b9d477d9 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:50:58.465887 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-0730032d-c5ee-4e2c-b2cd-1137b9d477d9 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:50:58.583126 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-cd93fc9d-79bb-4ea2-99b9-efdc13a373a0 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:50:58.583741 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-cd93fc9d-79bb-4ea2-99b9-efdc13a373a0 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] [instance: a79303e6-05ad-4901-96b7-ce845b4016f4] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:50:58.591357 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-cd93fc9d-79bb-4ea2-99b9-efdc13a373a0 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:50:58.591801 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-cd93fc9d-79bb-4ea2-99b9-efdc13a373a0 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:50:58.592605 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-cd93fc9d-79bb-4ea2-99b9-efdc13a373a0 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:50:58.593029 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-cd93fc9d-79bb-4ea2-99b9-efdc13a373a0 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:50:58.661109 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-cd93fc9d-79bb-4ea2-99b9-efdc13a373a0 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c757a383a434a4c9b1b928087af8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8818377e744d4f6ba65560705c191f0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:50:58.669871 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-cd93fc9d-79bb-4ea2-99b9-efdc13a373a0 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] 10.222.0.64 "GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4" status: 200 len: 1226 microversion: 2.1 time: 0.090905 Oct 27 15:50:58.670470 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 608/1287] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:50:58 2021] GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4 => generated 1226 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 15:50:58.811669 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-0730032d-c5ee-4e2c-b2cd-1137b9d477d9 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:50:58.821490 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-0730032d-c5ee-4e2c-b2cd-1137b9d477d9 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:50:58.822981 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-0730032d-c5ee-4e2c-b2cd-1137b9d477d9 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:50:58.824158 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-0730032d-c5ee-4e2c-b2cd-1137b9d477d9 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672" status: 200 len: 1748 microversion: 2.20 time: 0.370496 Oct 27 15:50:58.824709 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 680/1288] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Oct 27 15:50:58 2021] GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672 => generated 1748 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 15:50:59.068818 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-f90d83d2-f72c-41ed-be97-e659541c27e0 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:50:59.070296 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-f90d83d2-f72c-41ed-be97-e659541c27e0 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: 62c89161-c119-48b2-839d-712db798ff96] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:50:59.076026 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-f90d83d2-f72c-41ed-be97-e659541c27e0 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:50:59.076466 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-f90d83d2-f72c-41ed-be97-e659541c27e0 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:50:59.077213 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-f90d83d2-f72c-41ed-be97-e659541c27e0 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:50:59.077636 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-f90d83d2-f72c-41ed-be97-e659541c27e0 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:50:59.107113 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-f90d83d2-f72c-41ed-be97-e659541c27e0 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042000 Oct 27 15:50:59.107669 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 609/1289] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Oct 27 15:50:59 2021] GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 15:50:59.687297 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-b0923830-bcc9-492d-af26-9d1890b34acc tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:50:59.687927 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-b0923830-bcc9-492d-af26-9d1890b34acc tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] [instance: a79303e6-05ad-4901-96b7-ce845b4016f4] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:50:59.694231 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-b0923830-bcc9-492d-af26-9d1890b34acc tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:50:59.694670 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-b0923830-bcc9-492d-af26-9d1890b34acc tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:50:59.695433 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-b0923830-bcc9-492d-af26-9d1890b34acc tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:50:59.695899 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-b0923830-bcc9-492d-af26-9d1890b34acc tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:50:59.754778 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-b0923830-bcc9-492d-af26-9d1890b34acc tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c757a383a434a4c9b1b928087af8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8818377e744d4f6ba65560705c191f0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:50:59.762482 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-b0923830-bcc9-492d-af26-9d1890b34acc tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] 10.222.0.64 "GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4" status: 200 len: 1226 microversion: 2.1 time: 0.079234 Oct 27 15:50:59.763043 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 681/1290] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:50:59 2021] GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4 => generated 1226 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 15:50:59.841930 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-dc79afbf-1793-4390-90cf-3a90eadc2b9b tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:50:59.842709 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-dc79afbf-1793-4390-90cf-3a90eadc2b9b tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:50:59.848893 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-dc79afbf-1793-4390-90cf-3a90eadc2b9b tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:50:59.849325 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-dc79afbf-1793-4390-90cf-3a90eadc2b9b tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:50:59.850074 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-dc79afbf-1793-4390-90cf-3a90eadc2b9b tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:50:59.851620 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-dc79afbf-1793-4390-90cf-3a90eadc2b9b tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:50:59.981502 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-dc79afbf-1793-4390-90cf-3a90eadc2b9b tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:50:59.990555 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-dc79afbf-1793-4390-90cf-3a90eadc2b9b tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:50:59.992303 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-dc79afbf-1793-4390-90cf-3a90eadc2b9b tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:50:59.993528 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-dc79afbf-1793-4390-90cf-3a90eadc2b9b tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672" status: 200 len: 1748 microversion: 2.20 time: 0.155336 Oct 27 15:50:59.994124 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 610/1291] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Oct 27 15:50:59 2021] GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672 => generated 1748 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 15:51:00.119054 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-a21e1d85-89a0-403a-874e-df139d18e24f tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:51:00.120113 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-a21e1d85-89a0-403a-874e-df139d18e24f tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: 62c89161-c119-48b2-839d-712db798ff96] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:51:00.126436 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-a21e1d85-89a0-403a-874e-df139d18e24f tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:51:00.126992 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-a21e1d85-89a0-403a-874e-df139d18e24f tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:51:00.127786 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-a21e1d85-89a0-403a-874e-df139d18e24f tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:51:00.128272 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-a21e1d85-89a0-403a-874e-df139d18e24f tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:51:00.160479 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-a21e1d85-89a0-403a-874e-df139d18e24f tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045679 Oct 27 15:51:00.161094 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 682/1292] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Oct 27 15:51:00 2021] GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 15:51:00.779357 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-9867f610-4e1a-4be7-8374-c61b4ccfe4d4 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:51:00.779982 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-9867f610-4e1a-4be7-8374-c61b4ccfe4d4 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] [instance: a79303e6-05ad-4901-96b7-ce845b4016f4] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:51:00.785712 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-9867f610-4e1a-4be7-8374-c61b4ccfe4d4 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:51:00.786152 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-9867f610-4e1a-4be7-8374-c61b4ccfe4d4 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:51:00.786897 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-9867f610-4e1a-4be7-8374-c61b4ccfe4d4 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:51:00.787318 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-9867f610-4e1a-4be7-8374-c61b4ccfe4d4 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:51:00.854448 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-9867f610-4e1a-4be7-8374-c61b4ccfe4d4 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c757a383a434a4c9b1b928087af8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8818377e744d4f6ba65560705c191f0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:51:00.861778 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-9867f610-4e1a-4be7-8374-c61b4ccfe4d4 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] 10.222.0.64 "GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4" status: 200 len: 1226 microversion: 2.1 time: 0.086070 Oct 27 15:51:00.862535 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 611/1293] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:51:00 2021] GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4 => generated 1226 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 15:51:01.012457 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-a51bfd01-ef06-423d-9631-6d1e673ae21f tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:51:01.013057 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-a51bfd01-ef06-423d-9631-6d1e673ae21f tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:51:01.019174 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-a51bfd01-ef06-423d-9631-6d1e673ae21f tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:51:01.019617 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-a51bfd01-ef06-423d-9631-6d1e673ae21f tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:51:01.020416 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-a51bfd01-ef06-423d-9631-6d1e673ae21f tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:51:01.020849 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-a51bfd01-ef06-423d-9631-6d1e673ae21f tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:51:01.142521 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-a51bfd01-ef06-423d-9631-6d1e673ae21f tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:51:01.152647 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-a51bfd01-ef06-423d-9631-6d1e673ae21f tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:51:01.154368 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-a51bfd01-ef06-423d-9631-6d1e673ae21f tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:51:01.155617 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-a51bfd01-ef06-423d-9631-6d1e673ae21f tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672" status: 200 len: 1748 microversion: 2.20 time: 0.146969 Oct 27 15:51:01.156262 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 683/1294] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Oct 27 15:51:01 2021] GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672 => generated 1748 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 15:51:01.173312 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-12261391-8f3d-4df7-b055-a741232b66b7 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:51:01.174349 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-12261391-8f3d-4df7-b055-a741232b66b7 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: 62c89161-c119-48b2-839d-712db798ff96] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:51:01.180629 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-12261391-8f3d-4df7-b055-a741232b66b7 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:51:01.181157 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-12261391-8f3d-4df7-b055-a741232b66b7 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:51:01.182031 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-12261391-8f3d-4df7-b055-a741232b66b7 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:51:01.182542 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-12261391-8f3d-4df7-b055-a741232b66b7 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:51:01.214319 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-12261391-8f3d-4df7-b055-a741232b66b7 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045204 Oct 27 15:51:01.214877 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 612/1295] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Oct 27 15:51:01 2021] GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 15:51:01.878346 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-c3a50cf4-a0a5-49c7-b773-5f24090c3412 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:51:01.878946 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-c3a50cf4-a0a5-49c7-b773-5f24090c3412 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] [instance: a79303e6-05ad-4901-96b7-ce845b4016f4] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:51:01.885812 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-c3a50cf4-a0a5-49c7-b773-5f24090c3412 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:51:01.886261 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-c3a50cf4-a0a5-49c7-b773-5f24090c3412 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:51:01.887960 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-c3a50cf4-a0a5-49c7-b773-5f24090c3412 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:51:01.887960 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-c3a50cf4-a0a5-49c7-b773-5f24090c3412 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:51:01.965871 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-c3a50cf4-a0a5-49c7-b773-5f24090c3412 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c757a383a434a4c9b1b928087af8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8818377e744d4f6ba65560705c191f0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:51:01.973460 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-c3a50cf4-a0a5-49c7-b773-5f24090c3412 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] 10.222.0.64 "GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4" status: 200 len: 1226 microversion: 2.1 time: 0.098909 Oct 27 15:51:01.974023 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 684/1296] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:51:01 2021] GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4 => generated 1226 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 15:51:02.173971 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-d1b1b71c-a378-4f40-9d5d-3c732e158ee5 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:51:02.174518 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-d1b1b71c-a378-4f40-9d5d-3c732e158ee5 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:51:02.185011 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-d1b1b71c-a378-4f40-9d5d-3c732e158ee5 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:51:02.185447 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-d1b1b71c-a378-4f40-9d5d-3c732e158ee5 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:51:02.186194 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-d1b1b71c-a378-4f40-9d5d-3c732e158ee5 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:51:02.186617 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-d1b1b71c-a378-4f40-9d5d-3c732e158ee5 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:51:02.225898 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-ce720d24-c895-4a16-8f36-e8af0c0e1e79 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:51:02.226872 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-ce720d24-c895-4a16-8f36-e8af0c0e1e79 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: 62c89161-c119-48b2-839d-712db798ff96] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:51:02.233103 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-ce720d24-c895-4a16-8f36-e8af0c0e1e79 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:51:02.233545 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-ce720d24-c895-4a16-8f36-e8af0c0e1e79 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:51:02.234318 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-ce720d24-c895-4a16-8f36-e8af0c0e1e79 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:51:02.234752 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-ce720d24-c895-4a16-8f36-e8af0c0e1e79 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:51:02.264777 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-ce720d24-c895-4a16-8f36-e8af0c0e1e79 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042626 Oct 27 15:51:02.265986 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 685/1297] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Oct 27 15:51:02 2021] GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 15:51:02.311020 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-d1b1b71c-a378-4f40-9d5d-3c732e158ee5 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:51:02.322055 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-d1b1b71c-a378-4f40-9d5d-3c732e158ee5 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:51:02.323546 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-d1b1b71c-a378-4f40-9d5d-3c732e158ee5 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:51:02.324712 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-d1b1b71c-a378-4f40-9d5d-3c732e158ee5 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672" status: 200 len: 1748 microversion: 2.20 time: 0.154782 Oct 27 15:51:02.325256 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 613/1298] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Oct 27 15:51:02 2021] GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672 => generated 1748 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 15:51:02.991571 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-c0b39d2d-84d8-43bd-80a3-77ec2d4cd088 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:51:02.992248 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-c0b39d2d-84d8-43bd-80a3-77ec2d4cd088 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] [instance: a79303e6-05ad-4901-96b7-ce845b4016f4] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:51:02.998193 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-c0b39d2d-84d8-43bd-80a3-77ec2d4cd088 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:51:02.998635 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-c0b39d2d-84d8-43bd-80a3-77ec2d4cd088 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:51:02.999400 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-c0b39d2d-84d8-43bd-80a3-77ec2d4cd088 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:51:02.999857 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-c0b39d2d-84d8-43bd-80a3-77ec2d4cd088 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:51:03.061989 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-c0b39d2d-84d8-43bd-80a3-77ec2d4cd088 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c757a383a434a4c9b1b928087af8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8818377e744d4f6ba65560705c191f0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:51:03.070132 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-c0b39d2d-84d8-43bd-80a3-77ec2d4cd088 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] 10.222.0.64 "GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4" status: 200 len: 1226 microversion: 2.1 time: 0.082754 Oct 27 15:51:03.070706 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 686/1299] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:51:02 2021] GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4 => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 15:51:03.277811 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-296199eb-c3f1-48fb-9901-0a59a84ef68a tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:51:03.278760 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-296199eb-c3f1-48fb-9901-0a59a84ef68a tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: 62c89161-c119-48b2-839d-712db798ff96] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:51:03.284903 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-296199eb-c3f1-48fb-9901-0a59a84ef68a tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:51:03.285337 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-296199eb-c3f1-48fb-9901-0a59a84ef68a tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:51:03.286092 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-296199eb-c3f1-48fb-9901-0a59a84ef68a tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:51:03.286513 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-296199eb-c3f1-48fb-9901-0a59a84ef68a tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:51:03.315469 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-296199eb-c3f1-48fb-9901-0a59a84ef68a tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041427 Oct 27 15:51:03.316041 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 614/1300] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Oct 27 15:51:03 2021] GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 15:51:03.342353 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-5c051aed-f686-4e86-b6fa-a79bfb9ca3a6 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:51:03.343206 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-5c051aed-f686-4e86-b6fa-a79bfb9ca3a6 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:51:03.349569 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-5c051aed-f686-4e86-b6fa-a79bfb9ca3a6 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:51:03.350019 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-5c051aed-f686-4e86-b6fa-a79bfb9ca3a6 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:51:03.351315 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-5c051aed-f686-4e86-b6fa-a79bfb9ca3a6 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:51:03.351749 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-5c051aed-f686-4e86-b6fa-a79bfb9ca3a6 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:51:03.476945 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-5c051aed-f686-4e86-b6fa-a79bfb9ca3a6 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:51:03.485117 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-5c051aed-f686-4e86-b6fa-a79bfb9ca3a6 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:51:03.486602 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-5c051aed-f686-4e86-b6fa-a79bfb9ca3a6 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:51:03.487739 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-5c051aed-f686-4e86-b6fa-a79bfb9ca3a6 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672" status: 200 len: 1748 microversion: 2.20 time: 0.149107 Oct 27 15:51:03.488328 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 687/1301] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Oct 27 15:51:03 2021] GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672 => generated 1748 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 15:51:04.086422 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-327d8b2e-c5e5-4f3f-aee4-482db1a3bdb6 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:51:04.086972 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-327d8b2e-c5e5-4f3f-aee4-482db1a3bdb6 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] [instance: a79303e6-05ad-4901-96b7-ce845b4016f4] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:51:04.092824 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-327d8b2e-c5e5-4f3f-aee4-482db1a3bdb6 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:51:04.093534 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-327d8b2e-c5e5-4f3f-aee4-482db1a3bdb6 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:51:04.094292 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-327d8b2e-c5e5-4f3f-aee4-482db1a3bdb6 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:51:04.094725 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-327d8b2e-c5e5-4f3f-aee4-482db1a3bdb6 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:51:04.154312 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-327d8b2e-c5e5-4f3f-aee4-482db1a3bdb6 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c757a383a434a4c9b1b928087af8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8818377e744d4f6ba65560705c191f0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:51:04.161783 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-327d8b2e-c5e5-4f3f-aee4-482db1a3bdb6 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] 10.222.0.64 "GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4" status: 200 len: 1226 microversion: 2.1 time: 0.079205 Oct 27 15:51:04.162342 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 615/1302] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:51:04 2021] GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4 => generated 1226 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 15:51:04.326942 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-29dca9ee-61e0-43e5-99fc-12a43d79c5e7 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:51:04.327886 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-29dca9ee-61e0-43e5-99fc-12a43d79c5e7 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: 62c89161-c119-48b2-839d-712db798ff96] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:51:04.333757 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-29dca9ee-61e0-43e5-99fc-12a43d79c5e7 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:51:04.334210 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-29dca9ee-61e0-43e5-99fc-12a43d79c5e7 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:51:04.335662 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-29dca9ee-61e0-43e5-99fc-12a43d79c5e7 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:51:04.335983 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-29dca9ee-61e0-43e5-99fc-12a43d79c5e7 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:51:04.364648 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-29dca9ee-61e0-43e5-99fc-12a43d79c5e7 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041480 Oct 27 15:51:04.365270 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 688/1303] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Oct 27 15:51:04 2021] GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 15:51:04.508365 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-5a45b206-0f68-4229-b0aa-6246b69f4258 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:51:04.508980 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-5a45b206-0f68-4229-b0aa-6246b69f4258 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:51:04.515116 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-5a45b206-0f68-4229-b0aa-6246b69f4258 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:51:04.515548 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-5a45b206-0f68-4229-b0aa-6246b69f4258 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:51:04.516324 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-5a45b206-0f68-4229-b0aa-6246b69f4258 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:51:04.516752 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-5a45b206-0f68-4229-b0aa-6246b69f4258 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:51:04.642752 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-5a45b206-0f68-4229-b0aa-6246b69f4258 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:51:04.651503 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-5a45b206-0f68-4229-b0aa-6246b69f4258 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:51:04.653037 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-5a45b206-0f68-4229-b0aa-6246b69f4258 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:51:04.654159 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-5a45b206-0f68-4229-b0aa-6246b69f4258 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672" status: 200 len: 1748 microversion: 2.20 time: 0.150187 Oct 27 15:51:04.654698 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 616/1304] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Oct 27 15:51:04 2021] GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672 => generated 1748 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 15:51:05.178495 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-3413b9f3-36b7-4300-99a5-0b0ec6639a9a tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:51:05.179066 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-3413b9f3-36b7-4300-99a5-0b0ec6639a9a tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] [instance: a79303e6-05ad-4901-96b7-ce845b4016f4] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:51:05.184801 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-3413b9f3-36b7-4300-99a5-0b0ec6639a9a tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:51:05.185251 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-3413b9f3-36b7-4300-99a5-0b0ec6639a9a tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:51:05.186056 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-3413b9f3-36b7-4300-99a5-0b0ec6639a9a tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:51:05.186483 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-3413b9f3-36b7-4300-99a5-0b0ec6639a9a tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:51:05.248288 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-3413b9f3-36b7-4300-99a5-0b0ec6639a9a tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c757a383a434a4c9b1b928087af8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8818377e744d4f6ba65560705c191f0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:51:05.255538 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-3413b9f3-36b7-4300-99a5-0b0ec6639a9a tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] 10.222.0.64 "GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4" status: 200 len: 1226 microversion: 2.1 time: 0.080943 Oct 27 15:51:05.256133 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 689/1305] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:51:05 2021] GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4 => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 15:51:05.376054 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-439a4c7b-8542-4606-a4dc-49695908504c tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:51:05.376957 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-439a4c7b-8542-4606-a4dc-49695908504c tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: 62c89161-c119-48b2-839d-712db798ff96] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:51:05.383276 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-439a4c7b-8542-4606-a4dc-49695908504c tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:51:05.383721 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-439a4c7b-8542-4606-a4dc-49695908504c tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:51:05.384526 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-439a4c7b-8542-4606-a4dc-49695908504c tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:51:05.384966 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-439a4c7b-8542-4606-a4dc-49695908504c tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:51:05.414612 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-439a4c7b-8542-4606-a4dc-49695908504c tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042351 Oct 27 15:51:05.415154 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 617/1306] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Oct 27 15:51:05 2021] GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 15:51:05.544835 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 27 15:51:05.545426 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: Wed Oct 27 15:51:05 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Oct 27 15:51:05.673215 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-975345f7-4fae-40f6-8aa7-852d34e7355d tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:51:05.673823 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-975345f7-4fae-40f6-8aa7-852d34e7355d tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:51:05.680448 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-975345f7-4fae-40f6-8aa7-852d34e7355d tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:51:05.680892 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-975345f7-4fae-40f6-8aa7-852d34e7355d tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:51:05.681665 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-975345f7-4fae-40f6-8aa7-852d34e7355d tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:51:05.682095 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-975345f7-4fae-40f6-8aa7-852d34e7355d tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:51:05.806356 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-975345f7-4fae-40f6-8aa7-852d34e7355d tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:51:05.816495 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-975345f7-4fae-40f6-8aa7-852d34e7355d tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:51:05.818365 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-975345f7-4fae-40f6-8aa7-852d34e7355d tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:51:05.820921 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-975345f7-4fae-40f6-8aa7-852d34e7355d tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672" status: 200 len: 1748 microversion: 2.20 time: 0.151370 Oct 27 15:51:05.821535 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 690/1307] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Oct 27 15:51:05 2021] GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672 => generated 1748 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 15:51:06.273548 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-7ed3a0e5-45bf-452b-b450-2e446ed65ba8 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:51:06.274231 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-7ed3a0e5-45bf-452b-b450-2e446ed65ba8 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] [instance: a79303e6-05ad-4901-96b7-ce845b4016f4] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:51:06.281192 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-7ed3a0e5-45bf-452b-b450-2e446ed65ba8 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:51:06.281720 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-7ed3a0e5-45bf-452b-b450-2e446ed65ba8 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:51:06.282621 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-7ed3a0e5-45bf-452b-b450-2e446ed65ba8 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:51:06.283059 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-7ed3a0e5-45bf-452b-b450-2e446ed65ba8 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:51:06.343218 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-7ed3a0e5-45bf-452b-b450-2e446ed65ba8 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c757a383a434a4c9b1b928087af8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8818377e744d4f6ba65560705c191f0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:51:06.350996 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-7ed3a0e5-45bf-452b-b450-2e446ed65ba8 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] 10.222.0.64 "GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4" status: 200 len: 1226 microversion: 2.1 time: 0.081330 Oct 27 15:51:06.351551 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 618/1308] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:51:06 2021] GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4 => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 15:51:06.425803 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-56e2d396-1037-4903-a60b-da66af689aa6 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:51:06.426713 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-56e2d396-1037-4903-a60b-da66af689aa6 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: 62c89161-c119-48b2-839d-712db798ff96] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:51:06.433105 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-56e2d396-1037-4903-a60b-da66af689aa6 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:51:06.433542 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-56e2d396-1037-4903-a60b-da66af689aa6 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:51:06.434299 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-56e2d396-1037-4903-a60b-da66af689aa6 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:51:06.434727 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-56e2d396-1037-4903-a60b-da66af689aa6 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:51:06.462307 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-56e2d396-1037-4903-a60b-da66af689aa6 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040227 Oct 27 15:51:06.462844 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 691/1309] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Oct 27 15:51:06 2021] GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 15:51:06.841007 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-f981e915-bf9a-4eb2-a69c-3b710efe3459 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:51:06.841600 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-f981e915-bf9a-4eb2-a69c-3b710efe3459 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:51:06.847666 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-f981e915-bf9a-4eb2-a69c-3b710efe3459 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:51:06.848131 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-f981e915-bf9a-4eb2-a69c-3b710efe3459 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:51:06.848879 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-f981e915-bf9a-4eb2-a69c-3b710efe3459 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:51:06.849302 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-f981e915-bf9a-4eb2-a69c-3b710efe3459 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:51:06.974075 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-f981e915-bf9a-4eb2-a69c-3b710efe3459 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:51:06.986748 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-f981e915-bf9a-4eb2-a69c-3b710efe3459 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:51:06.989509 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-f981e915-bf9a-4eb2-a69c-3b710efe3459 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:51:06.990683 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-f981e915-bf9a-4eb2-a69c-3b710efe3459 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672" status: 200 len: 1748 microversion: 2.20 time: 0.153707 Oct 27 15:51:06.991237 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 619/1310] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Oct 27 15:51:06 2021] GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672 => generated 1748 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 15:51:07.368872 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-8b08b8a1-1982-43d0-95e4-c59be04908ec tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:51:07.369452 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-8b08b8a1-1982-43d0-95e4-c59be04908ec tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] [instance: a79303e6-05ad-4901-96b7-ce845b4016f4] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:51:07.375653 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-8b08b8a1-1982-43d0-95e4-c59be04908ec tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:51:07.376133 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-8b08b8a1-1982-43d0-95e4-c59be04908ec tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:51:07.376892 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-8b08b8a1-1982-43d0-95e4-c59be04908ec tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:51:07.377321 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-8b08b8a1-1982-43d0-95e4-c59be04908ec tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:51:07.440994 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-8b08b8a1-1982-43d0-95e4-c59be04908ec tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c757a383a434a4c9b1b928087af8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8818377e744d4f6ba65560705c191f0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:51:07.448685 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-8b08b8a1-1982-43d0-95e4-c59be04908ec tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] 10.222.0.64 "GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4" status: 200 len: 1226 microversion: 2.1 time: 0.083574 Oct 27 15:51:07.449243 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 692/1311] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:51:07 2021] GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4 => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 15:51:07.473786 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-d68bff4c-ac49-4525-bcbe-624ae48440fa tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:51:07.474832 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-d68bff4c-ac49-4525-bcbe-624ae48440fa tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: 62c89161-c119-48b2-839d-712db798ff96] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:51:07.482254 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-d68bff4c-ac49-4525-bcbe-624ae48440fa tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:51:07.482694 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-d68bff4c-ac49-4525-bcbe-624ae48440fa tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:51:07.483457 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-d68bff4c-ac49-4525-bcbe-624ae48440fa tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:51:07.483910 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-d68bff4c-ac49-4525-bcbe-624ae48440fa tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:51:07.512285 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-d68bff4c-ac49-4525-bcbe-624ae48440fa tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042153 Oct 27 15:51:07.512835 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 620/1312] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Oct 27 15:51:07 2021] GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 15:51:08.009522 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-91db77ad-b76a-409b-bdb3-44cf27875871 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:51:08.010152 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-91db77ad-b76a-409b-bdb3-44cf27875871 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:51:08.015964 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-91db77ad-b76a-409b-bdb3-44cf27875871 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:51:08.016409 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-91db77ad-b76a-409b-bdb3-44cf27875871 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:51:08.017167 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-91db77ad-b76a-409b-bdb3-44cf27875871 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:51:08.017601 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-91db77ad-b76a-409b-bdb3-44cf27875871 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:51:08.135606 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-91db77ad-b76a-409b-bdb3-44cf27875871 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:51:08.143956 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-91db77ad-b76a-409b-bdb3-44cf27875871 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:51:08.145630 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-91db77ad-b76a-409b-bdb3-44cf27875871 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:51:08.147825 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-91db77ad-b76a-409b-bdb3-44cf27875871 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672" status: 200 len: 1748 microversion: 2.20 time: 0.141668 Oct 27 15:51:08.148414 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 693/1313] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Oct 27 15:51:08 2021] GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672 => generated 1748 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 15:51:08.465251 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-96133ca9-ef7d-4ebb-b249-03aa7f8b2a81 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:51:08.465854 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-96133ca9-ef7d-4ebb-b249-03aa7f8b2a81 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] [instance: a79303e6-05ad-4901-96b7-ce845b4016f4] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:51:08.471873 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-96133ca9-ef7d-4ebb-b249-03aa7f8b2a81 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:51:08.472317 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-96133ca9-ef7d-4ebb-b249-03aa7f8b2a81 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:51:08.473070 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-96133ca9-ef7d-4ebb-b249-03aa7f8b2a81 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:51:08.473499 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-96133ca9-ef7d-4ebb-b249-03aa7f8b2a81 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:51:08.525894 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-756ad0b1-c303-4611-8d75-e9556fac9a24 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:51:08.526811 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-756ad0b1-c303-4611-8d75-e9556fac9a24 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: 62c89161-c119-48b2-839d-712db798ff96] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:51:08.533254 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-756ad0b1-c303-4611-8d75-e9556fac9a24 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:51:08.533707 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-756ad0b1-c303-4611-8d75-e9556fac9a24 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:51:08.534525 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-756ad0b1-c303-4611-8d75-e9556fac9a24 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:51:08.534973 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-756ad0b1-c303-4611-8d75-e9556fac9a24 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:51:08.539151 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-96133ca9-ef7d-4ebb-b249-03aa7f8b2a81 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c757a383a434a4c9b1b928087af8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8818377e744d4f6ba65560705c191f0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:51:08.547053 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-96133ca9-ef7d-4ebb-b249-03aa7f8b2a81 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] 10.222.0.64 "GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4" status: 200 len: 1226 microversion: 2.1 time: 0.085533 Oct 27 15:51:08.547622 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 621/1314] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:51:08 2021] GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4 => generated 1226 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 15:51:08.566307 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-756ad0b1-c303-4611-8d75-e9556fac9a24 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044148 Oct 27 15:51:08.566786 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 694/1315] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Oct 27 15:51:08 2021] GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 15:51:09.166648 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-97336d57-e214-4b54-8321-aa8fe575ece6 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:51:09.167248 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-97336d57-e214-4b54-8321-aa8fe575ece6 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:51:09.173067 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-97336d57-e214-4b54-8321-aa8fe575ece6 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:51:09.173446 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-97336d57-e214-4b54-8321-aa8fe575ece6 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:51:09.174235 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-97336d57-e214-4b54-8321-aa8fe575ece6 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:51:09.174656 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-97336d57-e214-4b54-8321-aa8fe575ece6 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:51:09.293820 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-97336d57-e214-4b54-8321-aa8fe575ece6 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:51:09.301891 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-97336d57-e214-4b54-8321-aa8fe575ece6 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:51:09.303455 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-97336d57-e214-4b54-8321-aa8fe575ece6 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:51:09.304634 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-97336d57-e214-4b54-8321-aa8fe575ece6 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672" status: 200 len: 1748 microversion: 2.20 time: 0.142565 Oct 27 15:51:09.305193 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 622/1316] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Oct 27 15:51:09 2021] GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672 => generated 1748 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 15:51:09.565909 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-50c261a7-fa2e-460a-b348-967348c28e96 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:51:09.566529 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-50c261a7-fa2e-460a-b348-967348c28e96 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] [instance: a79303e6-05ad-4901-96b7-ce845b4016f4] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:51:09.573519 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-50c261a7-fa2e-460a-b348-967348c28e96 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:51:09.573965 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-50c261a7-fa2e-460a-b348-967348c28e96 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:51:09.574730 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-50c261a7-fa2e-460a-b348-967348c28e96 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:51:09.575164 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-50c261a7-fa2e-460a-b348-967348c28e96 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:51:09.578313 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-e1ee6da0-0fb9-416b-abfd-902c14c1b241 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:51:09.579217 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-e1ee6da0-0fb9-416b-abfd-902c14c1b241 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: 62c89161-c119-48b2-839d-712db798ff96] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:51:09.585552 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-e1ee6da0-0fb9-416b-abfd-902c14c1b241 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:51:09.585991 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-e1ee6da0-0fb9-416b-abfd-902c14c1b241 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:51:09.586760 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-e1ee6da0-0fb9-416b-abfd-902c14c1b241 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:51:09.587186 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-e1ee6da0-0fb9-416b-abfd-902c14c1b241 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:51:09.617013 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-e1ee6da0-0fb9-416b-abfd-902c14c1b241 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042559 Oct 27 15:51:09.617589 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 623/1317] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Oct 27 15:51:09 2021] GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 15:51:09.635599 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-50c261a7-fa2e-460a-b348-967348c28e96 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c757a383a434a4c9b1b928087af8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8818377e744d4f6ba65560705c191f0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:51:09.643201 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-50c261a7-fa2e-460a-b348-967348c28e96 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] 10.222.0.64 "GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4" status: 200 len: 1226 microversion: 2.1 time: 0.081037 Oct 27 15:51:09.643837 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 695/1318] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:51:09 2021] GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4 => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 15:51:10.323010 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-934e4de7-a1f2-4ba9-a753-b641e578fcf9 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:51:10.323611 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-934e4de7-a1f2-4ba9-a753-b641e578fcf9 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:51:10.329408 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-934e4de7-a1f2-4ba9-a753-b641e578fcf9 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:51:10.329849 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-934e4de7-a1f2-4ba9-a753-b641e578fcf9 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:51:10.330603 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-934e4de7-a1f2-4ba9-a753-b641e578fcf9 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:51:10.331028 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-934e4de7-a1f2-4ba9-a753-b641e578fcf9 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:51:10.450381 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-934e4de7-a1f2-4ba9-a753-b641e578fcf9 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:51:10.458434 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-934e4de7-a1f2-4ba9-a753-b641e578fcf9 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:51:10.460576 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-934e4de7-a1f2-4ba9-a753-b641e578fcf9 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:51:10.461719 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-934e4de7-a1f2-4ba9-a753-b641e578fcf9 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672" status: 200 len: 1748 microversion: 2.20 time: 0.143053 Oct 27 15:51:10.462276 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 624/1319] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Oct 27 15:51:10 2021] GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672 => generated 1748 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 15:51:10.628925 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-b53b592f-4661-4668-8530-4165a346344e tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:51:10.629751 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-b53b592f-4661-4668-8530-4165a346344e tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: 62c89161-c119-48b2-839d-712db798ff96] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:51:10.636273 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-b53b592f-4661-4668-8530-4165a346344e tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:51:10.636710 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-b53b592f-4661-4668-8530-4165a346344e tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:51:10.637470 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-b53b592f-4661-4668-8530-4165a346344e tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:51:10.637897 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-b53b592f-4661-4668-8530-4165a346344e tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:51:10.660601 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-ace30a36-e567-4f1c-ad22-245667fe7433 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:51:10.661360 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-ace30a36-e567-4f1c-ad22-245667fe7433 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] [instance: a79303e6-05ad-4901-96b7-ce845b4016f4] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:51:10.667642 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-b53b592f-4661-4668-8530-4165a346344e tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042540 Oct 27 15:51:10.668259 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 696/1320] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Oct 27 15:51:10 2021] GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 15:51:10.668763 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-ace30a36-e567-4f1c-ad22-245667fe7433 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:51:10.669338 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-ace30a36-e567-4f1c-ad22-245667fe7433 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:51:10.670275 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-ace30a36-e567-4f1c-ad22-245667fe7433 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:51:10.670804 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-ace30a36-e567-4f1c-ad22-245667fe7433 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:51:10.731369 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-ace30a36-e567-4f1c-ad22-245667fe7433 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c757a383a434a4c9b1b928087af8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8818377e744d4f6ba65560705c191f0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:51:10.738807 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-ace30a36-e567-4f1c-ad22-245667fe7433 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] 10.222.0.64 "GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4" status: 200 len: 1226 microversion: 2.1 time: 0.081830 Oct 27 15:51:10.739359 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 625/1321] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:51:10 2021] GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4 => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 15:51:11.479468 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-e1eba02f-1e9a-4e38-9ef7-b924a2e647b7 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:51:11.480098 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-e1eba02f-1e9a-4e38-9ef7-b924a2e647b7 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:51:11.485894 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-e1eba02f-1e9a-4e38-9ef7-b924a2e647b7 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:51:11.486337 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-e1eba02f-1e9a-4e38-9ef7-b924a2e647b7 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:51:11.487101 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-e1eba02f-1e9a-4e38-9ef7-b924a2e647b7 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:51:11.487532 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-e1eba02f-1e9a-4e38-9ef7-b924a2e647b7 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:51:11.610172 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-e1eba02f-1e9a-4e38-9ef7-b924a2e647b7 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:51:11.618581 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-e1eba02f-1e9a-4e38-9ef7-b924a2e647b7 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:51:11.620102 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-e1eba02f-1e9a-4e38-9ef7-b924a2e647b7 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:51:11.621248 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-e1eba02f-1e9a-4e38-9ef7-b924a2e647b7 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672" status: 200 len: 1748 microversion: 2.20 time: 0.145537 Oct 27 15:51:11.621790 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 697/1322] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Oct 27 15:51:11 2021] GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672 => generated 1748 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 15:51:11.679060 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-c845725d-369e-4eb2-82bf-aa8aee0e21d2 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:51:11.680397 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-c845725d-369e-4eb2-82bf-aa8aee0e21d2 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: 62c89161-c119-48b2-839d-712db798ff96] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:51:11.686815 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-c845725d-369e-4eb2-82bf-aa8aee0e21d2 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:51:11.687239 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-c845725d-369e-4eb2-82bf-aa8aee0e21d2 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:51:11.688037 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-c845725d-369e-4eb2-82bf-aa8aee0e21d2 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:51:11.688467 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-c845725d-369e-4eb2-82bf-aa8aee0e21d2 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:51:11.717718 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-c845725d-369e-4eb2-82bf-aa8aee0e21d2 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043009 Oct 27 15:51:11.718527 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 626/1323] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Oct 27 15:51:11 2021] GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 15:51:11.755989 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-11bd7526-9427-4834-b02b-ab5193c8d84b tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:51:11.757121 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-11bd7526-9427-4834-b02b-ab5193c8d84b tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] [instance: a79303e6-05ad-4901-96b7-ce845b4016f4] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:51:11.763333 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-11bd7526-9427-4834-b02b-ab5193c8d84b tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:51:11.763776 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-11bd7526-9427-4834-b02b-ab5193c8d84b tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:51:11.764574 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-11bd7526-9427-4834-b02b-ab5193c8d84b tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:51:11.765008 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-11bd7526-9427-4834-b02b-ab5193c8d84b tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:51:11.824994 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-11bd7526-9427-4834-b02b-ab5193c8d84b tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c757a383a434a4c9b1b928087af8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8818377e744d4f6ba65560705c191f0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:51:11.832566 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-11bd7526-9427-4834-b02b-ab5193c8d84b tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] 10.222.0.64 "GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4" status: 200 len: 1226 microversion: 2.1 time: 0.080349 Oct 27 15:51:11.833130 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 698/1324] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:51:11 2021] GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4 => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 15:51:12.639696 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-6887900e-a6b2-42c9-bff0-e372501f956f tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:51:12.640285 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-6887900e-a6b2-42c9-bff0-e372501f956f tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:51:12.646197 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-6887900e-a6b2-42c9-bff0-e372501f956f tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:51:12.646957 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-6887900e-a6b2-42c9-bff0-e372501f956f tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:51:12.647902 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-6887900e-a6b2-42c9-bff0-e372501f956f tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:51:12.648443 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-6887900e-a6b2-42c9-bff0-e372501f956f tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:51:12.730001 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-b8d3b7c9-f495-4c7b-a775-ec7aa166d3ad tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:51:12.731056 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-b8d3b7c9-f495-4c7b-a775-ec7aa166d3ad tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: 62c89161-c119-48b2-839d-712db798ff96] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:51:12.736886 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-b8d3b7c9-f495-4c7b-a775-ec7aa166d3ad tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:51:12.737334 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-b8d3b7c9-f495-4c7b-a775-ec7aa166d3ad tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:51:12.738102 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-b8d3b7c9-f495-4c7b-a775-ec7aa166d3ad tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:51:12.738530 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-b8d3b7c9-f495-4c7b-a775-ec7aa166d3ad tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:51:12.769636 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-b8d3b7c9-f495-4c7b-a775-ec7aa166d3ad tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043577 Oct 27 15:51:12.770972 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 699/1325] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Oct 27 15:51:12 2021] GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 15:51:12.773451 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-6887900e-a6b2-42c9-bff0-e372501f956f tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:51:12.781688 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-6887900e-a6b2-42c9-bff0-e372501f956f tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:51:12.783176 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-6887900e-a6b2-42c9-bff0-e372501f956f tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:51:12.784350 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-6887900e-a6b2-42c9-bff0-e372501f956f tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672" status: 200 len: 1748 microversion: 2.20 time: 0.148512 Oct 27 15:51:12.784905 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 627/1326] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Oct 27 15:51:12 2021] GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672 => generated 1748 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 15:51:12.849329 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-fea0204f-0084-452e-874a-4fd0a15f24a4 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:51:12.850552 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-fea0204f-0084-452e-874a-4fd0a15f24a4 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] [instance: a79303e6-05ad-4901-96b7-ce845b4016f4] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:51:12.856538 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-fea0204f-0084-452e-874a-4fd0a15f24a4 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:51:12.856984 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-fea0204f-0084-452e-874a-4fd0a15f24a4 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:51:12.857762 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-fea0204f-0084-452e-874a-4fd0a15f24a4 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:51:12.858197 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-fea0204f-0084-452e-874a-4fd0a15f24a4 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:51:12.922187 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-fea0204f-0084-452e-874a-4fd0a15f24a4 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c757a383a434a4c9b1b928087af8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8818377e744d4f6ba65560705c191f0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:51:12.930061 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-fea0204f-0084-452e-874a-4fd0a15f24a4 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] 10.222.0.64 "GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4" status: 200 len: 1226 microversion: 2.1 time: 0.084424 Oct 27 15:51:12.930634 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 700/1327] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:51:12 2021] GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4 => generated 1226 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 15:51:13.782714 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-f2c98e32-ba93-43ba-9b9b-08fe40c1b8d7 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:51:13.783672 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-f2c98e32-ba93-43ba-9b9b-08fe40c1b8d7 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: 62c89161-c119-48b2-839d-712db798ff96] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:51:13.790152 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-f2c98e32-ba93-43ba-9b9b-08fe40c1b8d7 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:51:13.790651 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-f2c98e32-ba93-43ba-9b9b-08fe40c1b8d7 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:51:13.791459 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-f2c98e32-ba93-43ba-9b9b-08fe40c1b8d7 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:51:13.791958 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-f2c98e32-ba93-43ba-9b9b-08fe40c1b8d7 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:51:13.806344 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-0413c6de-a45e-420c-84b2-3a77caa31f2e tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:51:13.807343 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-0413c6de-a45e-420c-84b2-3a77caa31f2e tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:51:13.816882 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-0413c6de-a45e-420c-84b2-3a77caa31f2e tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:51:13.817578 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-0413c6de-a45e-420c-84b2-3a77caa31f2e tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:51:13.819408 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-0413c6de-a45e-420c-84b2-3a77caa31f2e tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:51:13.820350 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-0413c6de-a45e-420c-84b2-3a77caa31f2e tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:51:13.835044 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-f2c98e32-ba93-43ba-9b9b-08fe40c1b8d7 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055475 Oct 27 15:51:13.837948 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 628/1328] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Oct 27 15:51:13 2021] GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 15:51:13.948902 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-0413c6de-a45e-420c-84b2-3a77caa31f2e tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:51:13.949639 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-cf86ca96-5fa8-4ab2-bc73-58af7e0cbc80 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:51:13.950674 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-cf86ca96-5fa8-4ab2-bc73-58af7e0cbc80 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] [instance: a79303e6-05ad-4901-96b7-ce845b4016f4] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:51:13.959510 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-cf86ca96-5fa8-4ab2-bc73-58af7e0cbc80 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:51:13.960258 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-cf86ca96-5fa8-4ab2-bc73-58af7e0cbc80 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:51:13.961483 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-cf86ca96-5fa8-4ab2-bc73-58af7e0cbc80 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:51:13.962188 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-cf86ca96-5fa8-4ab2-bc73-58af7e0cbc80 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:51:13.962590 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-0413c6de-a45e-420c-84b2-3a77caa31f2e tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:51:13.965329 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-0413c6de-a45e-420c-84b2-3a77caa31f2e tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:51:13.967324 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-0413c6de-a45e-420c-84b2-3a77caa31f2e tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672" status: 200 len: 1748 microversion: 2.20 time: 0.167665 Oct 27 15:51:13.968524 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 701/1329] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Oct 27 15:51:13 2021] GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672 => generated 1748 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 15:51:14.044372 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-cf86ca96-5fa8-4ab2-bc73-58af7e0cbc80 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c757a383a434a4c9b1b928087af8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8818377e744d4f6ba65560705c191f0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:51:14.052402 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-cf86ca96-5fa8-4ab2-bc73-58af7e0cbc80 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] 10.222.0.64 "GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4" status: 200 len: 1226 microversion: 2.1 time: 0.108989 Oct 27 15:51:14.053118 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 629/1330] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:51:13 2021] GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4 => generated 1226 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 15:51:14.848005 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-6228d7d9-24e0-4058-8524-662e7ef9a9c1 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:51:14.848915 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-6228d7d9-24e0-4058-8524-662e7ef9a9c1 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: 62c89161-c119-48b2-839d-712db798ff96] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:51:14.855323 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-6228d7d9-24e0-4058-8524-662e7ef9a9c1 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:51:14.855773 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-6228d7d9-24e0-4058-8524-662e7ef9a9c1 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:51:14.856582 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-6228d7d9-24e0-4058-8524-662e7ef9a9c1 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:51:14.857018 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-6228d7d9-24e0-4058-8524-662e7ef9a9c1 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:51:14.888914 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-6228d7d9-24e0-4058-8524-662e7ef9a9c1 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044436 Oct 27 15:51:14.889690 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 702/1331] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Oct 27 15:51:14 2021] GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 15:51:14.995702 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-5e53c351-4835-4d75-b9fd-b2a219e1c947 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:51:14.996322 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-5e53c351-4835-4d75-b9fd-b2a219e1c947 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:51:15.002521 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-5e53c351-4835-4d75-b9fd-b2a219e1c947 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:51:15.002960 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-5e53c351-4835-4d75-b9fd-b2a219e1c947 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:51:15.003723 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-5e53c351-4835-4d75-b9fd-b2a219e1c947 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:51:15.004198 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-5e53c351-4835-4d75-b9fd-b2a219e1c947 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:51:15.070308 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-7103d71b-2756-491e-86c1-0bd2fba25b7d tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:51:15.070929 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-7103d71b-2756-491e-86c1-0bd2fba25b7d tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] [instance: a79303e6-05ad-4901-96b7-ce845b4016f4] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:51:15.077370 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-7103d71b-2756-491e-86c1-0bd2fba25b7d tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:51:15.077953 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-7103d71b-2756-491e-86c1-0bd2fba25b7d tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:51:15.078867 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-7103d71b-2756-491e-86c1-0bd2fba25b7d tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:51:15.079366 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-7103d71b-2756-491e-86c1-0bd2fba25b7d tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:51:15.147150 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-7103d71b-2756-491e-86c1-0bd2fba25b7d tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c757a383a434a4c9b1b928087af8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8818377e744d4f6ba65560705c191f0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:51:15.155258 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-7103d71b-2756-491e-86c1-0bd2fba25b7d tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] 10.222.0.64 "GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4" status: 200 len: 1226 microversion: 2.1 time: 0.089616 Oct 27 15:51:15.155837 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 703/1332] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:51:15 2021] GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4 => generated 1226 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 15:51:15.276759 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-5e53c351-4835-4d75-b9fd-b2a219e1c947 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:51:15.285202 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-5e53c351-4835-4d75-b9fd-b2a219e1c947 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:51:15.286682 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-5e53c351-4835-4d75-b9fd-b2a219e1c947 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:51:15.288657 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-5e53c351-4835-4d75-b9fd-b2a219e1c947 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672" status: 200 len: 1748 microversion: 2.20 time: 0.296535 Oct 27 15:51:15.289229 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 630/1333] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Oct 27 15:51:14 2021] GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672 => generated 1748 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 15:51:15.901736 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-7e88e35f-cea0-477b-9075-37bc6522f16a tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:51:15.902734 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-7e88e35f-cea0-477b-9075-37bc6522f16a tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: 62c89161-c119-48b2-839d-712db798ff96] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:51:15.909061 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-7e88e35f-cea0-477b-9075-37bc6522f16a tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:51:15.909425 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-7e88e35f-cea0-477b-9075-37bc6522f16a tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:51:15.910205 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-7e88e35f-cea0-477b-9075-37bc6522f16a tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:51:15.910672 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-7e88e35f-cea0-477b-9075-37bc6522f16a tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:51:15.952381 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-7e88e35f-cea0-477b-9075-37bc6522f16a tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054026 Oct 27 15:51:15.953320 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 704/1334] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Oct 27 15:51:15 2021] GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 15:51:16.173146 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-2871a474-12f3-44f1-828d-e457dd091604 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:51:16.173799 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-2871a474-12f3-44f1-828d-e457dd091604 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] [instance: a79303e6-05ad-4901-96b7-ce845b4016f4] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:51:16.180006 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-2871a474-12f3-44f1-828d-e457dd091604 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:51:16.180449 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-2871a474-12f3-44f1-828d-e457dd091604 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:51:16.181220 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-2871a474-12f3-44f1-828d-e457dd091604 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:51:16.181650 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-2871a474-12f3-44f1-828d-e457dd091604 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:51:16.246716 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-2871a474-12f3-44f1-828d-e457dd091604 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c757a383a434a4c9b1b928087af8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8818377e744d4f6ba65560705c191f0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:51:16.254100 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-2871a474-12f3-44f1-828d-e457dd091604 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] 10.222.0.64 "GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4" status: 200 len: 1226 microversion: 2.1 time: 0.084713 Oct 27 15:51:16.254650 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 631/1335] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:51:16 2021] GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4 => generated 1226 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 15:51:16.306974 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-0bfd6774-e5b1-46b0-9f68-2e07da4bac6f tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:51:16.307586 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-0bfd6774-e5b1-46b0-9f68-2e07da4bac6f tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:51:16.313390 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-0bfd6774-e5b1-46b0-9f68-2e07da4bac6f tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:51:16.313846 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-0bfd6774-e5b1-46b0-9f68-2e07da4bac6f tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:51:16.314623 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-0bfd6774-e5b1-46b0-9f68-2e07da4bac6f tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:51:16.315063 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-0bfd6774-e5b1-46b0-9f68-2e07da4bac6f tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:51:16.443316 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-0bfd6774-e5b1-46b0-9f68-2e07da4bac6f tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:51:16.452223 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-0bfd6774-e5b1-46b0-9f68-2e07da4bac6f tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:51:16.453709 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-0bfd6774-e5b1-46b0-9f68-2e07da4bac6f tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:51:16.455230 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-0bfd6774-e5b1-46b0-9f68-2e07da4bac6f tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672" status: 200 len: 1748 microversion: 2.20 time: 0.152628 Oct 27 15:51:16.455823 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 705/1336] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Oct 27 15:51:16 2021] GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672 => generated 1748 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 15:51:16.966282 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-dd433eb9-3102-40f6-8bf8-fb4b60c872b8 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:51:16.967182 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-dd433eb9-3102-40f6-8bf8-fb4b60c872b8 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: 62c89161-c119-48b2-839d-712db798ff96] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:51:16.973287 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-dd433eb9-3102-40f6-8bf8-fb4b60c872b8 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:51:16.973717 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-dd433eb9-3102-40f6-8bf8-fb4b60c872b8 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:51:16.974481 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-dd433eb9-3102-40f6-8bf8-fb4b60c872b8 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:51:16.974979 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-dd433eb9-3102-40f6-8bf8-fb4b60c872b8 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:51:17.003003 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-dd433eb9-3102-40f6-8bf8-fb4b60c872b8 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040485 Oct 27 15:51:17.003549 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 632/1337] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Oct 27 15:51:16 2021] GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 15:51:17.270762 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-07d01bd3-9a04-4165-a84d-f9dda4d1dac6 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:51:17.271352 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-07d01bd3-9a04-4165-a84d-f9dda4d1dac6 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] [instance: a79303e6-05ad-4901-96b7-ce845b4016f4] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:51:17.278508 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-07d01bd3-9a04-4165-a84d-f9dda4d1dac6 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:51:17.278957 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-07d01bd3-9a04-4165-a84d-f9dda4d1dac6 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:51:17.279731 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-07d01bd3-9a04-4165-a84d-f9dda4d1dac6 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:51:17.280192 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-07d01bd3-9a04-4165-a84d-f9dda4d1dac6 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:51:17.339126 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-07d01bd3-9a04-4165-a84d-f9dda4d1dac6 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c757a383a434a4c9b1b928087af8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8818377e744d4f6ba65560705c191f0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:51:17.346605 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-07d01bd3-9a04-4165-a84d-f9dda4d1dac6 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] 10.222.0.64 "GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4" status: 200 len: 1226 microversion: 2.1 time: 0.079544 Oct 27 15:51:17.347167 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 706/1338] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:51:17 2021] GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4 => generated 1226 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 15:51:17.473546 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-382370db-9bbf-42f8-8bef-e380232827ff tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:51:17.474158 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-382370db-9bbf-42f8-8bef-e380232827ff tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:51:17.480556 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-382370db-9bbf-42f8-8bef-e380232827ff tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:51:17.481004 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-382370db-9bbf-42f8-8bef-e380232827ff tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:51:17.481773 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-382370db-9bbf-42f8-8bef-e380232827ff tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:51:17.482208 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-382370db-9bbf-42f8-8bef-e380232827ff tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:51:17.604917 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-382370db-9bbf-42f8-8bef-e380232827ff tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:51:17.613090 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-382370db-9bbf-42f8-8bef-e380232827ff tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:51:17.614568 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-382370db-9bbf-42f8-8bef-e380232827ff tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:51:17.615800 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-382370db-9bbf-42f8-8bef-e380232827ff tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672" status: 200 len: 1748 microversion: 2.20 time: 0.145992 Oct 27 15:51:17.616562 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 633/1339] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Oct 27 15:51:17 2021] GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672 => generated 1748 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 15:51:18.015116 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-bf4517fe-f16c-4b1b-a68c-0933845d44f7 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:51:18.016074 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-bf4517fe-f16c-4b1b-a68c-0933845d44f7 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: 62c89161-c119-48b2-839d-712db798ff96] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:51:18.022092 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-bf4517fe-f16c-4b1b-a68c-0933845d44f7 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:51:18.022552 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-bf4517fe-f16c-4b1b-a68c-0933845d44f7 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:51:18.023331 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-bf4517fe-f16c-4b1b-a68c-0933845d44f7 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:51:18.023768 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-bf4517fe-f16c-4b1b-a68c-0933845d44f7 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:51:18.054654 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-bf4517fe-f16c-4b1b-a68c-0933845d44f7 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043321 Oct 27 15:51:18.055245 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 707/1340] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Oct 27 15:51:18 2021] GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 15:51:18.363375 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-68c71a6c-c381-4b72-a949-197387186e25 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:51:18.364018 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-68c71a6c-c381-4b72-a949-197387186e25 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] [instance: a79303e6-05ad-4901-96b7-ce845b4016f4] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:51:18.370357 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-68c71a6c-c381-4b72-a949-197387186e25 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:51:18.370914 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-68c71a6c-c381-4b72-a949-197387186e25 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:51:18.371652 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-68c71a6c-c381-4b72-a949-197387186e25 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:51:18.372186 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-68c71a6c-c381-4b72-a949-197387186e25 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:51:18.432426 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-68c71a6c-c381-4b72-a949-197387186e25 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c757a383a434a4c9b1b928087af8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8818377e744d4f6ba65560705c191f0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:51:18.439647 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-68c71a6c-c381-4b72-a949-197387186e25 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] 10.222.0.64 "GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4" status: 200 len: 1226 microversion: 2.1 time: 0.080069 Oct 27 15:51:18.440221 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 634/1341] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:51:18 2021] GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4 => generated 1226 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 15:51:18.633933 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-7488371c-c771-466a-a695-6fd797026ff8 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:51:18.634474 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-7488371c-c771-466a-a695-6fd797026ff8 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:51:18.640701 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-7488371c-c771-466a-a695-6fd797026ff8 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:51:18.641171 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-7488371c-c771-466a-a695-6fd797026ff8 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:51:18.641932 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-7488371c-c771-466a-a695-6fd797026ff8 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:51:18.642359 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-7488371c-c771-466a-a695-6fd797026ff8 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:51:18.762954 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-7488371c-c771-466a-a695-6fd797026ff8 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:51:18.771085 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-7488371c-c771-466a-a695-6fd797026ff8 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:51:18.773095 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-7488371c-c771-466a-a695-6fd797026ff8 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:51:18.774249 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-7488371c-c771-466a-a695-6fd797026ff8 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672" status: 200 len: 1748 microversion: 2.20 time: 0.144229 Oct 27 15:51:18.774799 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 708/1342] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Oct 27 15:51:18 2021] GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672 => generated 1748 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 15:51:19.066492 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-53c68d79-afe7-4a38-8107-bf01b50c1060 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:51:19.067454 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-53c68d79-afe7-4a38-8107-bf01b50c1060 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: 62c89161-c119-48b2-839d-712db798ff96] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:51:19.074442 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-53c68d79-afe7-4a38-8107-bf01b50c1060 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:51:19.074905 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-53c68d79-afe7-4a38-8107-bf01b50c1060 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:51:19.075782 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-53c68d79-afe7-4a38-8107-bf01b50c1060 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:51:19.076284 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-53c68d79-afe7-4a38-8107-bf01b50c1060 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:51:19.106554 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-53c68d79-afe7-4a38-8107-bf01b50c1060 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043798 Oct 27 15:51:19.107114 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 635/1343] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Oct 27 15:51:19 2021] GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 15:51:19.459217 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-25c11374-d95b-4e5f-b73b-b2cad52c2791 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:51:19.459867 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-25c11374-d95b-4e5f-b73b-b2cad52c2791 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] [instance: a79303e6-05ad-4901-96b7-ce845b4016f4] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:51:19.466138 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-25c11374-d95b-4e5f-b73b-b2cad52c2791 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:51:19.466813 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-25c11374-d95b-4e5f-b73b-b2cad52c2791 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:51:19.468057 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-25c11374-d95b-4e5f-b73b-b2cad52c2791 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:51:19.468431 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-25c11374-d95b-4e5f-b73b-b2cad52c2791 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:51:19.528730 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-25c11374-d95b-4e5f-b73b-b2cad52c2791 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c757a383a434a4c9b1b928087af8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8818377e744d4f6ba65560705c191f0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:51:19.536040 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-25c11374-d95b-4e5f-b73b-b2cad52c2791 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] 10.222.0.64 "GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4" status: 200 len: 1226 microversion: 2.1 time: 0.080525 Oct 27 15:51:19.536606 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 709/1344] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:51:19 2021] GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4 => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 15:51:19.793151 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-a74c2c64-0ce0-4104-9ac6-631104d0d5b8 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:51:19.793681 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-a74c2c64-0ce0-4104-9ac6-631104d0d5b8 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:51:19.799646 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-a74c2c64-0ce0-4104-9ac6-631104d0d5b8 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:51:19.800238 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-a74c2c64-0ce0-4104-9ac6-631104d0d5b8 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:51:19.801004 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-a74c2c64-0ce0-4104-9ac6-631104d0d5b8 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:51:19.801433 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-a74c2c64-0ce0-4104-9ac6-631104d0d5b8 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:51:19.924356 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-a74c2c64-0ce0-4104-9ac6-631104d0d5b8 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:51:19.933192 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-a74c2c64-0ce0-4104-9ac6-631104d0d5b8 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:51:19.934687 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-a74c2c64-0ce0-4104-9ac6-631104d0d5b8 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:51:19.935826 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-a74c2c64-0ce0-4104-9ac6-631104d0d5b8 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672" status: 200 len: 1748 microversion: 2.20 time: 0.146560 Oct 27 15:51:19.936394 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 636/1345] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Oct 27 15:51:19 2021] GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672 => generated 1748 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 15:51:20.118156 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-132d189c-f61e-453e-996f-45bf4d64baeb tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:51:20.118949 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-132d189c-f61e-453e-996f-45bf4d64baeb tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: 62c89161-c119-48b2-839d-712db798ff96] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:51:20.125406 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-132d189c-f61e-453e-996f-45bf4d64baeb tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:51:20.125906 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-132d189c-f61e-453e-996f-45bf4d64baeb tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:51:20.126594 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-132d189c-f61e-453e-996f-45bf4d64baeb tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:51:20.127019 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-132d189c-f61e-453e-996f-45bf4d64baeb tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:51:20.156362 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-132d189c-f61e-453e-996f-45bf4d64baeb tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042043 Oct 27 15:51:20.156907 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 710/1346] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Oct 27 15:51:20 2021] GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 15:51:20.552599 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-2ac89dd5-0269-4346-a3db-f99e48d9fecc tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:51:20.553211 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-2ac89dd5-0269-4346-a3db-f99e48d9fecc tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] [instance: a79303e6-05ad-4901-96b7-ce845b4016f4] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:51:20.559420 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-2ac89dd5-0269-4346-a3db-f99e48d9fecc tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:51:20.559878 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-2ac89dd5-0269-4346-a3db-f99e48d9fecc tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:51:20.560655 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-2ac89dd5-0269-4346-a3db-f99e48d9fecc tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:51:20.561087 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-2ac89dd5-0269-4346-a3db-f99e48d9fecc tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:51:20.626203 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-2ac89dd5-0269-4346-a3db-f99e48d9fecc tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c757a383a434a4c9b1b928087af8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8818377e744d4f6ba65560705c191f0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:51:20.634529 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-2ac89dd5-0269-4346-a3db-f99e48d9fecc tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] 10.222.0.64 "GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4" status: 200 len: 1226 microversion: 2.1 time: 0.085552 Oct 27 15:51:20.635089 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 637/1347] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:51:20 2021] GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4 => generated 1226 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 15:51:20.953708 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-d0a4abfd-7168-4764-aaa4-0281f722e584 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:51:20.954342 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-d0a4abfd-7168-4764-aaa4-0281f722e584 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:51:20.960731 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-d0a4abfd-7168-4764-aaa4-0281f722e584 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:51:20.961203 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-d0a4abfd-7168-4764-aaa4-0281f722e584 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:51:20.961975 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-d0a4abfd-7168-4764-aaa4-0281f722e584 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:51:20.962404 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-d0a4abfd-7168-4764-aaa4-0281f722e584 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:51:21.087955 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-d0a4abfd-7168-4764-aaa4-0281f722e584 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:51:21.096584 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-d0a4abfd-7168-4764-aaa4-0281f722e584 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:51:21.098085 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-d0a4abfd-7168-4764-aaa4-0281f722e584 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:51:21.099244 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-d0a4abfd-7168-4764-aaa4-0281f722e584 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672" status: 200 len: 1748 microversion: 2.20 time: 0.149273 Oct 27 15:51:21.100425 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 711/1348] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Oct 27 15:51:20 2021] GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672 => generated 1748 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 15:51:21.168639 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-5f44adb4-1f4d-4cbe-83ee-f061a2d56de0 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:51:21.169449 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-5f44adb4-1f4d-4cbe-83ee-f061a2d56de0 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: 62c89161-c119-48b2-839d-712db798ff96] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:51:21.175138 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-5f44adb4-1f4d-4cbe-83ee-f061a2d56de0 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:51:21.175577 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-5f44adb4-1f4d-4cbe-83ee-f061a2d56de0 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:51:21.176361 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-5f44adb4-1f4d-4cbe-83ee-f061a2d56de0 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:51:21.176785 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-5f44adb4-1f4d-4cbe-83ee-f061a2d56de0 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:51:21.206097 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-5f44adb4-1f4d-4cbe-83ee-f061a2d56de0 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041196 Oct 27 15:51:21.206670 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 638/1349] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Oct 27 15:51:21 2021] GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 15:51:21.651651 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-2fa5478e-5956-4916-b476-3cf4a0e9a16c tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:51:21.652277 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-2fa5478e-5956-4916-b476-3cf4a0e9a16c tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] [instance: a79303e6-05ad-4901-96b7-ce845b4016f4] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:51:21.658439 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-2fa5478e-5956-4916-b476-3cf4a0e9a16c tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:51:21.658877 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-2fa5478e-5956-4916-b476-3cf4a0e9a16c tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:51:21.659632 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-2fa5478e-5956-4916-b476-3cf4a0e9a16c tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:51:21.660093 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-2fa5478e-5956-4916-b476-3cf4a0e9a16c tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:51:21.721187 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-2fa5478e-5956-4916-b476-3cf4a0e9a16c tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c757a383a434a4c9b1b928087af8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8818377e744d4f6ba65560705c191f0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:51:21.729220 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-2fa5478e-5956-4916-b476-3cf4a0e9a16c tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] 10.222.0.64 "GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4" status: 200 len: 1226 microversion: 2.1 time: 0.081681 Oct 27 15:51:21.729806 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 712/1350] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:51:21 2021] GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4 => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 15:51:22.118399 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-11d28a0c-487d-49ce-bf1a-795e81a59117 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:51:22.119003 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-11d28a0c-487d-49ce-bf1a-795e81a59117 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:51:22.125238 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-11d28a0c-487d-49ce-bf1a-795e81a59117 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:51:22.125675 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-11d28a0c-487d-49ce-bf1a-795e81a59117 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:51:22.126457 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-11d28a0c-487d-49ce-bf1a-795e81a59117 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:51:22.126882 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-11d28a0c-487d-49ce-bf1a-795e81a59117 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:51:22.218464 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-83f5d35c-77da-4e81-a0ce-1e33f41b2256 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:51:22.219368 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-83f5d35c-77da-4e81-a0ce-1e33f41b2256 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: 62c89161-c119-48b2-839d-712db798ff96] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:51:22.226106 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-83f5d35c-77da-4e81-a0ce-1e33f41b2256 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:51:22.226639 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-83f5d35c-77da-4e81-a0ce-1e33f41b2256 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:51:22.227329 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-83f5d35c-77da-4e81-a0ce-1e33f41b2256 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:51:22.227755 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-83f5d35c-77da-4e81-a0ce-1e33f41b2256 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:51:22.249014 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-11d28a0c-487d-49ce-bf1a-795e81a59117 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:51:22.257775 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-11d28a0c-487d-49ce-bf1a-795e81a59117 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:51:22.258372 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-83f5d35c-77da-4e81-a0ce-1e33f41b2256 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043932 Oct 27 15:51:22.258936 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 713/1351] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Oct 27 15:51:22 2021] GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 15:51:22.259264 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-11d28a0c-487d-49ce-bf1a-795e81a59117 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:51:22.260448 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-11d28a0c-487d-49ce-bf1a-795e81a59117 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672" status: 200 len: 1748 microversion: 2.20 time: 0.146379 Oct 27 15:51:22.260987 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 639/1352] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Oct 27 15:51:22 2021] GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672 => generated 1748 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 15:51:22.746047 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-a392b185-3645-40b8-a1fc-c23866fe83bc tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:51:22.746649 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-a392b185-3645-40b8-a1fc-c23866fe83bc tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] [instance: a79303e6-05ad-4901-96b7-ce845b4016f4] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:51:22.752506 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-a392b185-3645-40b8-a1fc-c23866fe83bc tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:51:22.752945 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-a392b185-3645-40b8-a1fc-c23866fe83bc tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:51:22.753699 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-a392b185-3645-40b8-a1fc-c23866fe83bc tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:51:22.754126 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-a392b185-3645-40b8-a1fc-c23866fe83bc tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:51:22.811376 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-a392b185-3645-40b8-a1fc-c23866fe83bc tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c757a383a434a4c9b1b928087af8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8818377e744d4f6ba65560705c191f0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:51:22.818585 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-a392b185-3645-40b8-a1fc-c23866fe83bc tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] 10.222.0.64 "GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4" status: 200 len: 1226 microversion: 2.1 time: 0.076199 Oct 27 15:51:22.819140 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 714/1353] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:51:22 2021] GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4 => generated 1226 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 15:51:23.269794 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-e589555c-36e1-4f3b-8a2c-3d39aebb1510 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:51:23.270686 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-e589555c-36e1-4f3b-8a2c-3d39aebb1510 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: 62c89161-c119-48b2-839d-712db798ff96] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:51:23.277350 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-e589555c-36e1-4f3b-8a2c-3d39aebb1510 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:51:23.277783 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-e589555c-36e1-4f3b-8a2c-3d39aebb1510 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:51:23.278182 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-14c8589d-c58e-4b82-96f4-ce27bd794454 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:51:23.278538 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-e589555c-36e1-4f3b-8a2c-3d39aebb1510 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:51:23.278791 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-14c8589d-c58e-4b82-96f4-ce27bd794454 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:51:23.278964 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-e589555c-36e1-4f3b-8a2c-3d39aebb1510 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:51:23.284998 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-14c8589d-c58e-4b82-96f4-ce27bd794454 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:51:23.285441 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-14c8589d-c58e-4b82-96f4-ce27bd794454 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:51:23.286208 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-14c8589d-c58e-4b82-96f4-ce27bd794454 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:51:23.286640 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-14c8589d-c58e-4b82-96f4-ce27bd794454 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:51:23.307355 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-e589555c-36e1-4f3b-8a2c-3d39aebb1510 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041270 Oct 27 15:51:23.307922 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 640/1354] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Oct 27 15:51:23 2021] GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 15:51:23.406726 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-14c8589d-c58e-4b82-96f4-ce27bd794454 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:51:23.415413 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-14c8589d-c58e-4b82-96f4-ce27bd794454 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:51:23.416942 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-14c8589d-c58e-4b82-96f4-ce27bd794454 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:51:23.418107 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-14c8589d-c58e-4b82-96f4-ce27bd794454 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672" status: 200 len: 1748 microversion: 2.20 time: 0.143671 Oct 27 15:51:23.418665 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 715/1355] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Oct 27 15:51:23 2021] GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672 => generated 1748 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 15:51:23.834444 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-cdd5f2a9-558f-4c37-8f8f-deedbf2b2611 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:51:23.835047 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-cdd5f2a9-558f-4c37-8f8f-deedbf2b2611 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] [instance: a79303e6-05ad-4901-96b7-ce845b4016f4] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:51:23.840826 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-cdd5f2a9-558f-4c37-8f8f-deedbf2b2611 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:51:23.841275 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-cdd5f2a9-558f-4c37-8f8f-deedbf2b2611 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:51:23.842023 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-cdd5f2a9-558f-4c37-8f8f-deedbf2b2611 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:51:23.842449 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-cdd5f2a9-558f-4c37-8f8f-deedbf2b2611 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:51:23.901072 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-cdd5f2a9-558f-4c37-8f8f-deedbf2b2611 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c757a383a434a4c9b1b928087af8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8818377e744d4f6ba65560705c191f0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:51:23.908358 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-cdd5f2a9-558f-4c37-8f8f-deedbf2b2611 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] 10.222.0.64 "GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4" status: 200 len: 1226 microversion: 2.1 time: 0.077734 Oct 27 15:51:23.908913 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 641/1356] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:51:23 2021] GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4 => generated 1226 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 15:51:24.319889 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-ab53519c-570f-4b6a-bbfc-cfcef6bae296 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:51:24.320802 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-ab53519c-570f-4b6a-bbfc-cfcef6bae296 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: 62c89161-c119-48b2-839d-712db798ff96] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:51:24.326924 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-ab53519c-570f-4b6a-bbfc-cfcef6bae296 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:51:24.327365 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-ab53519c-570f-4b6a-bbfc-cfcef6bae296 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:51:24.328146 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-ab53519c-570f-4b6a-bbfc-cfcef6bae296 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:51:24.328574 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-ab53519c-570f-4b6a-bbfc-cfcef6bae296 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:51:24.357501 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-ab53519c-570f-4b6a-bbfc-cfcef6bae296 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042544 Oct 27 15:51:24.358045 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 716/1357] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Oct 27 15:51:24 2021] GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 15:51:24.436286 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-4f926c1e-44ec-449f-9707-c4adf022a348 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:51:24.436888 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-4f926c1e-44ec-449f-9707-c4adf022a348 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:51:24.443094 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-4f926c1e-44ec-449f-9707-c4adf022a348 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:51:24.444237 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-4f926c1e-44ec-449f-9707-c4adf022a348 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:51:24.444834 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-4f926c1e-44ec-449f-9707-c4adf022a348 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:51:24.445260 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-4f926c1e-44ec-449f-9707-c4adf022a348 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:51:24.583517 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-4f926c1e-44ec-449f-9707-c4adf022a348 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:51:24.592898 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-4f926c1e-44ec-449f-9707-c4adf022a348 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:51:24.594412 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-4f926c1e-44ec-449f-9707-c4adf022a348 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:51:24.595552 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-4f926c1e-44ec-449f-9707-c4adf022a348 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672" status: 200 len: 1748 microversion: 2.20 time: 0.163134 Oct 27 15:51:24.596149 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 642/1358] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Oct 27 15:51:24 2021] GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672 => generated 1748 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 15:51:24.925367 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-2b9e6b52-32dd-4da1-aa65-309be6173528 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:51:24.925997 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-2b9e6b52-32dd-4da1-aa65-309be6173528 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] [instance: a79303e6-05ad-4901-96b7-ce845b4016f4] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:51:24.932269 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-2b9e6b52-32dd-4da1-aa65-309be6173528 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:51:24.932708 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-2b9e6b52-32dd-4da1-aa65-309be6173528 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:51:24.933498 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-2b9e6b52-32dd-4da1-aa65-309be6173528 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:51:24.933935 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-2b9e6b52-32dd-4da1-aa65-309be6173528 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:51:24.992765 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-2b9e6b52-32dd-4da1-aa65-309be6173528 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c757a383a434a4c9b1b928087af8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8818377e744d4f6ba65560705c191f0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:51:24.999954 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-2b9e6b52-32dd-4da1-aa65-309be6173528 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] 10.222.0.64 "GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4" status: 200 len: 1226 microversion: 2.1 time: 0.078238 Oct 27 15:51:25.000508 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 717/1359] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:51:24 2021] GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4 => generated 1226 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 15:51:25.369540 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-5970ff9f-b4d7-479f-9956-aaa186a69e93 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:51:25.370435 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-5970ff9f-b4d7-479f-9956-aaa186a69e93 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: 62c89161-c119-48b2-839d-712db798ff96] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:51:25.376153 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-5970ff9f-b4d7-479f-9956-aaa186a69e93 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:51:25.376591 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-5970ff9f-b4d7-479f-9956-aaa186a69e93 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:51:25.377340 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-5970ff9f-b4d7-479f-9956-aaa186a69e93 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:51:25.377766 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-5970ff9f-b4d7-479f-9956-aaa186a69e93 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:51:25.406171 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-5970ff9f-b4d7-479f-9956-aaa186a69e93 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041467 Oct 27 15:51:25.406703 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 643/1360] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Oct 27 15:51:25 2021] GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 15:51:25.613351 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-8a35f091-e033-4ec5-8e9e-492bc4293c97 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:51:25.613977 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-8a35f091-e033-4ec5-8e9e-492bc4293c97 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:51:25.620674 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-8a35f091-e033-4ec5-8e9e-492bc4293c97 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:51:25.621052 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-8a35f091-e033-4ec5-8e9e-492bc4293c97 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:51:25.621809 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-8a35f091-e033-4ec5-8e9e-492bc4293c97 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:51:25.622235 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-8a35f091-e033-4ec5-8e9e-492bc4293c97 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:51:25.739268 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-8a35f091-e033-4ec5-8e9e-492bc4293c97 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:51:25.748042 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-8a35f091-e033-4ec5-8e9e-492bc4293c97 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:51:25.749524 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-8a35f091-e033-4ec5-8e9e-492bc4293c97 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:51:25.750669 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-8a35f091-e033-4ec5-8e9e-492bc4293c97 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672" status: 200 len: 1748 microversion: 2.20 time: 0.141048 Oct 27 15:51:25.751207 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 718/1361] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Oct 27 15:51:25 2021] GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672 => generated 1748 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 15:51:26.017222 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-7820b3a9-e83c-4479-8fa8-6f0a21e070ef tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:51:26.017829 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-7820b3a9-e83c-4479-8fa8-6f0a21e070ef tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] [instance: a79303e6-05ad-4901-96b7-ce845b4016f4] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:51:26.024213 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-7820b3a9-e83c-4479-8fa8-6f0a21e070ef tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:51:26.024666 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-7820b3a9-e83c-4479-8fa8-6f0a21e070ef tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:51:26.025424 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-7820b3a9-e83c-4479-8fa8-6f0a21e070ef tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:51:26.025861 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-7820b3a9-e83c-4479-8fa8-6f0a21e070ef tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:51:26.083396 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-7820b3a9-e83c-4479-8fa8-6f0a21e070ef tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c757a383a434a4c9b1b928087af8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8818377e744d4f6ba65560705c191f0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:51:26.091756 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-7820b3a9-e83c-4479-8fa8-6f0a21e070ef tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] 10.222.0.64 "GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4" status: 200 len: 1226 microversion: 2.1 time: 0.078254 Oct 27 15:51:26.092350 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 644/1362] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:51:26 2021] GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4 => generated 1226 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 15:51:26.417972 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-c020c148-3b18-4c27-80bf-608a6d8f27eb tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:51:26.418877 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-c020c148-3b18-4c27-80bf-608a6d8f27eb tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: 62c89161-c119-48b2-839d-712db798ff96] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:51:26.424915 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-c020c148-3b18-4c27-80bf-608a6d8f27eb tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:51:26.425357 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-c020c148-3b18-4c27-80bf-608a6d8f27eb tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:51:26.426115 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-c020c148-3b18-4c27-80bf-608a6d8f27eb tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:51:26.426539 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-c020c148-3b18-4c27-80bf-608a6d8f27eb tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:51:26.455523 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-c020c148-3b18-4c27-80bf-608a6d8f27eb tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041367 Oct 27 15:51:26.456095 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 719/1363] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Oct 27 15:51:26 2021] GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 15:51:26.767765 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-915e89ff-9a70-40ae-b020-1dfe59c89afc tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:51:26.768414 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-915e89ff-9a70-40ae-b020-1dfe59c89afc tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:51:26.775139 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-915e89ff-9a70-40ae-b020-1dfe59c89afc tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:51:26.775588 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-915e89ff-9a70-40ae-b020-1dfe59c89afc tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:51:26.776381 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-915e89ff-9a70-40ae-b020-1dfe59c89afc tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:51:26.776816 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-915e89ff-9a70-40ae-b020-1dfe59c89afc tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:51:26.898394 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-915e89ff-9a70-40ae-b020-1dfe59c89afc tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:51:26.906603 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-915e89ff-9a70-40ae-b020-1dfe59c89afc tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:51:26.908137 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-915e89ff-9a70-40ae-b020-1dfe59c89afc tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:51:26.909288 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-915e89ff-9a70-40ae-b020-1dfe59c89afc tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672" status: 200 len: 1748 microversion: 2.20 time: 0.145283 Oct 27 15:51:26.909836 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 645/1364] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Oct 27 15:51:26 2021] GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672 => generated 1748 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 15:51:27.109582 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-bca237ce-3527-4c5b-a2e6-0fb4a91d6382 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:51:27.110141 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-bca237ce-3527-4c5b-a2e6-0fb4a91d6382 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] [instance: a79303e6-05ad-4901-96b7-ce845b4016f4] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:51:27.116912 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-bca237ce-3527-4c5b-a2e6-0fb4a91d6382 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:51:27.117355 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-bca237ce-3527-4c5b-a2e6-0fb4a91d6382 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:51:27.118117 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-bca237ce-3527-4c5b-a2e6-0fb4a91d6382 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:51:27.118550 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-bca237ce-3527-4c5b-a2e6-0fb4a91d6382 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:51:27.179195 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-bca237ce-3527-4c5b-a2e6-0fb4a91d6382 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c757a383a434a4c9b1b928087af8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8818377e744d4f6ba65560705c191f0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:51:27.186744 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-bca237ce-3527-4c5b-a2e6-0fb4a91d6382 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] 10.222.0.64 "GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4" status: 200 len: 1226 microversion: 2.1 time: 0.080973 Oct 27 15:51:27.187312 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 720/1365] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:51:27 2021] GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4 => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 15:51:27.468401 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-3f2d4c00-0e8a-49bc-83ce-a514180d9c2b tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:51:27.469294 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-3f2d4c00-0e8a-49bc-83ce-a514180d9c2b tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: 62c89161-c119-48b2-839d-712db798ff96] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:51:27.475086 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-3f2d4c00-0e8a-49bc-83ce-a514180d9c2b tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:51:27.475520 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-3f2d4c00-0e8a-49bc-83ce-a514180d9c2b tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:51:27.476301 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-3f2d4c00-0e8a-49bc-83ce-a514180d9c2b tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:51:27.476725 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-3f2d4c00-0e8a-49bc-83ce-a514180d9c2b tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:51:27.503877 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-3f2d4c00-0e8a-49bc-83ce-a514180d9c2b tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039574 Oct 27 15:51:27.504418 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 646/1366] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Oct 27 15:51:27 2021] GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 15:51:27.926674 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-9f765f2e-21c6-4ee9-82c0-8db91730fe71 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:51:27.927277 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-9f765f2e-21c6-4ee9-82c0-8db91730fe71 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:51:27.934132 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-9f765f2e-21c6-4ee9-82c0-8db91730fe71 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:51:27.934570 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-9f765f2e-21c6-4ee9-82c0-8db91730fe71 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:51:27.935326 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-9f765f2e-21c6-4ee9-82c0-8db91730fe71 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:51:27.935753 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-9f765f2e-21c6-4ee9-82c0-8db91730fe71 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:51:28.056717 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-9f765f2e-21c6-4ee9-82c0-8db91730fe71 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:51:28.064951 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-9f765f2e-21c6-4ee9-82c0-8db91730fe71 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:51:28.066473 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-9f765f2e-21c6-4ee9-82c0-8db91730fe71 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:51:28.067616 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-9f765f2e-21c6-4ee9-82c0-8db91730fe71 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672" status: 200 len: 1748 microversion: 2.20 time: 0.144712 Oct 27 15:51:28.068260 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 721/1367] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Oct 27 15:51:27 2021] GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672 => generated 1748 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 15:51:28.202259 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-37e56884-bee1-48b7-b7e7-e95e21e46ae6 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:51:28.202860 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-37e56884-bee1-48b7-b7e7-e95e21e46ae6 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] [instance: a79303e6-05ad-4901-96b7-ce845b4016f4] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:51:28.209580 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-37e56884-bee1-48b7-b7e7-e95e21e46ae6 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:51:28.210004 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-37e56884-bee1-48b7-b7e7-e95e21e46ae6 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:51:28.210767 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-37e56884-bee1-48b7-b7e7-e95e21e46ae6 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:51:28.211193 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-37e56884-bee1-48b7-b7e7-e95e21e46ae6 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:51:28.273642 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-37e56884-bee1-48b7-b7e7-e95e21e46ae6 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c757a383a434a4c9b1b928087af8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8818377e744d4f6ba65560705c191f0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:51:28.280961 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-37e56884-bee1-48b7-b7e7-e95e21e46ae6 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] 10.222.0.64 "GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4" status: 200 len: 1226 microversion: 2.1 time: 0.082373 Oct 27 15:51:28.281515 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 647/1368] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:51:28 2021] GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4 => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 15:51:28.516160 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-c5e96c2a-6e88-4052-8e29-eebe64dbff04 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:51:28.516976 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-c5e96c2a-6e88-4052-8e29-eebe64dbff04 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: 62c89161-c119-48b2-839d-712db798ff96] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:51:28.523727 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-c5e96c2a-6e88-4052-8e29-eebe64dbff04 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:51:28.524197 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-c5e96c2a-6e88-4052-8e29-eebe64dbff04 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:51:28.524967 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-c5e96c2a-6e88-4052-8e29-eebe64dbff04 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:51:28.525406 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-c5e96c2a-6e88-4052-8e29-eebe64dbff04 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:51:28.553916 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-c5e96c2a-6e88-4052-8e29-eebe64dbff04 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041767 Oct 27 15:51:28.554456 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 722/1369] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Oct 27 15:51:28 2021] GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 15:51:29.085620 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-a8567cdb-31cc-4e9b-9512-7876984e65dd tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:51:29.086213 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-a8567cdb-31cc-4e9b-9512-7876984e65dd tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:51:29.091989 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-a8567cdb-31cc-4e9b-9512-7876984e65dd tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:51:29.092431 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-a8567cdb-31cc-4e9b-9512-7876984e65dd tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:51:29.093436 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-a8567cdb-31cc-4e9b-9512-7876984e65dd tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:51:29.093889 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-a8567cdb-31cc-4e9b-9512-7876984e65dd tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:51:29.216190 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-a8567cdb-31cc-4e9b-9512-7876984e65dd tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:51:29.224481 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-a8567cdb-31cc-4e9b-9512-7876984e65dd tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:51:29.225978 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-a8567cdb-31cc-4e9b-9512-7876984e65dd tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:51:29.227128 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-a8567cdb-31cc-4e9b-9512-7876984e65dd tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672" status: 200 len: 1748 microversion: 2.20 time: 0.145232 Oct 27 15:51:29.227671 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 648/1370] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Oct 27 15:51:29 2021] GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672 => generated 1748 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 15:51:29.298306 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-763ca485-2f7b-4459-b902-425a3158413b tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:51:29.298914 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-763ca485-2f7b-4459-b902-425a3158413b tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] [instance: a79303e6-05ad-4901-96b7-ce845b4016f4] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:51:29.305390 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-763ca485-2f7b-4459-b902-425a3158413b tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:51:29.305832 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-763ca485-2f7b-4459-b902-425a3158413b tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:51:29.306586 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-763ca485-2f7b-4459-b902-425a3158413b tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:51:29.307021 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-763ca485-2f7b-4459-b902-425a3158413b tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:51:29.366956 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-763ca485-2f7b-4459-b902-425a3158413b tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c757a383a434a4c9b1b928087af8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8818377e744d4f6ba65560705c191f0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:51:29.374110 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-763ca485-2f7b-4459-b902-425a3158413b tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] 10.222.0.64 "GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4" status: 200 len: 1226 microversion: 2.1 time: 0.079455 Oct 27 15:51:29.374663 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 723/1371] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:51:29 2021] GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4 => generated 1226 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 15:51:29.565323 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-65bb15e5-0375-4a77-9d9b-3b95533c599d tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:51:29.566258 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-65bb15e5-0375-4a77-9d9b-3b95533c599d tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: 62c89161-c119-48b2-839d-712db798ff96] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:51:29.572632 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-65bb15e5-0375-4a77-9d9b-3b95533c599d tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:51:29.573072 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-65bb15e5-0375-4a77-9d9b-3b95533c599d tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:51:29.573837 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-65bb15e5-0375-4a77-9d9b-3b95533c599d tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:51:29.574263 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-65bb15e5-0375-4a77-9d9b-3b95533c599d tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:51:29.603197 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-65bb15e5-0375-4a77-9d9b-3b95533c599d tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041607 Oct 27 15:51:29.603743 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 649/1372] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Oct 27 15:51:29 2021] GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 15:51:30.245858 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-852869eb-93f4-4456-89dd-b41846cb79d4 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:51:30.246461 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-852869eb-93f4-4456-89dd-b41846cb79d4 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:51:30.252633 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-852869eb-93f4-4456-89dd-b41846cb79d4 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:51:30.253076 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-852869eb-93f4-4456-89dd-b41846cb79d4 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:51:30.253829 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-852869eb-93f4-4456-89dd-b41846cb79d4 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:51:30.254256 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-852869eb-93f4-4456-89dd-b41846cb79d4 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:51:30.373603 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-852869eb-93f4-4456-89dd-b41846cb79d4 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:51:30.381846 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-852869eb-93f4-4456-89dd-b41846cb79d4 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:51:30.383359 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-852869eb-93f4-4456-89dd-b41846cb79d4 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:51:30.384534 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-852869eb-93f4-4456-89dd-b41846cb79d4 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672" status: 200 len: 1748 microversion: 2.20 time: 0.142483 Oct 27 15:51:30.385086 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 724/1373] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Oct 27 15:51:30 2021] GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672 => generated 1748 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 15:51:30.390131 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-11625955-1937-48ae-bb80-c4cbe75c290c tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:51:30.390749 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-11625955-1937-48ae-bb80-c4cbe75c290c tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] [instance: a79303e6-05ad-4901-96b7-ce845b4016f4] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:51:30.396937 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-11625955-1937-48ae-bb80-c4cbe75c290c tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:51:30.397384 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-11625955-1937-48ae-bb80-c4cbe75c290c tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:51:30.399240 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-11625955-1937-48ae-bb80-c4cbe75c290c tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:51:30.399692 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-11625955-1937-48ae-bb80-c4cbe75c290c tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:51:30.458387 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-11625955-1937-48ae-bb80-c4cbe75c290c tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c757a383a434a4c9b1b928087af8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8818377e744d4f6ba65560705c191f0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:51:30.466115 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-11625955-1937-48ae-bb80-c4cbe75c290c tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] 10.222.0.64 "GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4" status: 200 len: 1226 microversion: 2.1 time: 0.079635 Oct 27 15:51:30.466679 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 650/1374] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:51:30 2021] GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4 => generated 1226 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 15:51:30.614615 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-08abc1cf-fc69-432a-a376-a3306b064173 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:51:30.616230 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-08abc1cf-fc69-432a-a376-a3306b064173 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: 62c89161-c119-48b2-839d-712db798ff96] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:51:30.621997 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-08abc1cf-fc69-432a-a376-a3306b064173 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:51:30.622435 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-08abc1cf-fc69-432a-a376-a3306b064173 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:51:30.623190 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-08abc1cf-fc69-432a-a376-a3306b064173 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:51:30.623613 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-08abc1cf-fc69-432a-a376-a3306b064173 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:51:30.651343 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-08abc1cf-fc69-432a-a376-a3306b064173 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040614 Oct 27 15:51:30.651910 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 725/1375] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Oct 27 15:51:30 2021] GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 15:51:31.403119 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-e79b9d1b-8f60-4302-8643-8596b6984506 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:51:31.403711 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-e79b9d1b-8f60-4302-8643-8596b6984506 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:51:31.409959 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-e79b9d1b-8f60-4302-8643-8596b6984506 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:51:31.410403 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-e79b9d1b-8f60-4302-8643-8596b6984506 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:51:31.411156 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-e79b9d1b-8f60-4302-8643-8596b6984506 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:51:31.411582 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-e79b9d1b-8f60-4302-8643-8596b6984506 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:51:31.482292 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-638c75d5-de23-45bc-97a6-f8b2127f129b tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:51:31.482899 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-638c75d5-de23-45bc-97a6-f8b2127f129b tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] [instance: a79303e6-05ad-4901-96b7-ce845b4016f4] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:51:31.489050 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-638c75d5-de23-45bc-97a6-f8b2127f129b tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:51:31.489877 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-638c75d5-de23-45bc-97a6-f8b2127f129b tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:51:31.490294 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-638c75d5-de23-45bc-97a6-f8b2127f129b tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:51:31.490728 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-638c75d5-de23-45bc-97a6-f8b2127f129b tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:51:31.531623 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-e79b9d1b-8f60-4302-8643-8596b6984506 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:51:31.540744 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-e79b9d1b-8f60-4302-8643-8596b6984506 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:51:31.542226 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-e79b9d1b-8f60-4302-8643-8596b6984506 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:51:31.543379 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-e79b9d1b-8f60-4302-8643-8596b6984506 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672" status: 200 len: 1748 microversion: 2.20 time: 0.144014 Oct 27 15:51:31.543955 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 651/1376] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Oct 27 15:51:31 2021] GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672 => generated 1748 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 15:51:31.550204 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-638c75d5-de23-45bc-97a6-f8b2127f129b tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c757a383a434a4c9b1b928087af8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8818377e744d4f6ba65560705c191f0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:51:31.557521 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-638c75d5-de23-45bc-97a6-f8b2127f129b tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] 10.222.0.64 "GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4" status: 200 len: 1226 microversion: 2.1 time: 0.078960 Oct 27 15:51:31.558072 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 726/1377] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:51:31 2021] GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4 => generated 1226 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 15:51:31.662416 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-d062237c-590e-4b8c-b645-4a8b555ea5ab tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:51:31.663241 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-d062237c-590e-4b8c-b645-4a8b555ea5ab tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: 62c89161-c119-48b2-839d-712db798ff96] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:51:31.668911 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-d062237c-590e-4b8c-b645-4a8b555ea5ab tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:51:31.669348 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-d062237c-590e-4b8c-b645-4a8b555ea5ab tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:51:31.670093 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-d062237c-590e-4b8c-b645-4a8b555ea5ab tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:51:31.670516 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-d062237c-590e-4b8c-b645-4a8b555ea5ab tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:51:31.698387 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-d062237c-590e-4b8c-b645-4a8b555ea5ab tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039704 Oct 27 15:51:31.698919 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 652/1378] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Oct 27 15:51:31 2021] GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 15:51:32.563964 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-a1a73f1a-7369-4ca2-b480-7177a5efd359 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:51:32.564851 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-a1a73f1a-7369-4ca2-b480-7177a5efd359 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:51:32.573051 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-a1a73f1a-7369-4ca2-b480-7177a5efd359 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:51:32.573407 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-a1a73f1a-7369-4ca2-b480-7177a5efd359 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:51:32.573961 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-629bd897-cbe3-44e0-8a3d-3c46d11f17af tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:51:32.574397 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-a1a73f1a-7369-4ca2-b480-7177a5efd359 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:51:32.574570 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-629bd897-cbe3-44e0-8a3d-3c46d11f17af tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] [instance: a79303e6-05ad-4901-96b7-ce845b4016f4] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:51:32.574697 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-a1a73f1a-7369-4ca2-b480-7177a5efd359 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:51:32.580714 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-629bd897-cbe3-44e0-8a3d-3c46d11f17af tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:51:32.581158 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-629bd897-cbe3-44e0-8a3d-3c46d11f17af tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:51:32.581953 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-629bd897-cbe3-44e0-8a3d-3c46d11f17af tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:51:32.582382 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-629bd897-cbe3-44e0-8a3d-3c46d11f17af tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:51:32.642640 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-629bd897-cbe3-44e0-8a3d-3c46d11f17af tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c757a383a434a4c9b1b928087af8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8818377e744d4f6ba65560705c191f0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:51:32.651132 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-629bd897-cbe3-44e0-8a3d-3c46d11f17af tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] 10.222.0.64 "GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4" status: 200 len: 1226 microversion: 2.1 time: 0.080834 Oct 27 15:51:32.651703 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 653/1379] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:51:32 2021] GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4 => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 15:51:32.699109 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-a1a73f1a-7369-4ca2-b480-7177a5efd359 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:51:32.707576 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-a1a73f1a-7369-4ca2-b480-7177a5efd359 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:51:32.709879 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-a1a73f1a-7369-4ca2-b480-7177a5efd359 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:51:32.710029 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-f5ac4209-ba54-42f3-ae1b-a0fffa5beefe tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:51:32.710781 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-f5ac4209-ba54-42f3-ae1b-a0fffa5beefe tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: 62c89161-c119-48b2-839d-712db798ff96] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:51:32.711045 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-a1a73f1a-7369-4ca2-b480-7177a5efd359 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672" status: 200 len: 1748 microversion: 2.20 time: 0.152888 Oct 27 15:51:32.711599 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 727/1380] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Oct 27 15:51:32 2021] GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672 => generated 1748 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 15:51:32.716676 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-f5ac4209-ba54-42f3-ae1b-a0fffa5beefe tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:51:32.717125 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-f5ac4209-ba54-42f3-ae1b-a0fffa5beefe tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:51:32.718142 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-f5ac4209-ba54-42f3-ae1b-a0fffa5beefe tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:51:32.718568 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-f5ac4209-ba54-42f3-ae1b-a0fffa5beefe tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:51:32.746436 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-f5ac4209-ba54-42f3-ae1b-a0fffa5beefe tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041149 Oct 27 15:51:32.746979 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 654/1381] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Oct 27 15:51:32 2021] GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 15:51:33.668072 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-2730da8e-f113-4980-8c6d-0cdeb15bc3f3 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:51:33.668661 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-2730da8e-f113-4980-8c6d-0cdeb15bc3f3 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] [instance: a79303e6-05ad-4901-96b7-ce845b4016f4] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:51:33.674865 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-2730da8e-f113-4980-8c6d-0cdeb15bc3f3 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:51:33.675310 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-2730da8e-f113-4980-8c6d-0cdeb15bc3f3 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:51:33.676110 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-2730da8e-f113-4980-8c6d-0cdeb15bc3f3 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:51:33.676547 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-2730da8e-f113-4980-8c6d-0cdeb15bc3f3 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:51:33.730063 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-807a22f6-46bc-4673-a91f-24fd4540400a tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:51:33.730660 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-807a22f6-46bc-4673-a91f-24fd4540400a tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:51:33.736900 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-807a22f6-46bc-4673-a91f-24fd4540400a tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:51:33.737068 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-2730da8e-f113-4980-8c6d-0cdeb15bc3f3 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c757a383a434a4c9b1b928087af8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8818377e744d4f6ba65560705c191f0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:51:33.737346 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-807a22f6-46bc-4673-a91f-24fd4540400a tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:51:33.738110 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-807a22f6-46bc-4673-a91f-24fd4540400a tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:51:33.738541 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-807a22f6-46bc-4673-a91f-24fd4540400a tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:51:33.744828 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-2730da8e-f113-4980-8c6d-0cdeb15bc3f3 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] 10.222.0.64 "GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4" status: 200 len: 1226 microversion: 2.1 time: 0.080535 Oct 27 15:51:33.745393 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 728/1382] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:51:33 2021] GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4 => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 15:51:33.756529 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-7fcf70e1-6edd-49f6-b04a-2aef67a7f205 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:51:33.757434 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-7fcf70e1-6edd-49f6-b04a-2aef67a7f205 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: 62c89161-c119-48b2-839d-712db798ff96] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:51:33.762971 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-7fcf70e1-6edd-49f6-b04a-2aef67a7f205 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:51:33.763415 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-7fcf70e1-6edd-49f6-b04a-2aef67a7f205 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:51:33.764206 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-7fcf70e1-6edd-49f6-b04a-2aef67a7f205 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:51:33.764645 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-7fcf70e1-6edd-49f6-b04a-2aef67a7f205 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:51:33.794969 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-7fcf70e1-6edd-49f6-b04a-2aef67a7f205 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042072 Oct 27 15:51:33.795532 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 729/1383] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Oct 27 15:51:33 2021] GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 15:51:33.865697 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-807a22f6-46bc-4673-a91f-24fd4540400a tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:51:33.873889 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-807a22f6-46bc-4673-a91f-24fd4540400a tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:51:33.875418 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-807a22f6-46bc-4673-a91f-24fd4540400a tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:51:33.876588 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-807a22f6-46bc-4673-a91f-24fd4540400a tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672" status: 200 len: 1748 microversion: 2.20 time: 0.150337 Oct 27 15:51:33.877137 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 655/1384] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Oct 27 15:51:33 2021] GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672 => generated 1748 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 15:51:34.761975 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-056e47e0-5590-4377-a959-21dad6abc4d6 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:51:34.762583 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-056e47e0-5590-4377-a959-21dad6abc4d6 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] [instance: a79303e6-05ad-4901-96b7-ce845b4016f4] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:51:34.768998 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-056e47e0-5590-4377-a959-21dad6abc4d6 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:51:34.769448 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-056e47e0-5590-4377-a959-21dad6abc4d6 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:51:34.770213 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-056e47e0-5590-4377-a959-21dad6abc4d6 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:51:34.770649 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-056e47e0-5590-4377-a959-21dad6abc4d6 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:51:34.807637 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-bbd4363a-6761-4711-825b-066e323e651a tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:51:34.808996 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-bbd4363a-6761-4711-825b-066e323e651a tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: 62c89161-c119-48b2-839d-712db798ff96] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:51:34.816328 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-bbd4363a-6761-4711-825b-066e323e651a tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:51:34.816778 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-bbd4363a-6761-4711-825b-066e323e651a tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:51:34.817560 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-bbd4363a-6761-4711-825b-066e323e651a tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:51:34.817996 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-bbd4363a-6761-4711-825b-066e323e651a tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:51:34.829973 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-056e47e0-5590-4377-a959-21dad6abc4d6 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c757a383a434a4c9b1b928087af8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8818377e744d4f6ba65560705c191f0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:51:34.838205 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-056e47e0-5590-4377-a959-21dad6abc4d6 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] 10.222.0.64 "GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4" status: 200 len: 1226 microversion: 2.1 time: 0.079917 Oct 27 15:51:34.838778 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 730/1385] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:51:34 2021] GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4 => generated 1226 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 15:51:34.849360 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-bbd4363a-6761-4711-825b-066e323e651a tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046583 Oct 27 15:51:34.850324 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 656/1386] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Oct 27 15:51:34 2021] GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 15:51:34.894154 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-ec6bd3e7-e6a9-4608-acf4-89dbbe379174 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:51:34.894755 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-ec6bd3e7-e6a9-4608-acf4-89dbbe379174 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:51:34.901215 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-ec6bd3e7-e6a9-4608-acf4-89dbbe379174 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:51:34.901657 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-ec6bd3e7-e6a9-4608-acf4-89dbbe379174 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:51:34.902410 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-ec6bd3e7-e6a9-4608-acf4-89dbbe379174 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:51:34.902839 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-ec6bd3e7-e6a9-4608-acf4-89dbbe379174 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:51:35.020122 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-ec6bd3e7-e6a9-4608-acf4-89dbbe379174 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:51:35.028760 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-ec6bd3e7-e6a9-4608-acf4-89dbbe379174 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:51:35.030237 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-ec6bd3e7-e6a9-4608-acf4-89dbbe379174 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:51:35.031378 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-ec6bd3e7-e6a9-4608-acf4-89dbbe379174 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672" status: 200 len: 1748 microversion: 2.20 time: 0.140937 Oct 27 15:51:35.031957 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 731/1387] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Oct 27 15:51:34 2021] GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672 => generated 1748 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 15:51:35.854873 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-93f9bdd0-ae89-43aa-a66b-fde4d6678143 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:51:35.855493 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-93f9bdd0-ae89-43aa-a66b-fde4d6678143 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] [instance: a79303e6-05ad-4901-96b7-ce845b4016f4] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:51:35.860911 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-2a93f866-171b-4aa4-a2c0-e116b3b768f2 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:51:35.861810 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-2a93f866-171b-4aa4-a2c0-e116b3b768f2 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: 62c89161-c119-48b2-839d-712db798ff96] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:51:35.861934 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-93f9bdd0-ae89-43aa-a66b-fde4d6678143 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:51:35.862340 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-93f9bdd0-ae89-43aa-a66b-fde4d6678143 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:51:35.863141 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-93f9bdd0-ae89-43aa-a66b-fde4d6678143 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:51:35.863571 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-93f9bdd0-ae89-43aa-a66b-fde4d6678143 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:51:35.867760 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-2a93f866-171b-4aa4-a2c0-e116b3b768f2 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:51:35.868238 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-2a93f866-171b-4aa4-a2c0-e116b3b768f2 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:51:35.869015 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-2a93f866-171b-4aa4-a2c0-e116b3b768f2 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:51:35.869442 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-2a93f866-171b-4aa4-a2c0-e116b3b768f2 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:51:35.899106 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-2a93f866-171b-4aa4-a2c0-e116b3b768f2 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041813 Oct 27 15:51:35.899664 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 732/1388] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Oct 27 15:51:35 2021] GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 15:51:35.923779 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-93f9bdd0-ae89-43aa-a66b-fde4d6678143 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c757a383a434a4c9b1b928087af8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8818377e744d4f6ba65560705c191f0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:51:35.931170 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-93f9bdd0-ae89-43aa-a66b-fde4d6678143 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] 10.222.0.64 "GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4" status: 200 len: 1226 microversion: 2.1 time: 0.080617 Oct 27 15:51:35.931719 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 657/1389] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:51:35 2021] GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4 => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 15:51:36.049416 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-d040bb6e-af52-41dd-808d-ab8f8b4401ae tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:51:36.050016 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-d040bb6e-af52-41dd-808d-ab8f8b4401ae tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:51:36.056064 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-d040bb6e-af52-41dd-808d-ab8f8b4401ae tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:51:36.056534 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-d040bb6e-af52-41dd-808d-ab8f8b4401ae tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:51:36.057292 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-d040bb6e-af52-41dd-808d-ab8f8b4401ae tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:51:36.057725 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-d040bb6e-af52-41dd-808d-ab8f8b4401ae tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:51:36.183578 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-d040bb6e-af52-41dd-808d-ab8f8b4401ae tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:51:36.191732 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-d040bb6e-af52-41dd-808d-ab8f8b4401ae tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:51:36.193265 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-d040bb6e-af52-41dd-808d-ab8f8b4401ae tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:51:36.194448 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-d040bb6e-af52-41dd-808d-ab8f8b4401ae tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672" status: 200 len: 1748 microversion: 2.20 time: 0.148777 Oct 27 15:51:36.194975 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 733/1390] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Oct 27 15:51:36 2021] GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672 => generated 1748 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 15:51:36.910602 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-1059e2fd-9bb2-4d65-931e-eaf5ced07449 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:51:36.911508 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-1059e2fd-9bb2-4d65-931e-eaf5ced07449 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: 62c89161-c119-48b2-839d-712db798ff96] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:51:36.918565 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-1059e2fd-9bb2-4d65-931e-eaf5ced07449 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:51:36.919407 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-1059e2fd-9bb2-4d65-931e-eaf5ced07449 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:51:36.919763 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-1059e2fd-9bb2-4d65-931e-eaf5ced07449 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:51:36.920219 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-1059e2fd-9bb2-4d65-931e-eaf5ced07449 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:51:36.947673 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-42b6bb7f-e9ff-4637-9109-46254bf25525 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:51:36.948373 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-42b6bb7f-e9ff-4637-9109-46254bf25525 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] [instance: a79303e6-05ad-4901-96b7-ce845b4016f4] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:51:36.948679 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-1059e2fd-9bb2-4d65-931e-eaf5ced07449 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041905 Oct 27 15:51:36.949232 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 658/1391] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Oct 27 15:51:36 2021] GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 15:51:36.954777 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-42b6bb7f-e9ff-4637-9109-46254bf25525 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:51:36.955295 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-42b6bb7f-e9ff-4637-9109-46254bf25525 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:51:36.956091 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-42b6bb7f-e9ff-4637-9109-46254bf25525 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:51:36.956528 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-42b6bb7f-e9ff-4637-9109-46254bf25525 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:51:37.017032 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-42b6bb7f-e9ff-4637-9109-46254bf25525 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c757a383a434a4c9b1b928087af8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8818377e744d4f6ba65560705c191f0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:51:37.025155 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-42b6bb7f-e9ff-4637-9109-46254bf25525 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] 10.222.0.64 "GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4" status: 200 len: 1226 microversion: 2.1 time: 0.081145 Oct 27 15:51:37.025780 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 734/1392] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:51:36 2021] GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4 => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 15:51:37.214130 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-6300c912-cccb-4a44-b59e-ea976b0085bf tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:51:37.214714 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-6300c912-cccb-4a44-b59e-ea976b0085bf tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:51:37.220741 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-6300c912-cccb-4a44-b59e-ea976b0085bf tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:51:37.221188 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-6300c912-cccb-4a44-b59e-ea976b0085bf tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:51:37.221960 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-6300c912-cccb-4a44-b59e-ea976b0085bf tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:51:37.222390 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-6300c912-cccb-4a44-b59e-ea976b0085bf tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:51:37.342305 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-6300c912-cccb-4a44-b59e-ea976b0085bf tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:51:37.350548 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-6300c912-cccb-4a44-b59e-ea976b0085bf tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:51:37.352950 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-6300c912-cccb-4a44-b59e-ea976b0085bf tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:51:37.354134 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-6300c912-cccb-4a44-b59e-ea976b0085bf tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672" status: 200 len: 1748 microversion: 2.20 time: 0.144225 Oct 27 15:51:37.354737 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 659/1393] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Oct 27 15:51:37 2021] GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672 => generated 1748 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 15:51:37.959963 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-2f0e9950-1b68-42e9-b57e-344958f51416 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:51:37.961472 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-2f0e9950-1b68-42e9-b57e-344958f51416 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: 62c89161-c119-48b2-839d-712db798ff96] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:51:37.967937 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-2f0e9950-1b68-42e9-b57e-344958f51416 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:51:37.968380 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-2f0e9950-1b68-42e9-b57e-344958f51416 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:51:37.969143 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-2f0e9950-1b68-42e9-b57e-344958f51416 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:51:37.969584 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-2f0e9950-1b68-42e9-b57e-344958f51416 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:51:37.997999 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-2f0e9950-1b68-42e9-b57e-344958f51416 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041843 Oct 27 15:51:37.998549 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 735/1394] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Oct 27 15:51:37 2021] GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 15:51:38.041996 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-e04cbc21-2a3b-4aed-8669-3d46b167f4b6 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:51:38.042597 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-e04cbc21-2a3b-4aed-8669-3d46b167f4b6 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] [instance: a79303e6-05ad-4901-96b7-ce845b4016f4] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:51:38.048792 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-e04cbc21-2a3b-4aed-8669-3d46b167f4b6 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:51:38.049233 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-e04cbc21-2a3b-4aed-8669-3d46b167f4b6 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:51:38.049990 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-e04cbc21-2a3b-4aed-8669-3d46b167f4b6 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:51:38.050454 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-e04cbc21-2a3b-4aed-8669-3d46b167f4b6 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:51:38.113246 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-e04cbc21-2a3b-4aed-8669-3d46b167f4b6 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c757a383a434a4c9b1b928087af8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8818377e744d4f6ba65560705c191f0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:51:38.121558 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-e04cbc21-2a3b-4aed-8669-3d46b167f4b6 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] 10.222.0.64 "GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4" status: 200 len: 1226 microversion: 2.1 time: 0.083227 Oct 27 15:51:38.122125 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 660/1395] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:51:38 2021] GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4 => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 15:51:38.372551 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-aa31ffbd-db61-4bc2-a812-b7f1bd3e6dc9 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:51:38.373931 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-aa31ffbd-db61-4bc2-a812-b7f1bd3e6dc9 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:51:38.379673 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-aa31ffbd-db61-4bc2-a812-b7f1bd3e6dc9 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:51:38.380146 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-aa31ffbd-db61-4bc2-a812-b7f1bd3e6dc9 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:51:38.380911 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-aa31ffbd-db61-4bc2-a812-b7f1bd3e6dc9 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:51:38.381340 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-aa31ffbd-db61-4bc2-a812-b7f1bd3e6dc9 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:51:38.501445 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-aa31ffbd-db61-4bc2-a812-b7f1bd3e6dc9 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:51:38.509684 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-aa31ffbd-db61-4bc2-a812-b7f1bd3e6dc9 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:51:38.511188 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-aa31ffbd-db61-4bc2-a812-b7f1bd3e6dc9 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:51:38.512416 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-aa31ffbd-db61-4bc2-a812-b7f1bd3e6dc9 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672" status: 200 len: 1748 microversion: 2.20 time: 0.143624 Oct 27 15:51:38.512979 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 736/1396] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Oct 27 15:51:38 2021] GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672 => generated 1748 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 15:51:39.009867 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-8d000984-f1c8-4310-b93c-0f88187e1047 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:51:39.010879 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-8d000984-f1c8-4310-b93c-0f88187e1047 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: 62c89161-c119-48b2-839d-712db798ff96] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:51:39.016703 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-8d000984-f1c8-4310-b93c-0f88187e1047 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:51:39.017140 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-8d000984-f1c8-4310-b93c-0f88187e1047 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:51:39.017895 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-8d000984-f1c8-4310-b93c-0f88187e1047 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:51:39.018319 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-8d000984-f1c8-4310-b93c-0f88187e1047 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:51:39.048322 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-8d000984-f1c8-4310-b93c-0f88187e1047 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042670 Oct 27 15:51:39.048962 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 661/1397] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Oct 27 15:51:39 2021] GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 15:51:39.138539 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-1e5db724-db30-40a4-8af1-67be77f7a7bc tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:51:39.139160 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-1e5db724-db30-40a4-8af1-67be77f7a7bc tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] [instance: a79303e6-05ad-4901-96b7-ce845b4016f4] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:51:39.145507 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-1e5db724-db30-40a4-8af1-67be77f7a7bc tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:51:39.145944 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-1e5db724-db30-40a4-8af1-67be77f7a7bc tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:51:39.146672 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-1e5db724-db30-40a4-8af1-67be77f7a7bc tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:51:39.147160 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-1e5db724-db30-40a4-8af1-67be77f7a7bc tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:51:39.210382 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-1e5db724-db30-40a4-8af1-67be77f7a7bc tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c757a383a434a4c9b1b928087af8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8818377e744d4f6ba65560705c191f0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:51:39.218736 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-1e5db724-db30-40a4-8af1-67be77f7a7bc tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] 10.222.0.64 "GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4" status: 200 len: 1226 microversion: 2.1 time: 0.083911 Oct 27 15:51:39.219301 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 737/1398] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:51:39 2021] GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4 => generated 1226 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 15:51:39.530937 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-abcc921e-e2b5-4c8b-a64a-7ce5d68d53fb tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:51:39.531622 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-abcc921e-e2b5-4c8b-a64a-7ce5d68d53fb tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:51:39.537417 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-abcc921e-e2b5-4c8b-a64a-7ce5d68d53fb tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:51:39.537860 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-abcc921e-e2b5-4c8b-a64a-7ce5d68d53fb tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:51:39.538615 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-abcc921e-e2b5-4c8b-a64a-7ce5d68d53fb tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:51:39.539041 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-abcc921e-e2b5-4c8b-a64a-7ce5d68d53fb tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:51:39.659070 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-abcc921e-e2b5-4c8b-a64a-7ce5d68d53fb tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:51:39.667516 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-abcc921e-e2b5-4c8b-a64a-7ce5d68d53fb tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:51:39.669377 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-abcc921e-e2b5-4c8b-a64a-7ce5d68d53fb tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:51:39.670562 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-abcc921e-e2b5-4c8b-a64a-7ce5d68d53fb tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672" status: 200 len: 1748 microversion: 2.20 time: 0.143766 Oct 27 15:51:39.671249 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 662/1399] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Oct 27 15:51:39 2021] GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672 => generated 1748 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 15:51:40.060488 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-e1d877c4-4f87-43fd-bf02-cebfed539353 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:51:40.061396 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-e1d877c4-4f87-43fd-bf02-cebfed539353 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: 62c89161-c119-48b2-839d-712db798ff96] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:51:40.067179 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-e1d877c4-4f87-43fd-bf02-cebfed539353 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:51:40.067623 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-e1d877c4-4f87-43fd-bf02-cebfed539353 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:51:40.068421 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-e1d877c4-4f87-43fd-bf02-cebfed539353 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:51:40.068853 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-e1d877c4-4f87-43fd-bf02-cebfed539353 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:51:40.096737 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-e1d877c4-4f87-43fd-bf02-cebfed539353 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040802 Oct 27 15:51:40.097290 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 738/1400] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Oct 27 15:51:40 2021] GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 15:51:40.235040 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-bd34d88f-9679-41d1-8f70-59bef40ba903 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:51:40.235708 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-bd34d88f-9679-41d1-8f70-59bef40ba903 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] [instance: a79303e6-05ad-4901-96b7-ce845b4016f4] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:51:40.241996 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-bd34d88f-9679-41d1-8f70-59bef40ba903 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:51:40.242437 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-bd34d88f-9679-41d1-8f70-59bef40ba903 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:51:40.243197 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-bd34d88f-9679-41d1-8f70-59bef40ba903 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:51:40.243630 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-bd34d88f-9679-41d1-8f70-59bef40ba903 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:51:40.304152 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-bd34d88f-9679-41d1-8f70-59bef40ba903 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c757a383a434a4c9b1b928087af8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8818377e744d4f6ba65560705c191f0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:51:40.311913 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-bd34d88f-9679-41d1-8f70-59bef40ba903 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] 10.222.0.64 "GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4" status: 200 len: 1226 microversion: 2.1 time: 0.080529 Oct 27 15:51:40.312474 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 663/1401] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:51:40 2021] GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4 => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 15:51:40.688165 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-df486a98-2c22-413c-b1e5-3c05ee94d4b7 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:51:40.688778 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-df486a98-2c22-413c-b1e5-3c05ee94d4b7 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:51:40.694973 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-df486a98-2c22-413c-b1e5-3c05ee94d4b7 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:51:40.695418 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-df486a98-2c22-413c-b1e5-3c05ee94d4b7 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:51:40.696208 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-df486a98-2c22-413c-b1e5-3c05ee94d4b7 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:51:40.696638 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-df486a98-2c22-413c-b1e5-3c05ee94d4b7 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:51:40.818874 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-df486a98-2c22-413c-b1e5-3c05ee94d4b7 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:51:40.827003 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-df486a98-2c22-413c-b1e5-3c05ee94d4b7 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:51:40.828539 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-df486a98-2c22-413c-b1e5-3c05ee94d4b7 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:51:40.829684 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-df486a98-2c22-413c-b1e5-3c05ee94d4b7 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672" status: 200 len: 1748 microversion: 2.20 time: 0.145236 Oct 27 15:51:40.830243 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 739/1402] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Oct 27 15:51:40 2021] GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672 => generated 1748 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 15:51:41.108312 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-8a5c20cb-b87f-473c-9546-0ad459a85410 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:51:41.109132 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-8a5c20cb-b87f-473c-9546-0ad459a85410 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: 62c89161-c119-48b2-839d-712db798ff96] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:51:41.114768 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-8a5c20cb-b87f-473c-9546-0ad459a85410 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:51:41.115203 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-8a5c20cb-b87f-473c-9546-0ad459a85410 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:51:41.115985 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-8a5c20cb-b87f-473c-9546-0ad459a85410 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:51:41.116409 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-8a5c20cb-b87f-473c-9546-0ad459a85410 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:51:41.145237 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-8a5c20cb-b87f-473c-9546-0ad459a85410 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040752 Oct 27 15:51:41.145788 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 664/1403] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Oct 27 15:51:41 2021] GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 15:51:41.328779 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-c884553e-4e01-4110-b07a-2abb23c3bac1 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:51:41.329416 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-c884553e-4e01-4110-b07a-2abb23c3bac1 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] [instance: a79303e6-05ad-4901-96b7-ce845b4016f4] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:51:41.335125 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-c884553e-4e01-4110-b07a-2abb23c3bac1 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:51:41.335568 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-c884553e-4e01-4110-b07a-2abb23c3bac1 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:51:41.336361 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-c884553e-4e01-4110-b07a-2abb23c3bac1 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:51:41.336788 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-c884553e-4e01-4110-b07a-2abb23c3bac1 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:51:41.396258 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-c884553e-4e01-4110-b07a-2abb23c3bac1 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c757a383a434a4c9b1b928087af8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8818377e744d4f6ba65560705c191f0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:51:41.404030 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-c884553e-4e01-4110-b07a-2abb23c3bac1 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] 10.222.0.64 "GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4" status: 200 len: 1226 microversion: 2.1 time: 0.078891 Oct 27 15:51:41.404599 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 740/1404] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:51:41 2021] GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4 => generated 1226 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 15:51:41.848574 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-cb4d8ce5-21b8-4d51-aac7-d3df01e8c9f2 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:51:41.849176 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-cb4d8ce5-21b8-4d51-aac7-d3df01e8c9f2 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:51:41.855308 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-cb4d8ce5-21b8-4d51-aac7-d3df01e8c9f2 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:51:41.855877 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-cb4d8ce5-21b8-4d51-aac7-d3df01e8c9f2 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:51:41.856650 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-cb4d8ce5-21b8-4d51-aac7-d3df01e8c9f2 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:51:41.857079 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-cb4d8ce5-21b8-4d51-aac7-d3df01e8c9f2 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:51:41.975449 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-cb4d8ce5-21b8-4d51-aac7-d3df01e8c9f2 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:51:41.983573 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-cb4d8ce5-21b8-4d51-aac7-d3df01e8c9f2 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:51:41.985108 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-cb4d8ce5-21b8-4d51-aac7-d3df01e8c9f2 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:51:41.986291 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-cb4d8ce5-21b8-4d51-aac7-d3df01e8c9f2 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672" status: 200 len: 1748 microversion: 2.20 time: 0.141452 Oct 27 15:51:41.986847 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 665/1405] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Oct 27 15:51:41 2021] GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672 => generated 1748 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 15:51:42.156624 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-9eb83e3c-1790-4430-9c39-cd929807831f tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:51:42.157459 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-9eb83e3c-1790-4430-9c39-cd929807831f tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: 62c89161-c119-48b2-839d-712db798ff96] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:51:42.163636 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-9eb83e3c-1790-4430-9c39-cd929807831f tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:51:42.164112 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-9eb83e3c-1790-4430-9c39-cd929807831f tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:51:42.164889 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-9eb83e3c-1790-4430-9c39-cd929807831f tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:51:42.165321 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-9eb83e3c-1790-4430-9c39-cd929807831f tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:51:42.193768 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-9eb83e3c-1790-4430-9c39-cd929807831f tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041253 Oct 27 15:51:42.194316 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 741/1406] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Oct 27 15:51:42 2021] GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 15:51:42.421061 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-bfc7161b-0928-4e9b-8d47-a87a6eecb01a tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:51:42.421590 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-bfc7161b-0928-4e9b-8d47-a87a6eecb01a tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] [instance: a79303e6-05ad-4901-96b7-ce845b4016f4] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:51:42.427322 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-bfc7161b-0928-4e9b-8d47-a87a6eecb01a tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:51:42.427758 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-bfc7161b-0928-4e9b-8d47-a87a6eecb01a tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:51:42.428540 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-bfc7161b-0928-4e9b-8d47-a87a6eecb01a tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:51:42.428973 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-bfc7161b-0928-4e9b-8d47-a87a6eecb01a tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:51:42.491420 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-bfc7161b-0928-4e9b-8d47-a87a6eecb01a tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c757a383a434a4c9b1b928087af8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8818377e744d4f6ba65560705c191f0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:51:42.499429 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-bfc7161b-0928-4e9b-8d47-a87a6eecb01a tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] 10.222.0.64 "GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4" status: 200 len: 1226 microversion: 2.1 time: 0.082617 Oct 27 15:51:42.500025 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 666/1407] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:51:42 2021] GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4 => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 15:51:43.004338 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-109f4121-090f-4401-8a31-9c0c995d22e3 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:51:43.004939 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-109f4121-090f-4401-8a31-9c0c995d22e3 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:51:43.010729 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-109f4121-090f-4401-8a31-9c0c995d22e3 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:51:43.011164 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-109f4121-090f-4401-8a31-9c0c995d22e3 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:51:43.011935 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-109f4121-090f-4401-8a31-9c0c995d22e3 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:51:43.012932 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-109f4121-090f-4401-8a31-9c0c995d22e3 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:51:43.131751 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-109f4121-090f-4401-8a31-9c0c995d22e3 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:51:43.140899 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-109f4121-090f-4401-8a31-9c0c995d22e3 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:51:43.142404 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-109f4121-090f-4401-8a31-9c0c995d22e3 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:51:43.143558 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-109f4121-090f-4401-8a31-9c0c995d22e3 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672" status: 200 len: 1748 microversion: 2.20 time: 0.142931 Oct 27 15:51:43.144159 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 742/1408] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Oct 27 15:51:42 2021] GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672 => generated 1748 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 15:51:43.205529 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-ac9bc063-a9fd-4df3-a186-eb9cb8f1dcc8 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:51:43.206432 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-ac9bc063-a9fd-4df3-a186-eb9cb8f1dcc8 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: 62c89161-c119-48b2-839d-712db798ff96] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:51:43.212674 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-ac9bc063-a9fd-4df3-a186-eb9cb8f1dcc8 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:51:43.213084 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-ac9bc063-a9fd-4df3-a186-eb9cb8f1dcc8 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:51:43.213847 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-ac9bc063-a9fd-4df3-a186-eb9cb8f1dcc8 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:51:43.214279 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-ac9bc063-a9fd-4df3-a186-eb9cb8f1dcc8 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:51:43.242971 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-ac9bc063-a9fd-4df3-a186-eb9cb8f1dcc8 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041208 Oct 27 15:51:43.243512 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 667/1409] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Oct 27 15:51:43 2021] GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 15:51:43.518164 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-4ac3eda9-204c-459d-96fb-730dd9c90d9d tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:51:43.518769 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-4ac3eda9-204c-459d-96fb-730dd9c90d9d tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] [instance: a79303e6-05ad-4901-96b7-ce845b4016f4] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:51:43.525729 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-4ac3eda9-204c-459d-96fb-730dd9c90d9d tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:51:43.526255 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-4ac3eda9-204c-459d-96fb-730dd9c90d9d tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:51:43.527027 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-4ac3eda9-204c-459d-96fb-730dd9c90d9d tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:51:43.527468 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-4ac3eda9-204c-459d-96fb-730dd9c90d9d tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:51:43.590711 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-4ac3eda9-204c-459d-96fb-730dd9c90d9d tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c757a383a434a4c9b1b928087af8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8818377e744d4f6ba65560705c191f0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:51:43.598458 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-4ac3eda9-204c-459d-96fb-730dd9c90d9d tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] 10.222.0.64 "GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4" status: 200 len: 1226 microversion: 2.1 time: 0.084565 Oct 27 15:51:43.599015 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 743/1410] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:51:43 2021] GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4 => generated 1226 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 15:51:44.162377 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-ba708c09-5de0-4c33-93b4-958583931449 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:51:44.163010 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-ba708c09-5de0-4c33-93b4-958583931449 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:51:44.169071 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-ba708c09-5de0-4c33-93b4-958583931449 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:51:44.169460 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-ba708c09-5de0-4c33-93b4-958583931449 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:51:44.170218 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-ba708c09-5de0-4c33-93b4-958583931449 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:51:44.170655 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-ba708c09-5de0-4c33-93b4-958583931449 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:51:44.256340 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-d9fe00d3-7508-40ab-9c77-65ff9ce1fe0e tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:51:44.256681 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-d9fe00d3-7508-40ab-9c77-65ff9ce1fe0e tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: 62c89161-c119-48b2-839d-712db798ff96] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:51:44.263506 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-d9fe00d3-7508-40ab-9c77-65ff9ce1fe0e tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:51:44.264002 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-d9fe00d3-7508-40ab-9c77-65ff9ce1fe0e tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:51:44.264763 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-d9fe00d3-7508-40ab-9c77-65ff9ce1fe0e tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:51:44.265198 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-d9fe00d3-7508-40ab-9c77-65ff9ce1fe0e tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:51:44.295655 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-d9fe00d3-7508-40ab-9c77-65ff9ce1fe0e tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044149 Oct 27 15:51:44.296255 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 744/1411] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Oct 27 15:51:44 2021] GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 15:51:44.299776 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-ba708c09-5de0-4c33-93b4-958583931449 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:51:44.308421 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-ba708c09-5de0-4c33-93b4-958583931449 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:51:44.310453 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-ba708c09-5de0-4c33-93b4-958583931449 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:51:44.311624 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-ba708c09-5de0-4c33-93b4-958583931449 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672" status: 200 len: 1748 microversion: 2.20 time: 0.153053 Oct 27 15:51:44.312206 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 668/1412] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Oct 27 15:51:44 2021] GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672 => generated 1748 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 15:51:44.614618 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-b6e28b4e-d78a-46ee-a868-6d90fe9b94b4 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:51:44.615202 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-b6e28b4e-d78a-46ee-a868-6d90fe9b94b4 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] [instance: a79303e6-05ad-4901-96b7-ce845b4016f4] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:51:44.621367 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-b6e28b4e-d78a-46ee-a868-6d90fe9b94b4 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:51:44.621792 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-b6e28b4e-d78a-46ee-a868-6d90fe9b94b4 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:51:44.622581 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-b6e28b4e-d78a-46ee-a868-6d90fe9b94b4 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:51:44.622974 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-b6e28b4e-d78a-46ee-a868-6d90fe9b94b4 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:51:44.681674 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-b6e28b4e-d78a-46ee-a868-6d90fe9b94b4 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c757a383a434a4c9b1b928087af8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8818377e744d4f6ba65560705c191f0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:51:44.689193 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-b6e28b4e-d78a-46ee-a868-6d90fe9b94b4 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] 10.222.0.64 "GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4" status: 200 len: 1226 microversion: 2.1 time: 0.078312 Oct 27 15:51:44.689753 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 745/1413] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:51:44 2021] GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4 => generated 1226 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 15:51:45.308819 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-f5f7a633-a9e2-4bed-9fe3-7fd79294b4ce tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:51:45.310337 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-f5f7a633-a9e2-4bed-9fe3-7fd79294b4ce tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: 62c89161-c119-48b2-839d-712db798ff96] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:51:45.316485 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-f5f7a633-a9e2-4bed-9fe3-7fd79294b4ce tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:51:45.316933 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-f5f7a633-a9e2-4bed-9fe3-7fd79294b4ce tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:51:45.317690 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-f5f7a633-a9e2-4bed-9fe3-7fd79294b4ce tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:51:45.318119 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-f5f7a633-a9e2-4bed-9fe3-7fd79294b4ce tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:51:45.330517 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-3dfbe85c-cb2f-40d8-af70-859519c6f754 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:51:45.331251 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-3dfbe85c-cb2f-40d8-af70-859519c6f754 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:51:45.336949 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-3dfbe85c-cb2f-40d8-af70-859519c6f754 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:51:45.337399 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-3dfbe85c-cb2f-40d8-af70-859519c6f754 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:51:45.338172 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-3dfbe85c-cb2f-40d8-af70-859519c6f754 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:51:45.338605 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-3dfbe85c-cb2f-40d8-af70-859519c6f754 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:51:45.348481 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-f5f7a633-a9e2-4bed-9fe3-7fd79294b4ce tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043461 Oct 27 15:51:45.349046 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 669/1414] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Oct 27 15:51:45 2021] GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 15:51:45.462157 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-3dfbe85c-cb2f-40d8-af70-859519c6f754 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:51:45.471407 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-3dfbe85c-cb2f-40d8-af70-859519c6f754 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:51:45.472943 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-3dfbe85c-cb2f-40d8-af70-859519c6f754 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:51:45.474107 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-3dfbe85c-cb2f-40d8-af70-859519c6f754 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672" status: 200 len: 1748 microversion: 2.20 time: 0.147346 Oct 27 15:51:45.474668 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 746/1415] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Oct 27 15:51:45 2021] GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672 => generated 1748 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 15:51:45.705013 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-df15e7e0-adb3-42bc-b729-22074b7e2f8c tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:51:45.705610 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-df15e7e0-adb3-42bc-b729-22074b7e2f8c tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] [instance: a79303e6-05ad-4901-96b7-ce845b4016f4] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:51:45.711469 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-df15e7e0-adb3-42bc-b729-22074b7e2f8c tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:51:45.711937 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-df15e7e0-adb3-42bc-b729-22074b7e2f8c tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:51:45.712688 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-df15e7e0-adb3-42bc-b729-22074b7e2f8c tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:51:45.713110 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-df15e7e0-adb3-42bc-b729-22074b7e2f8c tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:51:45.772174 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-df15e7e0-adb3-42bc-b729-22074b7e2f8c tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c757a383a434a4c9b1b928087af8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8818377e744d4f6ba65560705c191f0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:51:45.780319 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-df15e7e0-adb3-42bc-b729-22074b7e2f8c tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] 10.222.0.64 "GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4" status: 200 len: 1226 microversion: 2.1 time: 0.078976 Oct 27 15:51:45.780888 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 670/1416] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:51:45 2021] GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4 => generated 1226 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 15:51:46.360312 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-5bd9945b-3b9f-4bb0-ba69-0554856712f7 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:51:46.361224 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-5bd9945b-3b9f-4bb0-ba69-0554856712f7 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: 62c89161-c119-48b2-839d-712db798ff96] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:51:46.367512 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-5bd9945b-3b9f-4bb0-ba69-0554856712f7 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:51:46.367996 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-5bd9945b-3b9f-4bb0-ba69-0554856712f7 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:51:46.368773 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-5bd9945b-3b9f-4bb0-ba69-0554856712f7 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:51:46.369207 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-5bd9945b-3b9f-4bb0-ba69-0554856712f7 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:51:46.398168 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-5bd9945b-3b9f-4bb0-ba69-0554856712f7 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041747 Oct 27 15:51:46.398735 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 747/1417] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Oct 27 15:51:46 2021] GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 15:51:46.492025 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-a5018f07-1183-49f8-a890-f35baecc3a2a tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:51:46.492638 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-a5018f07-1183-49f8-a890-f35baecc3a2a tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:51:46.499314 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-a5018f07-1183-49f8-a890-f35baecc3a2a tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:51:46.499754 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-a5018f07-1183-49f8-a890-f35baecc3a2a tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:51:46.500543 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-a5018f07-1183-49f8-a890-f35baecc3a2a tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:51:46.500973 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-a5018f07-1183-49f8-a890-f35baecc3a2a tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:51:46.624276 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-a5018f07-1183-49f8-a890-f35baecc3a2a tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:51:46.632378 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-a5018f07-1183-49f8-a890-f35baecc3a2a tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:51:46.633853 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-a5018f07-1183-49f8-a890-f35baecc3a2a tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:51:46.634992 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-a5018f07-1183-49f8-a890-f35baecc3a2a tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672" status: 200 len: 1748 microversion: 2.20 time: 0.146681 Oct 27 15:51:46.635548 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 671/1418] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Oct 27 15:51:46 2021] GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672 => generated 1748 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 15:51:46.796489 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-33268fac-a846-47f5-8598-0d1daad59698 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:51:46.797088 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-33268fac-a846-47f5-8598-0d1daad59698 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] [instance: a79303e6-05ad-4901-96b7-ce845b4016f4] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:51:46.802850 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-33268fac-a846-47f5-8598-0d1daad59698 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:51:46.803286 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-33268fac-a846-47f5-8598-0d1daad59698 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:51:46.804069 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-33268fac-a846-47f5-8598-0d1daad59698 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:51:46.804496 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-33268fac-a846-47f5-8598-0d1daad59698 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:51:46.864894 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-33268fac-a846-47f5-8598-0d1daad59698 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c757a383a434a4c9b1b928087af8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8818377e744d4f6ba65560705c191f0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:51:46.873391 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-33268fac-a846-47f5-8598-0d1daad59698 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] 10.222.0.64 "GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4" status: 200 len: 1226 microversion: 2.1 time: 0.080590 Oct 27 15:51:46.873961 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 748/1419] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:51:46 2021] GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4 => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 15:51:47.409749 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-eba64cb5-0e00-4fb7-9ed1-6ec6dacfeb7d tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:51:47.410648 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-eba64cb5-0e00-4fb7-9ed1-6ec6dacfeb7d tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: 62c89161-c119-48b2-839d-712db798ff96] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:51:47.416489 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-eba64cb5-0e00-4fb7-9ed1-6ec6dacfeb7d tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:51:47.416930 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-eba64cb5-0e00-4fb7-9ed1-6ec6dacfeb7d tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:51:47.417689 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-eba64cb5-0e00-4fb7-9ed1-6ec6dacfeb7d tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:51:47.418111 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-eba64cb5-0e00-4fb7-9ed1-6ec6dacfeb7d tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:51:47.451342 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-eba64cb5-0e00-4fb7-9ed1-6ec6dacfeb7d tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045272 Oct 27 15:51:47.451931 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 672/1420] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Oct 27 15:51:47 2021] GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 15:51:47.654195 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-e5b59c3a-9a5e-46ce-98c9-1fbeed3ce498 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:51:47.654799 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-e5b59c3a-9a5e-46ce-98c9-1fbeed3ce498 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:51:47.661210 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-e5b59c3a-9a5e-46ce-98c9-1fbeed3ce498 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:51:47.661580 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-e5b59c3a-9a5e-46ce-98c9-1fbeed3ce498 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:51:47.662343 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-e5b59c3a-9a5e-46ce-98c9-1fbeed3ce498 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:51:47.662778 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-e5b59c3a-9a5e-46ce-98c9-1fbeed3ce498 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:51:47.787572 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-e5b59c3a-9a5e-46ce-98c9-1fbeed3ce498 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:51:47.795911 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-e5b59c3a-9a5e-46ce-98c9-1fbeed3ce498 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:51:47.797696 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-e5b59c3a-9a5e-46ce-98c9-1fbeed3ce498 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:51:47.798836 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-e5b59c3a-9a5e-46ce-98c9-1fbeed3ce498 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672" status: 200 len: 1748 microversion: 2.20 time: 0.149592 Oct 27 15:51:47.799383 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 749/1421] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Oct 27 15:51:47 2021] GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672 => generated 1748 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 15:51:47.895878 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-e2cfc7d7-d7e5-4dad-a670-b4c231394af4 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:51:47.896504 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-e2cfc7d7-d7e5-4dad-a670-b4c231394af4 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] [instance: a79303e6-05ad-4901-96b7-ce845b4016f4] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:51:47.902911 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-e2cfc7d7-d7e5-4dad-a670-b4c231394af4 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:51:47.903723 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-e2cfc7d7-d7e5-4dad-a670-b4c231394af4 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:51:47.904521 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-e2cfc7d7-d7e5-4dad-a670-b4c231394af4 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:51:47.904946 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-e2cfc7d7-d7e5-4dad-a670-b4c231394af4 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:51:47.963939 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-e2cfc7d7-d7e5-4dad-a670-b4c231394af4 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c757a383a434a4c9b1b928087af8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8818377e744d4f6ba65560705c191f0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:51:47.972339 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-e2cfc7d7-d7e5-4dad-a670-b4c231394af4 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] 10.222.0.64 "GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4" status: 200 len: 1226 microversion: 2.1 time: 0.080056 Oct 27 15:51:47.972912 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 673/1422] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:51:47 2021] GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4 => generated 1226 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 15:51:48.461915 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-bc078571-97f9-4f33-884b-4c52ef8fe2ac tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:51:48.462816 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-bc078571-97f9-4f33-884b-4c52ef8fe2ac tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: 62c89161-c119-48b2-839d-712db798ff96] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:51:48.471192 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-bc078571-97f9-4f33-884b-4c52ef8fe2ac tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:51:48.471630 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-bc078571-97f9-4f33-884b-4c52ef8fe2ac tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:51:48.472425 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-bc078571-97f9-4f33-884b-4c52ef8fe2ac tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:51:48.472854 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-bc078571-97f9-4f33-884b-4c52ef8fe2ac tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:51:48.501770 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-bc078571-97f9-4f33-884b-4c52ef8fe2ac tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043636 Oct 27 15:51:48.502329 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 750/1423] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Oct 27 15:51:48 2021] GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 15:51:48.817308 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-cdfa3e8f-af4b-4500-95e8-7af3668a2cdf tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:51:48.817905 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-cdfa3e8f-af4b-4500-95e8-7af3668a2cdf tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:51:48.823813 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-cdfa3e8f-af4b-4500-95e8-7af3668a2cdf tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:51:48.824287 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-cdfa3e8f-af4b-4500-95e8-7af3668a2cdf tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:51:48.825836 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-cdfa3e8f-af4b-4500-95e8-7af3668a2cdf tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:51:48.826271 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-cdfa3e8f-af4b-4500-95e8-7af3668a2cdf tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:51:48.944226 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-cdfa3e8f-af4b-4500-95e8-7af3668a2cdf tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:51:48.952866 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-cdfa3e8f-af4b-4500-95e8-7af3668a2cdf tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:51:48.954343 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-cdfa3e8f-af4b-4500-95e8-7af3668a2cdf tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:51:48.955478 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-cdfa3e8f-af4b-4500-95e8-7af3668a2cdf tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672" status: 200 len: 1748 microversion: 2.20 time: 0.142013 Oct 27 15:51:48.956045 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 674/1424] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Oct 27 15:51:48 2021] GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672 => generated 1748 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 15:51:48.988862 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-003e72e3-1d62-404c-be95-fe4f9807c1e0 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:51:48.989471 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-003e72e3-1d62-404c-be95-fe4f9807c1e0 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] [instance: a79303e6-05ad-4901-96b7-ce845b4016f4] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:51:48.995563 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-003e72e3-1d62-404c-be95-fe4f9807c1e0 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:51:48.996052 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-003e72e3-1d62-404c-be95-fe4f9807c1e0 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:51:48.997352 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-003e72e3-1d62-404c-be95-fe4f9807c1e0 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:51:48.997785 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-003e72e3-1d62-404c-be95-fe4f9807c1e0 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:51:49.057188 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-003e72e3-1d62-404c-be95-fe4f9807c1e0 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c757a383a434a4c9b1b928087af8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8818377e744d4f6ba65560705c191f0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:51:49.065054 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-003e72e3-1d62-404c-be95-fe4f9807c1e0 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] 10.222.0.64 "GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4" status: 200 len: 1226 microversion: 2.1 time: 0.079877 Oct 27 15:51:49.065619 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 751/1425] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:51:48 2021] GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4 => generated 1226 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 15:51:49.513299 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-3827db86-f945-40d3-ac3c-160e1a4b38b9 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:51:49.514195 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-3827db86-f945-40d3-ac3c-160e1a4b38b9 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: 62c89161-c119-48b2-839d-712db798ff96] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:51:49.519977 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-3827db86-f945-40d3-ac3c-160e1a4b38b9 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:51:49.520425 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-3827db86-f945-40d3-ac3c-160e1a4b38b9 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:51:49.521185 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-3827db86-f945-40d3-ac3c-160e1a4b38b9 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:51:49.521619 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-3827db86-f945-40d3-ac3c-160e1a4b38b9 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:51:49.550412 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-3827db86-f945-40d3-ac3c-160e1a4b38b9 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040929 Oct 27 15:51:49.550966 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 675/1426] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Oct 27 15:51:49 2021] GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 15:51:49.972641 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-500151e7-4766-449c-89b5-cf12cb1a9632 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:51:49.973244 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-500151e7-4766-449c-89b5-cf12cb1a9632 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:51:49.978878 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-500151e7-4766-449c-89b5-cf12cb1a9632 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:51:49.979313 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-500151e7-4766-449c-89b5-cf12cb1a9632 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:51:49.980091 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-500151e7-4766-449c-89b5-cf12cb1a9632 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:51:49.980520 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-500151e7-4766-449c-89b5-cf12cb1a9632 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:51:50.081608 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-1708475b-c1ce-4d26-a6cf-1cf589e50cb1 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:51:50.082154 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-1708475b-c1ce-4d26-a6cf-1cf589e50cb1 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] [instance: a79303e6-05ad-4901-96b7-ce845b4016f4] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:51:50.088202 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-1708475b-c1ce-4d26-a6cf-1cf589e50cb1 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:51:50.088653 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-1708475b-c1ce-4d26-a6cf-1cf589e50cb1 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:51:50.089413 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-1708475b-c1ce-4d26-a6cf-1cf589e50cb1 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:51:50.089863 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-1708475b-c1ce-4d26-a6cf-1cf589e50cb1 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:51:50.152657 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-1708475b-c1ce-4d26-a6cf-1cf589e50cb1 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c757a383a434a4c9b1b928087af8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8818377e744d4f6ba65560705c191f0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:51:50.160901 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-1708475b-c1ce-4d26-a6cf-1cf589e50cb1 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] 10.222.0.64 "GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4" status: 200 len: 1226 microversion: 2.1 time: 0.083087 Oct 27 15:51:50.161471 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 676/1427] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:51:50 2021] GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4 => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 15:51:50.214209 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-500151e7-4766-449c-89b5-cf12cb1a9632 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:51:50.223098 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-500151e7-4766-449c-89b5-cf12cb1a9632 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:51:50.224855 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-500151e7-4766-449c-89b5-cf12cb1a9632 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:51:50.226006 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-500151e7-4766-449c-89b5-cf12cb1a9632 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672" status: 200 len: 1748 microversion: 2.20 time: 0.257188 Oct 27 15:51:50.226649 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 752/1428] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Oct 27 15:51:49 2021] GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672 => generated 1748 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 15:51:50.561801 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-c47c9cc2-057a-475d-a436-6dea4400d0fd tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:51:50.562724 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-c47c9cc2-057a-475d-a436-6dea4400d0fd tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: 62c89161-c119-48b2-839d-712db798ff96] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:51:50.568511 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-c47c9cc2-057a-475d-a436-6dea4400d0fd tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:51:50.568956 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-c47c9cc2-057a-475d-a436-6dea4400d0fd tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:51:50.569713 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-c47c9cc2-057a-475d-a436-6dea4400d0fd tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:51:50.570139 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-c47c9cc2-057a-475d-a436-6dea4400d0fd tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:51:50.598743 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-c47c9cc2-057a-475d-a436-6dea4400d0fd tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040746 Oct 27 15:51:50.599205 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 677/1429] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Oct 27 15:51:50 2021] GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 15:51:51.177970 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-36b0f20b-8e02-462e-ba1d-250ec62d478a tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:51:51.178536 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-36b0f20b-8e02-462e-ba1d-250ec62d478a tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] [instance: a79303e6-05ad-4901-96b7-ce845b4016f4] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:51:51.184913 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-36b0f20b-8e02-462e-ba1d-250ec62d478a tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:51:51.185350 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-36b0f20b-8e02-462e-ba1d-250ec62d478a tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:51:51.186114 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-36b0f20b-8e02-462e-ba1d-250ec62d478a tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:51:51.186545 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-36b0f20b-8e02-462e-ba1d-250ec62d478a tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:51:51.244967 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-705f7899-9d98-439b-868e-b9697ef73fad tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:51:51.245695 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-705f7899-9d98-439b-868e-b9697ef73fad tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:51:51.252651 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-705f7899-9d98-439b-868e-b9697ef73fad tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:51:51.253854 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-705f7899-9d98-439b-868e-b9697ef73fad tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:51:51.254726 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-705f7899-9d98-439b-868e-b9697ef73fad tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:51:51.255191 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-705f7899-9d98-439b-868e-b9697ef73fad tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:51:51.255378 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-36b0f20b-8e02-462e-ba1d-250ec62d478a tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c757a383a434a4c9b1b928087af8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8818377e744d4f6ba65560705c191f0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:51:51.262940 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-36b0f20b-8e02-462e-ba1d-250ec62d478a tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] 10.222.0.64 "GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4" status: 200 len: 1226 microversion: 2.1 time: 0.088643 Oct 27 15:51:51.263517 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 753/1430] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:51:51 2021] GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4 => generated 1226 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 15:51:51.376821 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-705f7899-9d98-439b-868e-b9697ef73fad tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:51:51.384956 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-705f7899-9d98-439b-868e-b9697ef73fad tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:51:51.386450 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-705f7899-9d98-439b-868e-b9697ef73fad tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:51:51.388381 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-705f7899-9d98-439b-868e-b9697ef73fad tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672" status: 200 len: 1748 microversion: 2.20 time: 0.147240 Oct 27 15:51:51.388928 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 678/1431] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Oct 27 15:51:51 2021] GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672 => generated 1748 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 15:51:51.610190 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-02a7d139-3ce2-4103-9be1-2bbc5f18f70f tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:51:51.611400 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-02a7d139-3ce2-4103-9be1-2bbc5f18f70f tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: 62c89161-c119-48b2-839d-712db798ff96] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:51:51.617130 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-02a7d139-3ce2-4103-9be1-2bbc5f18f70f tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:51:51.617571 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-02a7d139-3ce2-4103-9be1-2bbc5f18f70f tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:51:51.618320 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-02a7d139-3ce2-4103-9be1-2bbc5f18f70f tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:51:51.618742 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-02a7d139-3ce2-4103-9be1-2bbc5f18f70f tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:51:51.649065 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-02a7d139-3ce2-4103-9be1-2bbc5f18f70f tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042881 Oct 27 15:51:51.649613 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 754/1432] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Oct 27 15:51:51 2021] GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 15:51:52.279561 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-c052f5c6-9312-4a8b-bcf7-be6dd2110286 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:51:52.280261 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-c052f5c6-9312-4a8b-bcf7-be6dd2110286 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] [instance: a79303e6-05ad-4901-96b7-ce845b4016f4] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:51:52.288933 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-c052f5c6-9312-4a8b-bcf7-be6dd2110286 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:51:52.289377 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-c052f5c6-9312-4a8b-bcf7-be6dd2110286 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:51:52.290203 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-c052f5c6-9312-4a8b-bcf7-be6dd2110286 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:51:52.290678 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-c052f5c6-9312-4a8b-bcf7-be6dd2110286 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:51:52.368526 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-c052f5c6-9312-4a8b-bcf7-be6dd2110286 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c757a383a434a4c9b1b928087af8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8818377e744d4f6ba65560705c191f0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:51:52.377807 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-c052f5c6-9312-4a8b-bcf7-be6dd2110286 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] 10.222.0.64 "GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4" status: 200 len: 1226 microversion: 2.1 time: 0.102253 Oct 27 15:51:52.378484 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 679/1433] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:51:52 2021] GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4 => generated 1226 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 15:51:52.406989 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-3c071229-690f-468b-855c-59fd7aa442fa tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:51:52.407591 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-3c071229-690f-468b-855c-59fd7aa442fa tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:51:52.413591 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-3c071229-690f-468b-855c-59fd7aa442fa tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:51:52.414039 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-3c071229-690f-468b-855c-59fd7aa442fa tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:51:52.414810 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-3c071229-690f-468b-855c-59fd7aa442fa tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:51:52.415246 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-3c071229-690f-468b-855c-59fd7aa442fa tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:51:52.554314 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-3c071229-690f-468b-855c-59fd7aa442fa tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:51:52.562960 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-3c071229-690f-468b-855c-59fd7aa442fa tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:51:52.564511 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-3c071229-690f-468b-855c-59fd7aa442fa tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:51:52.565684 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-3c071229-690f-468b-855c-59fd7aa442fa tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672" status: 200 len: 1748 microversion: 2.20 time: 0.162935 Oct 27 15:51:52.566253 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 755/1434] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Oct 27 15:51:52 2021] GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672 => generated 1748 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 15:51:52.660510 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-f2b43a36-6a27-465a-80c4-fd929efb685b tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:51:52.661431 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-f2b43a36-6a27-465a-80c4-fd929efb685b tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: 62c89161-c119-48b2-839d-712db798ff96] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:51:52.667230 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-f2b43a36-6a27-465a-80c4-fd929efb685b tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:51:52.667667 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-f2b43a36-6a27-465a-80c4-fd929efb685b tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:51:52.669604 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-f2b43a36-6a27-465a-80c4-fd929efb685b tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:51:52.670038 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-f2b43a36-6a27-465a-80c4-fd929efb685b tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:51:52.699414 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-f2b43a36-6a27-465a-80c4-fd929efb685b tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042607 Oct 27 15:51:52.700640 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 680/1435] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Oct 27 15:51:52 2021] GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 15:51:53.394856 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-cf9f94ff-2972-4d43-ae30-3257b9653f5f tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:51:53.395450 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-cf9f94ff-2972-4d43-ae30-3257b9653f5f tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] [instance: a79303e6-05ad-4901-96b7-ce845b4016f4] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:51:53.401195 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-cf9f94ff-2972-4d43-ae30-3257b9653f5f tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:51:53.401634 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-cf9f94ff-2972-4d43-ae30-3257b9653f5f tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:51:53.402383 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-cf9f94ff-2972-4d43-ae30-3257b9653f5f tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:51:53.403485 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-cf9f94ff-2972-4d43-ae30-3257b9653f5f tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:51:53.462873 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-cf9f94ff-2972-4d43-ae30-3257b9653f5f tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c757a383a434a4c9b1b928087af8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8818377e744d4f6ba65560705c191f0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:51:53.470986 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-cf9f94ff-2972-4d43-ae30-3257b9653f5f tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] 10.222.0.64 "GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4" status: 200 len: 1226 microversion: 2.1 time: 0.079870 Oct 27 15:51:53.471541 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 756/1436] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:51:53 2021] GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4 => generated 1226 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 15:51:53.584148 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-71d7df4c-e39e-417b-adca-7822f3d2c62e tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:51:53.584751 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-71d7df4c-e39e-417b-adca-7822f3d2c62e tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:51:53.591438 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-71d7df4c-e39e-417b-adca-7822f3d2c62e tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:51:53.591903 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-71d7df4c-e39e-417b-adca-7822f3d2c62e tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:51:53.592925 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-71d7df4c-e39e-417b-adca-7822f3d2c62e tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:51:53.593357 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-71d7df4c-e39e-417b-adca-7822f3d2c62e tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:51:53.710620 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-71d7df4c-e39e-417b-adca-7822f3d2c62e tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:51:53.710820 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-6facc02c-e035-41b8-b52f-a2c32df5b399 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:51:53.711744 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-6facc02c-e035-41b8-b52f-a2c32df5b399 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: 62c89161-c119-48b2-839d-712db798ff96] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:51:53.718403 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-6facc02c-e035-41b8-b52f-a2c32df5b399 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:51:53.718841 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-6facc02c-e035-41b8-b52f-a2c32df5b399 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:51:53.719613 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-6facc02c-e035-41b8-b52f-a2c32df5b399 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:51:53.719736 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-71d7df4c-e39e-417b-adca-7822f3d2c62e tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:51:53.720072 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-6facc02c-e035-41b8-b52f-a2c32df5b399 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:51:53.721259 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-71d7df4c-e39e-417b-adca-7822f3d2c62e tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:51:53.722447 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-71d7df4c-e39e-417b-adca-7822f3d2c62e tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672" status: 200 len: 1748 microversion: 2.20 time: 0.142193 Oct 27 15:51:53.723218 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 681/1437] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Oct 27 15:51:53 2021] GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672 => generated 1748 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 15:51:53.748096 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-6facc02c-e035-41b8-b52f-a2c32df5b399 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041264 Oct 27 15:51:53.748648 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 757/1438] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Oct 27 15:51:53 2021] GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 15:51:54.486748 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-1796de26-9348-469f-84a3-0461ad1ed768 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:51:54.487353 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-1796de26-9348-469f-84a3-0461ad1ed768 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] [instance: a79303e6-05ad-4901-96b7-ce845b4016f4] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:51:54.493147 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-1796de26-9348-469f-84a3-0461ad1ed768 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:51:54.493594 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-1796de26-9348-469f-84a3-0461ad1ed768 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:51:54.494353 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-1796de26-9348-469f-84a3-0461ad1ed768 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:51:54.494787 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-1796de26-9348-469f-84a3-0461ad1ed768 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:51:54.552497 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-1796de26-9348-469f-84a3-0461ad1ed768 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c757a383a434a4c9b1b928087af8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8818377e744d4f6ba65560705c191f0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:51:54.559575 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-1796de26-9348-469f-84a3-0461ad1ed768 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] 10.222.0.64 "GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4" status: 200 len: 1226 microversion: 2.1 time: 0.076512 Oct 27 15:51:54.560164 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 682/1439] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:51:54 2021] GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4 => generated 1226 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 15:51:54.739649 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-19ab0dc6-3295-4bc8-a562-6e3001c950cb tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:51:54.740283 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-19ab0dc6-3295-4bc8-a562-6e3001c950cb tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:51:54.746471 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-19ab0dc6-3295-4bc8-a562-6e3001c950cb tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:51:54.747488 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-19ab0dc6-3295-4bc8-a562-6e3001c950cb tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:51:54.748290 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-19ab0dc6-3295-4bc8-a562-6e3001c950cb tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:51:54.748721 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-19ab0dc6-3295-4bc8-a562-6e3001c950cb tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:51:54.758270 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-49be8b13-ae10-47bc-abec-4e61805009aa tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:51:54.759239 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-49be8b13-ae10-47bc-abec-4e61805009aa tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: 62c89161-c119-48b2-839d-712db798ff96] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:51:54.765336 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-49be8b13-ae10-47bc-abec-4e61805009aa tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:51:54.765771 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-49be8b13-ae10-47bc-abec-4e61805009aa tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:51:54.766522 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-49be8b13-ae10-47bc-abec-4e61805009aa tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:51:54.766952 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-49be8b13-ae10-47bc-abec-4e61805009aa tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:51:54.797553 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-49be8b13-ae10-47bc-abec-4e61805009aa tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042903 Oct 27 15:51:54.798218 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 683/1440] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Oct 27 15:51:54 2021] GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 15:51:54.892073 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-19ab0dc6-3295-4bc8-a562-6e3001c950cb tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:51:54.900507 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-19ab0dc6-3295-4bc8-a562-6e3001c950cb tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:51:54.901995 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-19ab0dc6-3295-4bc8-a562-6e3001c950cb tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:51:54.903247 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-19ab0dc6-3295-4bc8-a562-6e3001c950cb tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672" status: 200 len: 1748 microversion: 2.20 time: 0.167412 Oct 27 15:51:54.903794 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 758/1441] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Oct 27 15:51:54 2021] GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672 => generated 1748 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 15:51:55.576323 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-701ba617-adff-4b68-afd0-7accb993c4d5 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:51:55.576923 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-701ba617-adff-4b68-afd0-7accb993c4d5 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] [instance: a79303e6-05ad-4901-96b7-ce845b4016f4] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:51:55.582758 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-701ba617-adff-4b68-afd0-7accb993c4d5 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:51:55.583194 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-701ba617-adff-4b68-afd0-7accb993c4d5 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:51:55.584056 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-701ba617-adff-4b68-afd0-7accb993c4d5 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:51:55.584483 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-701ba617-adff-4b68-afd0-7accb993c4d5 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:51:55.647346 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-701ba617-adff-4b68-afd0-7accb993c4d5 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c757a383a434a4c9b1b928087af8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8818377e744d4f6ba65560705c191f0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:51:55.655643 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-701ba617-adff-4b68-afd0-7accb993c4d5 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] 10.222.0.64 "GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4" status: 200 len: 1226 microversion: 2.1 time: 0.083251 Oct 27 15:51:55.656232 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 684/1442] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:51:55 2021] GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4 => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 15:51:55.810049 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-b89f9870-cd50-4f0b-ab22-556aabf57ac4 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:51:55.810959 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-b89f9870-cd50-4f0b-ab22-556aabf57ac4 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: 62c89161-c119-48b2-839d-712db798ff96] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:51:55.817218 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-b89f9870-cd50-4f0b-ab22-556aabf57ac4 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:51:55.817660 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-b89f9870-cd50-4f0b-ab22-556aabf57ac4 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:51:55.818425 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-b89f9870-cd50-4f0b-ab22-556aabf57ac4 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:51:55.818856 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-b89f9870-cd50-4f0b-ab22-556aabf57ac4 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:51:55.848224 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-b89f9870-cd50-4f0b-ab22-556aabf57ac4 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042165 Oct 27 15:51:55.848703 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 759/1443] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Oct 27 15:51:55 2021] GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 15:51:55.921612 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-77e8870b-896f-4fda-8944-018bd1c05678 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:51:55.922229 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-77e8870b-896f-4fda-8944-018bd1c05678 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:51:55.928268 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-77e8870b-896f-4fda-8944-018bd1c05678 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:51:55.928713 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-77e8870b-896f-4fda-8944-018bd1c05678 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:51:55.929487 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-77e8870b-896f-4fda-8944-018bd1c05678 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:51:55.929967 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-77e8870b-896f-4fda-8944-018bd1c05678 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:51:56.054443 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-77e8870b-896f-4fda-8944-018bd1c05678 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:51:56.063813 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-77e8870b-896f-4fda-8944-018bd1c05678 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:51:56.065680 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-77e8870b-896f-4fda-8944-018bd1c05678 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:51:56.067066 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-77e8870b-896f-4fda-8944-018bd1c05678 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672" status: 200 len: 1748 microversion: 2.20 time: 0.149398 Oct 27 15:51:56.067745 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 685/1444] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Oct 27 15:51:55 2021] GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672 => generated 1748 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 15:51:56.672724 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-0015823e-7239-4019-b243-67339702fe9a tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:51:56.673237 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-0015823e-7239-4019-b243-67339702fe9a tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] [instance: a79303e6-05ad-4901-96b7-ce845b4016f4] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:51:56.679027 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-0015823e-7239-4019-b243-67339702fe9a tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:51:56.679463 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-0015823e-7239-4019-b243-67339702fe9a tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:51:56.680251 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-0015823e-7239-4019-b243-67339702fe9a tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:51:56.680682 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-0015823e-7239-4019-b243-67339702fe9a tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:51:56.743811 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-0015823e-7239-4019-b243-67339702fe9a tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c757a383a434a4c9b1b928087af8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8818377e744d4f6ba65560705c191f0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:51:56.752703 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-0015823e-7239-4019-b243-67339702fe9a tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] 10.222.0.64 "GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4" status: 200 len: 1226 microversion: 2.1 time: 0.083584 Oct 27 15:51:56.753869 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 760/1445] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:51:56 2021] GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4 => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 15:51:56.859637 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-adb7d4c6-f905-4c29-bdef-bdeb52547714 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:51:56.860640 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-adb7d4c6-f905-4c29-bdef-bdeb52547714 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: 62c89161-c119-48b2-839d-712db798ff96] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:51:56.867142 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-adb7d4c6-f905-4c29-bdef-bdeb52547714 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:51:56.867831 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-adb7d4c6-f905-4c29-bdef-bdeb52547714 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:51:56.870226 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-adb7d4c6-f905-4c29-bdef-bdeb52547714 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:51:56.870676 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-adb7d4c6-f905-4c29-bdef-bdeb52547714 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:51:56.901199 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-adb7d4c6-f905-4c29-bdef-bdeb52547714 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045479 Oct 27 15:51:56.901788 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 686/1446] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Oct 27 15:51:56 2021] GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 15:51:57.087905 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-55963020-30c0-492a-8fef-ee36385445e9 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:51:57.088488 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-55963020-30c0-492a-8fef-ee36385445e9 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:51:57.095243 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-55963020-30c0-492a-8fef-ee36385445e9 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:51:57.095701 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-55963020-30c0-492a-8fef-ee36385445e9 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:51:57.096490 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-55963020-30c0-492a-8fef-ee36385445e9 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:51:57.096917 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-55963020-30c0-492a-8fef-ee36385445e9 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:51:57.221236 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-55963020-30c0-492a-8fef-ee36385445e9 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:51:57.231612 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-55963020-30c0-492a-8fef-ee36385445e9 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:51:57.233130 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-55963020-30c0-492a-8fef-ee36385445e9 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:51:57.234491 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-55963020-30c0-492a-8fef-ee36385445e9 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672" status: 200 len: 1748 microversion: 2.20 time: 0.150517 Oct 27 15:51:57.236082 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 761/1447] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Oct 27 15:51:57 2021] GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672 => generated 1748 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 15:51:57.770387 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-e2652e1e-89f9-4aba-963d-5a22f4d2a97e tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:51:57.770991 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-e2652e1e-89f9-4aba-963d-5a22f4d2a97e tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] [instance: a79303e6-05ad-4901-96b7-ce845b4016f4] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:51:57.778608 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-e2652e1e-89f9-4aba-963d-5a22f4d2a97e tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:51:57.779050 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-e2652e1e-89f9-4aba-963d-5a22f4d2a97e tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:51:57.779811 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-e2652e1e-89f9-4aba-963d-5a22f4d2a97e tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:51:57.780269 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-e2652e1e-89f9-4aba-963d-5a22f4d2a97e tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:51:57.843338 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-e2652e1e-89f9-4aba-963d-5a22f4d2a97e tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c757a383a434a4c9b1b928087af8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8818377e744d4f6ba65560705c191f0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:51:57.852012 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-e2652e1e-89f9-4aba-963d-5a22f4d2a97e tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] 10.222.0.64 "GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4" status: 200 len: 1226 microversion: 2.1 time: 0.085548 Oct 27 15:51:57.852617 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 687/1448] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:51:57 2021] GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4 => generated 1226 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 15:51:57.913510 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-0478653e-0f6c-45bf-ab2c-c19c61f06fc7 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:51:57.914407 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-0478653e-0f6c-45bf-ab2c-c19c61f06fc7 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: 62c89161-c119-48b2-839d-712db798ff96] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:51:57.920916 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-0478653e-0f6c-45bf-ab2c-c19c61f06fc7 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:51:57.921358 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-0478653e-0f6c-45bf-ab2c-c19c61f06fc7 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:51:57.922118 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-0478653e-0f6c-45bf-ab2c-c19c61f06fc7 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:51:57.922540 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-0478653e-0f6c-45bf-ab2c-c19c61f06fc7 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:51:57.967399 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-0478653e-0f6c-45bf-ab2c-c19c61f06fc7 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057455 Oct 27 15:51:57.967962 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 762/1449] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Oct 27 15:51:57 2021] GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 15:51:58.253388 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-96714986-0ed7-4468-9d15-50fa351fa94d tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:51:58.253993 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-96714986-0ed7-4468-9d15-50fa351fa94d tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:51:58.260247 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-96714986-0ed7-4468-9d15-50fa351fa94d tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:51:58.260691 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-96714986-0ed7-4468-9d15-50fa351fa94d tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:51:58.261449 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-96714986-0ed7-4468-9d15-50fa351fa94d tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:51:58.261883 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-96714986-0ed7-4468-9d15-50fa351fa94d tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:51:58.382381 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-96714986-0ed7-4468-9d15-50fa351fa94d tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:51:58.391203 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-96714986-0ed7-4468-9d15-50fa351fa94d tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:51:58.392719 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-96714986-0ed7-4468-9d15-50fa351fa94d tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:51:58.393871 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-96714986-0ed7-4468-9d15-50fa351fa94d tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672" status: 200 len: 1748 microversion: 2.20 time: 0.144208 Oct 27 15:51:58.394421 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 688/1450] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Oct 27 15:51:58 2021] GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672 => generated 1748 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 15:51:58.869964 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-971f4ce3-1d96-4038-9baa-29be3efca72f tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:51:58.870838 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-971f4ce3-1d96-4038-9baa-29be3efca72f tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] [instance: a79303e6-05ad-4901-96b7-ce845b4016f4] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:51:58.878653 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-971f4ce3-1d96-4038-9baa-29be3efca72f tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:51:58.879259 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-971f4ce3-1d96-4038-9baa-29be3efca72f tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:51:58.880437 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-971f4ce3-1d96-4038-9baa-29be3efca72f tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:51:58.881077 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-971f4ce3-1d96-4038-9baa-29be3efca72f tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:51:58.957146 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-971f4ce3-1d96-4038-9baa-29be3efca72f tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c757a383a434a4c9b1b928087af8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8818377e744d4f6ba65560705c191f0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:51:58.964577 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-971f4ce3-1d96-4038-9baa-29be3efca72f tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] 10.222.0.64 "GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4" status: 200 len: 1226 microversion: 2.1 time: 0.099165 Oct 27 15:51:58.965831 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 763/1451] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:51:58 2021] GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4 => generated 1226 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 15:51:58.979525 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-b0047d99-34e2-4cf5-be57-d9af7a8dd2f7 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:51:58.980470 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-b0047d99-34e2-4cf5-be57-d9af7a8dd2f7 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: 62c89161-c119-48b2-839d-712db798ff96] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:51:58.986223 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-b0047d99-34e2-4cf5-be57-d9af7a8dd2f7 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:51:58.986669 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-b0047d99-34e2-4cf5-be57-d9af7a8dd2f7 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:51:58.987437 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-b0047d99-34e2-4cf5-be57-d9af7a8dd2f7 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:51:58.987892 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-b0047d99-34e2-4cf5-be57-d9af7a8dd2f7 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:51:59.017160 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-b0047d99-34e2-4cf5-be57-d9af7a8dd2f7 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042554 Oct 27 15:51:59.017713 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 689/1452] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Oct 27 15:51:58 2021] GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 15:51:59.412716 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-9da1eeed-04bc-445f-bf5c-53b8f6f06bec tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:51:59.413314 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-9da1eeed-04bc-445f-bf5c-53b8f6f06bec tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:51:59.419462 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-9da1eeed-04bc-445f-bf5c-53b8f6f06bec tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:51:59.419928 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-9da1eeed-04bc-445f-bf5c-53b8f6f06bec tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:51:59.420686 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-9da1eeed-04bc-445f-bf5c-53b8f6f06bec tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:51:59.421112 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-9da1eeed-04bc-445f-bf5c-53b8f6f06bec tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:51:59.542093 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-9da1eeed-04bc-445f-bf5c-53b8f6f06bec tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:51:59.550586 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-9da1eeed-04bc-445f-bf5c-53b8f6f06bec tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:51:59.552100 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-9da1eeed-04bc-445f-bf5c-53b8f6f06bec tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:51:59.553245 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-9da1eeed-04bc-445f-bf5c-53b8f6f06bec tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672" status: 200 len: 1748 microversion: 2.20 time: 0.144320 Oct 27 15:51:59.553805 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 764/1453] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Oct 27 15:51:59 2021] GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672 => generated 1748 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 15:51:59.981962 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-37a3dafa-6a49-412f-93f1-61897cee0b3e tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:51:59.982568 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-37a3dafa-6a49-412f-93f1-61897cee0b3e tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] [instance: a79303e6-05ad-4901-96b7-ce845b4016f4] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:51:59.988770 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-37a3dafa-6a49-412f-93f1-61897cee0b3e tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:51:59.989212 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-37a3dafa-6a49-412f-93f1-61897cee0b3e tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:51:59.989966 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-37a3dafa-6a49-412f-93f1-61897cee0b3e tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:51:59.990393 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-37a3dafa-6a49-412f-93f1-61897cee0b3e tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:52:00.028146 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-05652772-4890-4663-9f45-63d42bd4b478 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:52:00.029046 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-05652772-4890-4663-9f45-63d42bd4b478 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: 62c89161-c119-48b2-839d-712db798ff96] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:52:00.035359 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-05652772-4890-4663-9f45-63d42bd4b478 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:52:00.035801 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-05652772-4890-4663-9f45-63d42bd4b478 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:52:00.036673 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-05652772-4890-4663-9f45-63d42bd4b478 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:52:00.037098 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-05652772-4890-4663-9f45-63d42bd4b478 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:52:00.054039 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-37a3dafa-6a49-412f-93f1-61897cee0b3e tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c757a383a434a4c9b1b928087af8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8818377e744d4f6ba65560705c191f0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:52:00.061862 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-37a3dafa-6a49-412f-93f1-61897cee0b3e tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] 10.222.0.64 "GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4" status: 200 len: 1226 microversion: 2.1 time: 0.083738 Oct 27 15:52:00.062420 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 690/1454] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:51:59 2021] GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4 => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 15:52:00.066409 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-05652772-4890-4663-9f45-63d42bd4b478 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041970 Oct 27 15:52:00.066957 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 765/1455] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Oct 27 15:52:00 2021] GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 15:52:00.572042 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-b0a0e2f6-53c1-4ae5-8bab-899e3bfd2db0 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:52:00.572637 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-b0a0e2f6-53c1-4ae5-8bab-899e3bfd2db0 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:52:00.579317 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-b0a0e2f6-53c1-4ae5-8bab-899e3bfd2db0 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:52:00.579751 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-b0a0e2f6-53c1-4ae5-8bab-899e3bfd2db0 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:52:00.580531 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-b0a0e2f6-53c1-4ae5-8bab-899e3bfd2db0 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:52:00.580959 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-b0a0e2f6-53c1-4ae5-8bab-899e3bfd2db0 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:52:00.700925 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-b0a0e2f6-53c1-4ae5-8bab-899e3bfd2db0 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:52:00.709036 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-b0a0e2f6-53c1-4ae5-8bab-899e3bfd2db0 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:52:00.710550 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-b0a0e2f6-53c1-4ae5-8bab-899e3bfd2db0 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:52:00.711680 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-b0a0e2f6-53c1-4ae5-8bab-899e3bfd2db0 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672" status: 200 len: 1748 microversion: 2.20 time: 0.143352 Oct 27 15:52:00.712270 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 691/1456] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Oct 27 15:52:00 2021] GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672 => generated 1748 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 15:52:01.077687 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-07ee99e1-3bfb-4210-b796-7b1cc7b2fcc3 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:52:01.078330 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-41ba3bd1-d4af-4d38-9706-0cd5b9b37ad4 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:52:01.078744 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-07ee99e1-3bfb-4210-b796-7b1cc7b2fcc3 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] [instance: a79303e6-05ad-4901-96b7-ce845b4016f4] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:52:01.079023 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-41ba3bd1-d4af-4d38-9706-0cd5b9b37ad4 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: 62c89161-c119-48b2-839d-712db798ff96] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:52:01.085268 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-07ee99e1-3bfb-4210-b796-7b1cc7b2fcc3 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:52:01.085634 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-41ba3bd1-d4af-4d38-9706-0cd5b9b37ad4 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:52:01.085785 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-07ee99e1-3bfb-4210-b796-7b1cc7b2fcc3 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:52:01.086076 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-41ba3bd1-d4af-4d38-9706-0cd5b9b37ad4 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:52:01.086453 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-07ee99e1-3bfb-4210-b796-7b1cc7b2fcc3 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:52:01.086832 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-41ba3bd1-d4af-4d38-9706-0cd5b9b37ad4 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:52:01.086937 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-07ee99e1-3bfb-4210-b796-7b1cc7b2fcc3 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:52:01.087260 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-41ba3bd1-d4af-4d38-9706-0cd5b9b37ad4 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:52:01.116136 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-41ba3bd1-d4af-4d38-9706-0cd5b9b37ad4 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042124 Oct 27 15:52:01.116701 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 766/1457] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Oct 27 15:52:01 2021] GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 15:52:01.147165 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-07ee99e1-3bfb-4210-b796-7b1cc7b2fcc3 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c757a383a434a4c9b1b928087af8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8818377e744d4f6ba65560705c191f0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:52:01.154579 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-07ee99e1-3bfb-4210-b796-7b1cc7b2fcc3 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] 10.222.0.64 "GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4" status: 200 len: 1226 microversion: 2.1 time: 0.080515 Oct 27 15:52:01.155134 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 692/1458] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:52:01 2021] GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4 => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 15:52:01.730324 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-63c167bb-a455-4d00-a758-3740cb988835 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:52:01.731576 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-63c167bb-a455-4d00-a758-3740cb988835 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:52:01.737381 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-63c167bb-a455-4d00-a758-3740cb988835 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:52:01.737815 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-63c167bb-a455-4d00-a758-3740cb988835 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:52:01.738563 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-63c167bb-a455-4d00-a758-3740cb988835 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:52:01.738992 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-63c167bb-a455-4d00-a758-3740cb988835 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:52:01.858687 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-63c167bb-a455-4d00-a758-3740cb988835 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:52:01.866868 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-63c167bb-a455-4d00-a758-3740cb988835 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:52:01.868363 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-63c167bb-a455-4d00-a758-3740cb988835 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:52:01.869543 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-63c167bb-a455-4d00-a758-3740cb988835 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672" status: 200 len: 1748 microversion: 2.20 time: 0.142955 Oct 27 15:52:01.870094 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 767/1459] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Oct 27 15:52:01 2021] GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672 => generated 1748 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 15:52:02.128217 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-09a4594c-91ad-426a-a5af-f99c1c5c3322 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:52:02.129036 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-09a4594c-91ad-426a-a5af-f99c1c5c3322 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: 62c89161-c119-48b2-839d-712db798ff96] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:52:02.135141 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-09a4594c-91ad-426a-a5af-f99c1c5c3322 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:52:02.135580 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-09a4594c-91ad-426a-a5af-f99c1c5c3322 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:52:02.136377 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-09a4594c-91ad-426a-a5af-f99c1c5c3322 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:52:02.136807 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-09a4594c-91ad-426a-a5af-f99c1c5c3322 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:52:02.165070 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-09a4594c-91ad-426a-a5af-f99c1c5c3322 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040704 Oct 27 15:52:02.165628 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 693/1460] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Oct 27 15:52:02 2021] GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 15:52:02.171013 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-e4281aa4-57c6-4d1d-83d2-26b778e1f747 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:52:02.171619 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-e4281aa4-57c6-4d1d-83d2-26b778e1f747 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] [instance: a79303e6-05ad-4901-96b7-ce845b4016f4] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:52:02.177764 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-e4281aa4-57c6-4d1d-83d2-26b778e1f747 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:52:02.178209 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-e4281aa4-57c6-4d1d-83d2-26b778e1f747 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:52:02.178971 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-e4281aa4-57c6-4d1d-83d2-26b778e1f747 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:52:02.179404 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-e4281aa4-57c6-4d1d-83d2-26b778e1f747 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:52:02.238057 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-e4281aa4-57c6-4d1d-83d2-26b778e1f747 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c757a383a434a4c9b1b928087af8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8818377e744d4f6ba65560705c191f0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:52:02.245211 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-e4281aa4-57c6-4d1d-83d2-26b778e1f747 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] 10.222.0.64 "GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4" status: 200 len: 1226 microversion: 2.1 time: 0.078528 Oct 27 15:52:02.245777 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 768/1461] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:52:02 2021] GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4 => generated 1226 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 15:52:02.889646 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-7ffafeff-fb16-4ea7-a173-5cf43acdb8f5 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:52:02.890270 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-7ffafeff-fb16-4ea7-a173-5cf43acdb8f5 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:52:02.896107 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-7ffafeff-fb16-4ea7-a173-5cf43acdb8f5 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:52:02.896544 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-7ffafeff-fb16-4ea7-a173-5cf43acdb8f5 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:52:02.897297 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-7ffafeff-fb16-4ea7-a173-5cf43acdb8f5 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:52:02.897724 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-7ffafeff-fb16-4ea7-a173-5cf43acdb8f5 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:52:03.021427 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-7ffafeff-fb16-4ea7-a173-5cf43acdb8f5 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:52:03.029578 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-7ffafeff-fb16-4ea7-a173-5cf43acdb8f5 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:52:03.031093 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-7ffafeff-fb16-4ea7-a173-5cf43acdb8f5 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:52:03.032274 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-7ffafeff-fb16-4ea7-a173-5cf43acdb8f5 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672" status: 200 len: 1748 microversion: 2.20 time: 0.147364 Oct 27 15:52:03.032835 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 694/1462] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Oct 27 15:52:02 2021] GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672 => generated 1748 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 15:52:03.176614 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-57af466d-b520-40e6-af4c-da48211b311c tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:52:03.177481 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-57af466d-b520-40e6-af4c-da48211b311c tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: 62c89161-c119-48b2-839d-712db798ff96] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:52:03.183651 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-57af466d-b520-40e6-af4c-da48211b311c tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:52:03.184627 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-57af466d-b520-40e6-af4c-da48211b311c tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:52:03.185392 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-57af466d-b520-40e6-af4c-da48211b311c tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:52:03.185822 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-57af466d-b520-40e6-af4c-da48211b311c tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:52:03.214289 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-57af466d-b520-40e6-af4c-da48211b311c tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041472 Oct 27 15:52:03.214865 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 769/1463] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Oct 27 15:52:03 2021] GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 15:52:03.262218 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-31659320-6bde-4688-a344-8904bab0925c tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:52:03.263416 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-31659320-6bde-4688-a344-8904bab0925c tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] [instance: a79303e6-05ad-4901-96b7-ce845b4016f4] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:52:03.269708 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-31659320-6bde-4688-a344-8904bab0925c tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:52:03.270142 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-31659320-6bde-4688-a344-8904bab0925c tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:52:03.270895 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-31659320-6bde-4688-a344-8904bab0925c tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:52:03.271322 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-31659320-6bde-4688-a344-8904bab0925c tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:52:03.330645 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-31659320-6bde-4688-a344-8904bab0925c tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c757a383a434a4c9b1b928087af8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8818377e744d4f6ba65560705c191f0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:52:03.337976 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-31659320-6bde-4688-a344-8904bab0925c tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] 10.222.0.64 "GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4" status: 200 len: 1226 microversion: 2.1 time: 0.079506 Oct 27 15:52:03.338539 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 695/1464] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:52:03 2021] GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4 => generated 1226 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 15:52:04.050314 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-f7ad951c-60f2-4acb-8226-71f91bd867e0 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:52:04.050924 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-f7ad951c-60f2-4acb-8226-71f91bd867e0 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:52:04.056723 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-f7ad951c-60f2-4acb-8226-71f91bd867e0 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:52:04.057173 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-f7ad951c-60f2-4acb-8226-71f91bd867e0 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:52:04.057937 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-f7ad951c-60f2-4acb-8226-71f91bd867e0 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:52:04.058372 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-f7ad951c-60f2-4acb-8226-71f91bd867e0 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:52:04.182157 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-f7ad951c-60f2-4acb-8226-71f91bd867e0 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:52:04.190727 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-f7ad951c-60f2-4acb-8226-71f91bd867e0 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:52:04.192240 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-f7ad951c-60f2-4acb-8226-71f91bd867e0 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:52:04.193392 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-f7ad951c-60f2-4acb-8226-71f91bd867e0 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672" status: 200 len: 1748 microversion: 2.20 time: 0.146909 Oct 27 15:52:04.194143 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 770/1465] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Oct 27 15:52:04 2021] GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672 => generated 1748 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 15:52:04.226509 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-fbad1152-c5f7-4974-9f27-dfe88f4d31f9 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:52:04.227430 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-fbad1152-c5f7-4974-9f27-dfe88f4d31f9 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: 62c89161-c119-48b2-839d-712db798ff96] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:52:04.233397 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-fbad1152-c5f7-4974-9f27-dfe88f4d31f9 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:52:04.233832 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-fbad1152-c5f7-4974-9f27-dfe88f4d31f9 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:52:04.234582 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-fbad1152-c5f7-4974-9f27-dfe88f4d31f9 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:52:04.235030 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-fbad1152-c5f7-4974-9f27-dfe88f4d31f9 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:52:04.263363 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-fbad1152-c5f7-4974-9f27-dfe88f4d31f9 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039741 Oct 27 15:52:04.264029 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 696/1466] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Oct 27 15:52:04 2021] GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 15:52:04.354289 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-08482cbb-d7e7-46f7-867a-b1cfb923fce3 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:52:04.354887 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-08482cbb-d7e7-46f7-867a-b1cfb923fce3 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] [instance: a79303e6-05ad-4901-96b7-ce845b4016f4] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:52:04.360778 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-08482cbb-d7e7-46f7-867a-b1cfb923fce3 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:52:04.361210 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-08482cbb-d7e7-46f7-867a-b1cfb923fce3 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:52:04.361967 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-08482cbb-d7e7-46f7-867a-b1cfb923fce3 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:52:04.362391 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-08482cbb-d7e7-46f7-867a-b1cfb923fce3 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:52:04.422540 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-08482cbb-d7e7-46f7-867a-b1cfb923fce3 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c757a383a434a4c9b1b928087af8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8818377e744d4f6ba65560705c191f0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:52:04.431574 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-08482cbb-d7e7-46f7-867a-b1cfb923fce3 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] 10.222.0.64 "GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4" status: 200 len: 1226 microversion: 2.1 time: 0.080945 Oct 27 15:52:04.432201 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 771/1467] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:52:04 2021] GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4 => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 15:52:05.212561 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-4f897adf-57e2-4303-80f1-3c17700e3937 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:52:05.213163 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-4f897adf-57e2-4303-80f1-3c17700e3937 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:52:05.220287 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-4f897adf-57e2-4303-80f1-3c17700e3937 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:52:05.220727 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-4f897adf-57e2-4303-80f1-3c17700e3937 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:52:05.221507 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-4f897adf-57e2-4303-80f1-3c17700e3937 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:52:05.222019 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-4f897adf-57e2-4303-80f1-3c17700e3937 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:52:05.274488 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-18c0b3d2-d0a7-428e-9a32-130745792bd4 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:52:05.275389 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-18c0b3d2-d0a7-428e-9a32-130745792bd4 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: 62c89161-c119-48b2-839d-712db798ff96] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:52:05.281782 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-18c0b3d2-d0a7-428e-9a32-130745792bd4 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:52:05.282230 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-18c0b3d2-d0a7-428e-9a32-130745792bd4 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:52:05.282998 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-18c0b3d2-d0a7-428e-9a32-130745792bd4 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:52:05.283431 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-18c0b3d2-d0a7-428e-9a32-130745792bd4 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:52:05.313266 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-18c0b3d2-d0a7-428e-9a32-130745792bd4 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042517 Oct 27 15:52:05.313850 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 772/1468] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Oct 27 15:52:05 2021] GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 15:52:05.345828 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-4f897adf-57e2-4303-80f1-3c17700e3937 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:52:05.353846 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-4f897adf-57e2-4303-80f1-3c17700e3937 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:52:05.355321 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-4f897adf-57e2-4303-80f1-3c17700e3937 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:52:05.356619 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-4f897adf-57e2-4303-80f1-3c17700e3937 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672" status: 200 len: 1748 microversion: 2.20 time: 0.147841 Oct 27 15:52:05.357166 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 697/1469] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Oct 27 15:52:05 2021] GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672 => generated 1748 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 15:52:05.448178 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-bb365eac-160a-48ee-9406-ecb087463110 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:52:05.448813 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-bb365eac-160a-48ee-9406-ecb087463110 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] [instance: a79303e6-05ad-4901-96b7-ce845b4016f4] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:52:05.455159 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-bb365eac-160a-48ee-9406-ecb087463110 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:52:05.455609 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-bb365eac-160a-48ee-9406-ecb087463110 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:52:05.456412 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-bb365eac-160a-48ee-9406-ecb087463110 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:52:05.456844 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-bb365eac-160a-48ee-9406-ecb087463110 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:52:05.515064 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-bb365eac-160a-48ee-9406-ecb087463110 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c757a383a434a4c9b1b928087af8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8818377e744d4f6ba65560705c191f0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:52:05.522248 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-bb365eac-160a-48ee-9406-ecb087463110 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] 10.222.0.64 "GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4" status: 200 len: 1226 microversion: 2.1 time: 0.077740 Oct 27 15:52:05.522810 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 773/1470] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:52:05 2021] GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4 => generated 1226 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 15:52:06.324128 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-1c9fa456-fcce-40e0-856c-38d7b20056d6 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:52:06.325651 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-1c9fa456-fcce-40e0-856c-38d7b20056d6 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: 62c89161-c119-48b2-839d-712db798ff96] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:52:06.331763 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-1c9fa456-fcce-40e0-856c-38d7b20056d6 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:52:06.332229 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-1c9fa456-fcce-40e0-856c-38d7b20056d6 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:52:06.332989 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-1c9fa456-fcce-40e0-856c-38d7b20056d6 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:52:06.333410 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-1c9fa456-fcce-40e0-856c-38d7b20056d6 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:52:06.363502 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-1c9fa456-fcce-40e0-856c-38d7b20056d6 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043119 Oct 27 15:52:06.364153 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 698/1471] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Oct 27 15:52:06 2021] GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 15:52:06.374220 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-6b6fe7c9-d95b-441f-acca-7d36bd34928e tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:52:06.374926 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-6b6fe7c9-d95b-441f-acca-7d36bd34928e tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:52:06.381197 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-6b6fe7c9-d95b-441f-acca-7d36bd34928e tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:52:06.381642 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-6b6fe7c9-d95b-441f-acca-7d36bd34928e tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:52:06.382442 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-6b6fe7c9-d95b-441f-acca-7d36bd34928e tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:52:06.382878 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-6b6fe7c9-d95b-441f-acca-7d36bd34928e tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:52:06.509456 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-6b6fe7c9-d95b-441f-acca-7d36bd34928e tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:52:06.518233 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-6b6fe7c9-d95b-441f-acca-7d36bd34928e tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:52:06.519718 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-6b6fe7c9-d95b-441f-acca-7d36bd34928e tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:52:06.520890 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-6b6fe7c9-d95b-441f-acca-7d36bd34928e tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672" status: 200 len: 1748 microversion: 2.20 time: 0.150496 Oct 27 15:52:06.521446 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 774/1472] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Oct 27 15:52:06 2021] GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672 => generated 1748 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 15:52:06.538211 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-d178d776-0b6c-473c-82a0-4eecc39b7ea8 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:52:06.538819 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-d178d776-0b6c-473c-82a0-4eecc39b7ea8 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] [instance: a79303e6-05ad-4901-96b7-ce845b4016f4] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:52:06.545108 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-d178d776-0b6c-473c-82a0-4eecc39b7ea8 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:52:06.545549 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-d178d776-0b6c-473c-82a0-4eecc39b7ea8 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:52:06.546308 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-d178d776-0b6c-473c-82a0-4eecc39b7ea8 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:52:06.546740 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-d178d776-0b6c-473c-82a0-4eecc39b7ea8 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:52:06.606463 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-d178d776-0b6c-473c-82a0-4eecc39b7ea8 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c757a383a434a4c9b1b928087af8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8818377e744d4f6ba65560705c191f0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:52:06.613564 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-d178d776-0b6c-473c-82a0-4eecc39b7ea8 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] 10.222.0.64 "GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4" status: 200 len: 1226 microversion: 2.1 time: 0.079084 Oct 27 15:52:06.614124 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 699/1473] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:52:06 2021] GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4 => generated 1226 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 15:52:07.374657 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-a9e1bae1-d04e-47f8-b086-19a8b175f939 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:52:07.375593 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-a9e1bae1-d04e-47f8-b086-19a8b175f939 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: 62c89161-c119-48b2-839d-712db798ff96] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:52:07.381785 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-a9e1bae1-d04e-47f8-b086-19a8b175f939 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:52:07.382231 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-a9e1bae1-d04e-47f8-b086-19a8b175f939 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:52:07.382992 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-a9e1bae1-d04e-47f8-b086-19a8b175f939 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:52:07.383425 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-a9e1bae1-d04e-47f8-b086-19a8b175f939 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:52:07.412623 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-a9e1bae1-d04e-47f8-b086-19a8b175f939 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041899 Oct 27 15:52:07.413179 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 775/1474] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Oct 27 15:52:07 2021] GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 15:52:07.630558 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-9df5eb1e-4596-4a44-af35-6ba5390f6fb9 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:52:07.631118 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-9df5eb1e-4596-4a44-af35-6ba5390f6fb9 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] [instance: a79303e6-05ad-4901-96b7-ce845b4016f4] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:52:07.637209 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-9df5eb1e-4596-4a44-af35-6ba5390f6fb9 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:52:07.637640 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-9df5eb1e-4596-4a44-af35-6ba5390f6fb9 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:52:07.638390 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-9df5eb1e-4596-4a44-af35-6ba5390f6fb9 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:52:07.638961 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-9df5eb1e-4596-4a44-af35-6ba5390f6fb9 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:52:07.700869 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-9df5eb1e-4596-4a44-af35-6ba5390f6fb9 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c757a383a434a4c9b1b928087af8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8818377e744d4f6ba65560705c191f0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:52:07.709186 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-9df5eb1e-4596-4a44-af35-6ba5390f6fb9 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] 10.222.0.64 "GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4" status: 200 len: 1226 microversion: 2.1 time: 0.082493 Oct 27 15:52:07.709736 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 700/1475] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:52:07 2021] GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4 => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 15:52:08.424627 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-087fea0a-71b8-41a7-962f-d6bd6cdd14f0 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:52:08.425526 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-087fea0a-71b8-41a7-962f-d6bd6cdd14f0 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: 62c89161-c119-48b2-839d-712db798ff96] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:52:08.431655 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-087fea0a-71b8-41a7-962f-d6bd6cdd14f0 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:52:08.432155 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-087fea0a-71b8-41a7-962f-d6bd6cdd14f0 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:52:08.432890 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-087fea0a-71b8-41a7-962f-d6bd6cdd14f0 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:52:08.433322 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-087fea0a-71b8-41a7-962f-d6bd6cdd14f0 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:52:08.470312 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-087fea0a-71b8-41a7-962f-d6bd6cdd14f0 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050140 Oct 27 15:52:08.470875 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 776/1476] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Oct 27 15:52:08 2021] GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 15:52:08.725683 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-e4becf1e-3836-4d17-9fdf-f935e0c3d424 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:52:08.726307 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-e4becf1e-3836-4d17-9fdf-f935e0c3d424 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] [instance: a79303e6-05ad-4901-96b7-ce845b4016f4] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:52:08.732394 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-e4becf1e-3836-4d17-9fdf-f935e0c3d424 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:52:08.733391 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-e4becf1e-3836-4d17-9fdf-f935e0c3d424 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:52:08.734166 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-e4becf1e-3836-4d17-9fdf-f935e0c3d424 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:52:08.734579 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-e4becf1e-3836-4d17-9fdf-f935e0c3d424 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:52:08.792952 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-e4becf1e-3836-4d17-9fdf-f935e0c3d424 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c757a383a434a4c9b1b928087af8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8818377e744d4f6ba65560705c191f0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:52:08.800106 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-e4becf1e-3836-4d17-9fdf-f935e0c3d424 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] 10.222.0.64 "GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4" status: 200 len: 1226 microversion: 2.1 time: 0.078048 Oct 27 15:52:08.800668 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 701/1477] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:52:08 2021] GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4 => generated 1226 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 15:52:09.482000 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-52fe6a62-6323-425e-b031-e7f92f691f00 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:52:09.483437 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-52fe6a62-6323-425e-b031-e7f92f691f00 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: 62c89161-c119-48b2-839d-712db798ff96] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:52:09.489766 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-52fe6a62-6323-425e-b031-e7f92f691f00 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:52:09.490211 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-52fe6a62-6323-425e-b031-e7f92f691f00 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:52:09.491003 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-52fe6a62-6323-425e-b031-e7f92f691f00 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:52:09.491435 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-52fe6a62-6323-425e-b031-e7f92f691f00 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:52:09.519613 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-52fe6a62-6323-425e-b031-e7f92f691f00 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041439 Oct 27 15:52:09.520187 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 777/1478] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Oct 27 15:52:09 2021] GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 15:52:09.816469 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-71457ed2-b0b1-4468-8215-4125733bb63d tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:52:09.817016 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-71457ed2-b0b1-4468-8215-4125733bb63d tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] [instance: a79303e6-05ad-4901-96b7-ce845b4016f4] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:52:09.823344 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-71457ed2-b0b1-4468-8215-4125733bb63d tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:52:09.823781 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-71457ed2-b0b1-4468-8215-4125733bb63d tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:52:09.824554 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-71457ed2-b0b1-4468-8215-4125733bb63d tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:52:09.824977 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-71457ed2-b0b1-4468-8215-4125733bb63d tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:52:09.884189 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-71457ed2-b0b1-4468-8215-4125733bb63d tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c757a383a434a4c9b1b928087af8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8818377e744d4f6ba65560705c191f0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:52:09.892021 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-71457ed2-b0b1-4468-8215-4125733bb63d tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] 10.222.0.64 "GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4" status: 200 len: 1226 microversion: 2.1 time: 0.079233 Oct 27 15:52:09.892599 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 702/1479] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:52:09 2021] GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4 => generated 1226 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 15:52:10.531460 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-500a2184-88ed-4f76-85b4-fb5d75913de3 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:52:10.532420 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-500a2184-88ed-4f76-85b4-fb5d75913de3 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: 62c89161-c119-48b2-839d-712db798ff96] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:52:10.538777 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-500a2184-88ed-4f76-85b4-fb5d75913de3 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:52:10.539219 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-500a2184-88ed-4f76-85b4-fb5d75913de3 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:52:10.540021 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-500a2184-88ed-4f76-85b4-fb5d75913de3 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:52:10.540459 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-500a2184-88ed-4f76-85b4-fb5d75913de3 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:52:10.570957 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-500a2184-88ed-4f76-85b4-fb5d75913de3 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043493 Oct 27 15:52:10.571539 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 778/1480] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Oct 27 15:52:10 2021] GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 15:52:10.908526 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-6a9d9fc5-99c8-4afd-804a-5539c13b6cff tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:52:10.909140 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-6a9d9fc5-99c8-4afd-804a-5539c13b6cff tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] [instance: a79303e6-05ad-4901-96b7-ce845b4016f4] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:52:10.915436 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-6a9d9fc5-99c8-4afd-804a-5539c13b6cff tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:52:10.915933 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-6a9d9fc5-99c8-4afd-804a-5539c13b6cff tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:52:10.916718 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-6a9d9fc5-99c8-4afd-804a-5539c13b6cff tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:52:10.917151 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-6a9d9fc5-99c8-4afd-804a-5539c13b6cff tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:52:10.976198 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-6a9d9fc5-99c8-4afd-804a-5539c13b6cff tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c757a383a434a4c9b1b928087af8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8818377e744d4f6ba65560705c191f0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:52:10.983560 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-6a9d9fc5-99c8-4afd-804a-5539c13b6cff tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] 10.222.0.64 "GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4" status: 200 len: 1226 microversion: 2.1 time: 0.078714 Oct 27 15:52:10.984707 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 703/1481] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:52:10 2021] GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4 => generated 1226 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 15:52:11.583374 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-863ebd05-3aac-4e56-84ec-94998fcad5f6 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:52:11.584287 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-863ebd05-3aac-4e56-84ec-94998fcad5f6 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: 62c89161-c119-48b2-839d-712db798ff96] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:52:11.590596 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-863ebd05-3aac-4e56-84ec-94998fcad5f6 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:52:11.591032 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-863ebd05-3aac-4e56-84ec-94998fcad5f6 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:52:11.591778 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-863ebd05-3aac-4e56-84ec-94998fcad5f6 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:52:11.592475 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-863ebd05-3aac-4e56-84ec-94998fcad5f6 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:52:11.622271 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-863ebd05-3aac-4e56-84ec-94998fcad5f6 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042692 Oct 27 15:52:11.622820 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 779/1482] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Oct 27 15:52:11 2021] GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 15:52:12.001642 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-f4067341-b36d-4ee6-9910-94cc3692ff6b tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:52:12.002240 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-f4067341-b36d-4ee6-9910-94cc3692ff6b tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] [instance: a79303e6-05ad-4901-96b7-ce845b4016f4] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:52:12.008450 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-f4067341-b36d-4ee6-9910-94cc3692ff6b tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:52:12.008895 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-f4067341-b36d-4ee6-9910-94cc3692ff6b tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:52:12.009654 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-f4067341-b36d-4ee6-9910-94cc3692ff6b tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:52:12.010086 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-f4067341-b36d-4ee6-9910-94cc3692ff6b tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:52:12.077078 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-f4067341-b36d-4ee6-9910-94cc3692ff6b tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c757a383a434a4c9b1b928087af8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8818377e744d4f6ba65560705c191f0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:52:12.085217 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-f4067341-b36d-4ee6-9910-94cc3692ff6b tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] 10.222.0.64 "GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4" status: 200 len: 1226 microversion: 2.1 time: 0.087675 Oct 27 15:52:12.085943 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 704/1483] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:52:11 2021] GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4 => generated 1226 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 15:52:12.111939 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-316304fe-1ae8-44dd-a09a-66aba165ba92 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:52:12.112433 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-316304fe-1ae8-44dd-a09a-66aba165ba92 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] [instance: 013da7c4-ac69-4554-827b-d68e9bac0e54] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:52:12.118134 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-316304fe-1ae8-44dd-a09a-66aba165ba92 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:52:12.118601 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-316304fe-1ae8-44dd-a09a-66aba165ba92 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:52:12.119318 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-316304fe-1ae8-44dd-a09a-66aba165ba92 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:52:12.119783 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-316304fe-1ae8-44dd-a09a-66aba165ba92 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:52:12.190775 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-e13b4543-df11-41b3-aa1e-b4e7a4c25f65 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:52:12.191259 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-e13b4543-df11-41b3-aa1e-b4e7a4c25f65 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:52:12.198203 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-e13b4543-df11-41b3-aa1e-b4e7a4c25f65 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:52:12.199013 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-e13b4543-df11-41b3-aa1e-b4e7a4c25f65 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:52:12.199790 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-e13b4543-df11-41b3-aa1e-b4e7a4c25f65 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:52:12.200245 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-e13b4543-df11-41b3-aa1e-b4e7a4c25f65 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:52:37.063831 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 27 15:52:37.064407 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: Wed Oct 27 15:52:37 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54/os-volume_attachments/83c14b0a-376f-4e7f-8127-955f6bf3e3e5 (ip 10.222.0.64) !!! Oct 27 15:53:01.428772 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 27 15:53:01.429452 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: Wed Oct 27 15:53:01 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54/os-volume_attachments/83c14b0a-376f-4e7f-8127-955f6bf3e3e5 (ip 10.222.0.64) !!! Oct 27 15:53:16.117865 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.objects.instance [None req-316304fe-1ae8-44dd-a09a-66aba165ba92 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lazy-loading 'services' on Instance uuid 013da7c4-ac69-4554-827b-d68e9bac0e54 {{(pid=122224) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 27 15:54:12.253915 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-316304fe-1ae8-44dd-a09a-66aba165ba92 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] 10.222.0.64 "DELETE /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54/os-volume_attachments/83c14b0a-376f-4e7f-8127-955f6bf3e3e5" status: 202 len: 0 microversion: 2.1 time: 120.145555 Oct 27 15:54:12.254571 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 780/1484] 10.222.0.64 () {58 vars in 1415 bytes} [Wed Oct 27 15:52:12 2021] DELETE /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54/os-volume_attachments/83c14b0a-376f-4e7f-8127-955f6bf3e3e5 => generated 0 bytes in 120147 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 15:54:12.382341 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-e13b4543-df11-41b3-aa1e-b4e7a4c25f65 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "DELETE /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672/os-volume_attachments/edff6846-9aa2-4888-8ad9-b3c115a453d3" status: 202 len: 0 microversion: 2.20 time: 120.195999 Oct 27 15:54:12.384453 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 705/1485] 10.222.0.64 () {60 vars in 1456 bytes} [Wed Oct 27 15:52:12 2021] DELETE /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672/os-volume_attachments/edff6846-9aa2-4888-8ad9-b3c115a453d3 => generated 0 bytes in 120199 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Oct 27 15:54:12.396646 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-01bf23ab-ba63-4b30-afdf-8c058b068477 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:54:12.397268 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-01bf23ab-ba63-4b30-afdf-8c058b068477 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] [instance: a79303e6-05ad-4901-96b7-ce845b4016f4] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:54:12.403946 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-01bf23ab-ba63-4b30-afdf-8c058b068477 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:54:12.404408 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-01bf23ab-ba63-4b30-afdf-8c058b068477 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:54:12.405188 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-01bf23ab-ba63-4b30-afdf-8c058b068477 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:54:12.405626 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-01bf23ab-ba63-4b30-afdf-8c058b068477 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:54:12.472130 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-f6975fdd-32e4-4a52-bce7-a0f0298af089 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:54:12.473193 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-f6975fdd-32e4-4a52-bce7-a0f0298af089 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: 62c89161-c119-48b2-839d-712db798ff96] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:54:12.479959 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-f6975fdd-32e4-4a52-bce7-a0f0298af089 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:54:12.480412 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-f6975fdd-32e4-4a52-bce7-a0f0298af089 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:54:12.481213 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-f6975fdd-32e4-4a52-bce7-a0f0298af089 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:54:12.481632 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-f6975fdd-32e4-4a52-bce7-a0f0298af089 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:54:12.512452 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-f6975fdd-32e4-4a52-bce7-a0f0298af089 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.256655 Oct 27 15:54:12.513036 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 781/1486] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Oct 27 15:54:12 2021] GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments => generated 197 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 15:54:12.517847 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-e072aa48-70f6-404e-9c07-c35e323b82eb tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:54:12.518338 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-e072aa48-70f6-404e-9c07-c35e323b82eb tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] [instance: 013da7c4-ac69-4554-827b-d68e9bac0e54] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:54:12.524168 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-e072aa48-70f6-404e-9c07-c35e323b82eb tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:54:12.524867 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-e072aa48-70f6-404e-9c07-c35e323b82eb tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:54:12.525649 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-e072aa48-70f6-404e-9c07-c35e323b82eb tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:54:12.526081 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-e072aa48-70f6-404e-9c07-c35e323b82eb tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:54:12.658746 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-01bf23ab-ba63-4b30-afdf-8c058b068477 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c757a383a434a4c9b1b928087af8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8818377e744d4f6ba65560705c191f0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:54:12.670464 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-01bf23ab-ba63-4b30-afdf-8c058b068477 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] 10.222.0.64 "GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4" status: 200 len: 1226 microversion: 2.1 time: 0.284134 Oct 27 15:54:12.671559 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 706/1487] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:54:12 2021] GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4 => generated 1226 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 15:54:12.676493 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-c8c4028c-d12b-4530-84c6-bedf18d33342 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:54:12.676975 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-c8c4028c-d12b-4530-84c6-bedf18d33342 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:54:12.682699 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-c8c4028c-d12b-4530-84c6-bedf18d33342 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:54:12.683397 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-c8c4028c-d12b-4530-84c6-bedf18d33342 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:54:12.684198 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-c8c4028c-d12b-4530-84c6-bedf18d33342 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:54:12.684630 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-c8c4028c-d12b-4530-84c6-bedf18d33342 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:54:17.161251 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 27 15:54:17.161940 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: Wed Oct 27 15:54:17 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672/os-volume_attachments/edff6846-9aa2-4888-8ad9-b3c115a453d3 (ip 10.222.0.64) !!! Oct 27 15:54:25.561659 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 27 15:54:25.562233 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: Wed Oct 27 15:54:25 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54/os-volume_attachments/83c14b0a-376f-4e7f-8127-955f6bf3e3e5 (ip 10.222.0.64) !!! Oct 27 15:54:38.947092 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 27 15:54:38.947608 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: Wed Oct 27 15:54:38 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672/os-volume_attachments/edff6846-9aa2-4888-8ad9-b3c115a453d3 (ip 10.222.0.64) !!! Oct 27 15:55:16.662407 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.objects.instance [None req-e072aa48-70f6-404e-9c07-c35e323b82eb tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lazy-loading 'services' on Instance uuid 013da7c4-ac69-4554-827b-d68e9bac0e54 {{(pid=122224) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 27 15:55:16.703957 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.wsgi [None req-c8c4028c-d12b-4530-84c6-bedf18d33342 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] HTTP exception thrown: Instance a115c672-012e-4e45-b5c9-4427e7b66672 is not attached to volume edff6846-9aa2-4888-8ad9-b3c115a453d3 Oct 27 15:55:16.704539 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-c8c4028c-d12b-4530-84c6-bedf18d33342 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Returning 404 to user: Instance a115c672-012e-4e45-b5c9-4427e7b66672 is not attached to volume edff6846-9aa2-4888-8ad9-b3c115a453d3 {{(pid=122225) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 27 15:55:16.705357 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-c8c4028c-d12b-4530-84c6-bedf18d33342 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "DELETE /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672/os-volume_attachments/edff6846-9aa2-4888-8ad9-b3c115a453d3" status: 404 len: 154 microversion: 2.20 time: 64.032680 Oct 27 15:55:16.705921 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 707/1488] 10.222.0.64 () {60 vars in 1456 bytes} [Wed Oct 27 15:54:12 2021] DELETE /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672/os-volume_attachments/edff6846-9aa2-4888-8ad9-b3c115a453d3 => generated 154 bytes in 64034 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 27 15:55:16.714771 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-69e53e3f-2f38-464a-8aaf-779d98ca4088 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:55:16.714771 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-69e53e3f-2f38-464a-8aaf-779d98ca4088 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: 62c89161-c119-48b2-839d-712db798ff96] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:55:16.720645 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-69e53e3f-2f38-464a-8aaf-779d98ca4088 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:55:16.721124 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-69e53e3f-2f38-464a-8aaf-779d98ca4088 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:55:16.722036 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-69e53e3f-2f38-464a-8aaf-779d98ca4088 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:55:16.722481 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-69e53e3f-2f38-464a-8aaf-779d98ca4088 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:55:16.758244 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-69e53e3f-2f38-464a-8aaf-779d98ca4088 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051201 Oct 27 15:55:16.759374 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 708/1489] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Oct 27 15:55:16 2021] GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 15:55:16.764625 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-e0f219b3-312b-49fc-8c04-36e52bd6fb14 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:55:16.765593 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-e0f219b3-312b-49fc-8c04-36e52bd6fb14 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] [instance: a79303e6-05ad-4901-96b7-ce845b4016f4] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:55:16.772455 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-e0f219b3-312b-49fc-8c04-36e52bd6fb14 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:55:16.773315 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-e0f219b3-312b-49fc-8c04-36e52bd6fb14 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:55:16.775040 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-e0f219b3-312b-49fc-8c04-36e52bd6fb14 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:55:16.775568 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-e0f219b3-312b-49fc-8c04-36e52bd6fb14 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:55:16.844683 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-e0f219b3-312b-49fc-8c04-36e52bd6fb14 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c757a383a434a4c9b1b928087af8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8818377e744d4f6ba65560705c191f0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:55:16.852809 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-e0f219b3-312b-49fc-8c04-36e52bd6fb14 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] 10.222.0.64 "GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4" status: 200 len: 1226 microversion: 2.1 time: 0.092351 Oct 27 15:55:16.853394 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 709/1490] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:55:16 2021] GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4 => generated 1226 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 15:55:16.858675 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-a7cffad5-473a-4469-a49c-f9661bbb0a01 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:55:16.859157 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-a7cffad5-473a-4469-a49c-f9661bbb0a01 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] [instance: 013da7c4-ac69-4554-827b-d68e9bac0e54] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:55:16.865735 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-a7cffad5-473a-4469-a49c-f9661bbb0a01 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:55:16.866375 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-a7cffad5-473a-4469-a49c-f9661bbb0a01 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:55:16.867310 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-a7cffad5-473a-4469-a49c-f9661bbb0a01 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:55:16.867937 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-a7cffad5-473a-4469-a49c-f9661bbb0a01 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:55:57.081499 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 27 15:55:57.082153 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: Wed Oct 27 15:55:57 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54/os-volume_attachments/83c14b0a-376f-4e7f-8127-955f6bf3e3e5 (ip 10.222.0.64) !!! Oct 27 15:56:12.679682 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.wsgi [None req-e072aa48-70f6-404e-9c07-c35e323b82eb tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-d4303e42-6927-4d92-aa1c-8379f6512eb2) Oct 27 15:56:12.680387 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-e072aa48-70f6-404e-9c07-c35e323b82eb tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-d4303e42-6927-4d92-aa1c-8379f6512eb2) {{(pid=122224) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 27 15:56:12.681224 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-e072aa48-70f6-404e-9c07-c35e323b82eb tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] 10.222.0.64 "DELETE /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54/os-volume_attachments/83c14b0a-376f-4e7f-8127-955f6bf3e3e5" status: 400 len: 269 microversion: 2.1 time: 120.167073 Oct 27 15:56:12.682265 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 782/1491] 10.222.0.64 () {58 vars in 1415 bytes} [Wed Oct 27 15:54:12 2021] DELETE /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54/os-volume_attachments/83c14b0a-376f-4e7f-8127-955f6bf3e3e5 => generated 269 bytes in 120168 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 27 15:56:12.688632 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-63f0ab30-9f72-4cc7-887d-639bf1616e95 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:56:12.689119 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-63f0ab30-9f72-4cc7-887d-639bf1616e95 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:56:12.697393 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-63f0ab30-9f72-4cc7-887d-639bf1616e95 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:56:12.697850 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-63f0ab30-9f72-4cc7-887d-639bf1616e95 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:56:12.698639 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-63f0ab30-9f72-4cc7-887d-639bf1616e95 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:56:12.699084 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-63f0ab30-9f72-4cc7-887d-639bf1616e95 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:56:12.730086 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.objects.instance [None req-a7cffad5-473a-4469-a49c-f9661bbb0a01 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lazy-loading 'services' on Instance uuid 013da7c4-ac69-4554-827b-d68e9bac0e54 {{(pid=122225) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 27 15:57:16.896270 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.wsgi [None req-63f0ab30-9f72-4cc7-887d-639bf1616e95 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] HTTP exception thrown: Instance a115c672-012e-4e45-b5c9-4427e7b66672 is not attached to volume edff6846-9aa2-4888-8ad9-b3c115a453d3 Oct 27 15:57:16.896878 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-63f0ab30-9f72-4cc7-887d-639bf1616e95 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Returning 404 to user: Instance a115c672-012e-4e45-b5c9-4427e7b66672 is not attached to volume edff6846-9aa2-4888-8ad9-b3c115a453d3 {{(pid=122224) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 27 15:57:16.897726 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-63f0ab30-9f72-4cc7-887d-639bf1616e95 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "DELETE /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672/os-volume_attachments/edff6846-9aa2-4888-8ad9-b3c115a453d3" status: 404 len: 154 microversion: 2.20 time: 64.214701 Oct 27 15:57:16.898294 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 783/1492] 10.222.0.64 () {60 vars in 1456 bytes} [Wed Oct 27 15:56:12 2021] DELETE /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672/os-volume_attachments/edff6846-9aa2-4888-8ad9-b3c115a453d3 => generated 154 bytes in 64216 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 27 15:57:16.903396 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-2c8d1e92-f300-4513-ad42-49acd696220b tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:57:16.905468 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-2c8d1e92-f300-4513-ad42-49acd696220b tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: 62c89161-c119-48b2-839d-712db798ff96] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:57:16.911920 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-2c8d1e92-f300-4513-ad42-49acd696220b tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:57:16.912393 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-2c8d1e92-f300-4513-ad42-49acd696220b tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:57:16.913307 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-2c8d1e92-f300-4513-ad42-49acd696220b tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:57:16.913587 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-2c8d1e92-f300-4513-ad42-49acd696220b tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:57:16.925216 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.wsgi [None req-a7cffad5-473a-4469-a49c-f9661bbb0a01 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-9921bfa0-afbf-45c7-be98-a9537b987078) Oct 27 15:57:16.925906 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-a7cffad5-473a-4469-a49c-f9661bbb0a01 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-9921bfa0-afbf-45c7-be98-a9537b987078) {{(pid=122225) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 27 15:57:16.927189 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-a7cffad5-473a-4469-a49c-f9661bbb0a01 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] 10.222.0.64 "DELETE /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54/os-volume_attachments/83c14b0a-376f-4e7f-8127-955f6bf3e3e5" status: 400 len: 269 microversion: 2.1 time: 120.072647 Oct 27 15:57:16.927714 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 710/1493] 10.222.0.64 () {58 vars in 1415 bytes} [Wed Oct 27 15:55:16 2021] DELETE /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54/os-volume_attachments/83c14b0a-376f-4e7f-8127-955f6bf3e3e5 => generated 269 bytes in 120074 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 27 15:57:16.947615 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-2c8d1e92-f300-4513-ad42-49acd696220b tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048270 Oct 27 15:57:16.948238 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 784/1494] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Oct 27 15:57:16 2021] GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 15:57:16.953382 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-1f2954cd-e74a-4a1d-8f9d-cb08d12a6447 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:57:16.954111 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-1f2954cd-e74a-4a1d-8f9d-cb08d12a6447 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] [instance: 013da7c4-ac69-4554-827b-d68e9bac0e54] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:57:16.960021 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-1f2954cd-e74a-4a1d-8f9d-cb08d12a6447 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:57:16.960657 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-1f2954cd-e74a-4a1d-8f9d-cb08d12a6447 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:57:16.961610 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-1f2954cd-e74a-4a1d-8f9d-cb08d12a6447 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:57:16.962200 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-1f2954cd-e74a-4a1d-8f9d-cb08d12a6447 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:57:17.142271 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-2c64f549-5856-43cd-8e1c-e7267877f5e2 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:57:17.143590 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-2c64f549-5856-43cd-8e1c-e7267877f5e2 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] [instance: a79303e6-05ad-4901-96b7-ce845b4016f4] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:57:17.149375 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-2c64f549-5856-43cd-8e1c-e7267877f5e2 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:57:17.149823 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-2c64f549-5856-43cd-8e1c-e7267877f5e2 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:57:17.150600 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-2c64f549-5856-43cd-8e1c-e7267877f5e2 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:57:17.151038 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-2c64f549-5856-43cd-8e1c-e7267877f5e2 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:57:17.213530 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-2c64f549-5856-43cd-8e1c-e7267877f5e2 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c757a383a434a4c9b1b928087af8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8818377e744d4f6ba65560705c191f0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:57:17.221721 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-2c64f549-5856-43cd-8e1c-e7267877f5e2 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] 10.222.0.64 "GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4" status: 200 len: 1226 microversion: 2.1 time: 0.292701 Oct 27 15:57:17.222283 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 711/1495] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:57:16 2021] GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4 => generated 1226 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 15:57:17.226694 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-670dd123-e218-41e1-a0c4-a99c0696ec32 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:57:17.227173 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-670dd123-e218-41e1-a0c4-a99c0696ec32 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:57:17.232772 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-670dd123-e218-41e1-a0c4-a99c0696ec32 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:57:17.233703 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-670dd123-e218-41e1-a0c4-a99c0696ec32 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:57:17.234465 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-670dd123-e218-41e1-a0c4-a99c0696ec32 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:57:17.234892 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-670dd123-e218-41e1-a0c4-a99c0696ec32 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:57:37.180265 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 27 15:57:37.180924 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: Wed Oct 27 15:57:37 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672/os-volume_attachments/edff6846-9aa2-4888-8ad9-b3c115a453d3 (ip 10.222.0.64) !!! Oct 27 15:57:45.578768 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 27 15:57:45.579418 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: Wed Oct 27 15:57:45 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54/os-volume_attachments/83c14b0a-376f-4e7f-8127-955f6bf3e3e5 (ip 10.222.0.64) !!! Oct 27 15:57:58.965287 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 27 15:57:58.965987 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: Wed Oct 27 15:57:58 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672/os-volume_attachments/edff6846-9aa2-4888-8ad9-b3c115a453d3 (ip 10.222.0.64) !!! Oct 27 15:58:13.203947 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.objects.instance [None req-1f2954cd-e74a-4a1d-8f9d-cb08d12a6447 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lazy-loading 'services' on Instance uuid 013da7c4-ac69-4554-827b-d68e9bac0e54 {{(pid=122224) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 27 15:58:13.245699 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.wsgi [None req-670dd123-e218-41e1-a0c4-a99c0696ec32 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] HTTP exception thrown: Instance a115c672-012e-4e45-b5c9-4427e7b66672 is not attached to volume edff6846-9aa2-4888-8ad9-b3c115a453d3 Oct 27 15:58:13.246410 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-670dd123-e218-41e1-a0c4-a99c0696ec32 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Returning 404 to user: Instance a115c672-012e-4e45-b5c9-4427e7b66672 is not attached to volume edff6846-9aa2-4888-8ad9-b3c115a453d3 {{(pid=122225) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 27 15:58:13.248198 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-670dd123-e218-41e1-a0c4-a99c0696ec32 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "DELETE /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672/os-volume_attachments/edff6846-9aa2-4888-8ad9-b3c115a453d3" status: 404 len: 154 microversion: 2.20 time: 56.024120 Oct 27 15:58:13.248946 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 712/1496] 10.222.0.64 () {60 vars in 1456 bytes} [Wed Oct 27 15:57:17 2021] DELETE /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672/os-volume_attachments/edff6846-9aa2-4888-8ad9-b3c115a453d3 => generated 154 bytes in 56026 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 27 15:58:13.253550 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-9ac2cb98-e95b-4c8c-b199-057fd8d933c4 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:58:13.254496 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-9ac2cb98-e95b-4c8c-b199-057fd8d933c4 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: 62c89161-c119-48b2-839d-712db798ff96] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:58:13.260205 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-9ac2cb98-e95b-4c8c-b199-057fd8d933c4 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:58:13.260647 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-9ac2cb98-e95b-4c8c-b199-057fd8d933c4 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:58:13.261407 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-9ac2cb98-e95b-4c8c-b199-057fd8d933c4 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:58:13.261831 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-9ac2cb98-e95b-4c8c-b199-057fd8d933c4 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:58:13.290029 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-9ac2cb98-e95b-4c8c-b199-057fd8d933c4 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040035 Oct 27 15:58:13.290574 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 713/1497] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Oct 27 15:58:13 2021] GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 15:58:13.295276 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-40ef9820-88e0-4d47-acfd-8a0dd186115d tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:58:13.295884 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-40ef9820-88e0-4d47-acfd-8a0dd186115d tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] [instance: a79303e6-05ad-4901-96b7-ce845b4016f4] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:58:13.301161 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-40ef9820-88e0-4d47-acfd-8a0dd186115d tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:58:13.301599 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-40ef9820-88e0-4d47-acfd-8a0dd186115d tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:58:13.302343 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-40ef9820-88e0-4d47-acfd-8a0dd186115d tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:58:13.302767 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-40ef9820-88e0-4d47-acfd-8a0dd186115d tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:58:13.313515 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.wsgi [None req-1f2954cd-e74a-4a1d-8f9d-cb08d12a6447 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-bb577349-c0fc-48d7-9198-8ff5ac638e75) Oct 27 15:58:13.314189 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-1f2954cd-e74a-4a1d-8f9d-cb08d12a6447 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-bb577349-c0fc-48d7-9198-8ff5ac638e75) {{(pid=122224) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 27 15:58:13.315217 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-1f2954cd-e74a-4a1d-8f9d-cb08d12a6447 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] 10.222.0.64 "DELETE /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54/os-volume_attachments/83c14b0a-376f-4e7f-8127-955f6bf3e3e5" status: 400 len: 269 microversion: 2.1 time: 56.365710 Oct 27 15:58:13.316043 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 785/1498] 10.222.0.64 () {58 vars in 1415 bytes} [Wed Oct 27 15:57:16 2021] DELETE /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54/os-volume_attachments/83c14b0a-376f-4e7f-8127-955f6bf3e3e5 => generated 269 bytes in 56367 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 27 15:58:13.321651 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-9de9c7fb-9984-4806-8dd7-301241ebaa23 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:58:13.322204 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-9de9c7fb-9984-4806-8dd7-301241ebaa23 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] [instance: 013da7c4-ac69-4554-827b-d68e9bac0e54] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:58:13.329953 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-9de9c7fb-9984-4806-8dd7-301241ebaa23 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:58:13.330526 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-9de9c7fb-9984-4806-8dd7-301241ebaa23 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:58:13.331421 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-9de9c7fb-9984-4806-8dd7-301241ebaa23 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:58:13.331954 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-9de9c7fb-9984-4806-8dd7-301241ebaa23 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:58:13.364398 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-40ef9820-88e0-4d47-acfd-8a0dd186115d tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c757a383a434a4c9b1b928087af8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8818377e744d4f6ba65560705c191f0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:58:13.371819 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-40ef9820-88e0-4d47-acfd-8a0dd186115d tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] 10.222.0.64 "GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4" status: 200 len: 1226 microversion: 2.1 time: 0.080306 Oct 27 15:58:13.373274 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 714/1499] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:58:13 2021] GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4 => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 15:58:13.377904 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-adfa5ffe-a961-4bda-b4d6-4db5cdc361bb tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:58:13.378383 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-adfa5ffe-a961-4bda-b4d6-4db5cdc361bb tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:58:13.384016 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-adfa5ffe-a961-4bda-b4d6-4db5cdc361bb tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:58:13.384456 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-adfa5ffe-a961-4bda-b4d6-4db5cdc361bb tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:58:13.385212 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-adfa5ffe-a961-4bda-b4d6-4db5cdc361bb tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:58:13.385636 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-adfa5ffe-a961-4bda-b4d6-4db5cdc361bb tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:58:13.420158 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.objects.instance [None req-9de9c7fb-9984-4806-8dd7-301241ebaa23 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lazy-loading 'services' on Instance uuid 013da7c4-ac69-4554-827b-d68e9bac0e54 {{(pid=122224) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 27 15:58:13.458161 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.wsgi [None req-adfa5ffe-a961-4bda-b4d6-4db5cdc361bb tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] HTTP exception thrown: Instance a115c672-012e-4e45-b5c9-4427e7b66672 is not attached to volume edff6846-9aa2-4888-8ad9-b3c115a453d3 Oct 27 15:58:13.458902 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-adfa5ffe-a961-4bda-b4d6-4db5cdc361bb tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Returning 404 to user: Instance a115c672-012e-4e45-b5c9-4427e7b66672 is not attached to volume edff6846-9aa2-4888-8ad9-b3c115a453d3 {{(pid=122225) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 27 15:58:13.459728 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-adfa5ffe-a961-4bda-b4d6-4db5cdc361bb tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "DELETE /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672/os-volume_attachments/edff6846-9aa2-4888-8ad9-b3c115a453d3" status: 404 len: 154 microversion: 2.20 time: 0.085443 Oct 27 15:58:13.460698 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 715/1500] 10.222.0.64 () {60 vars in 1456 bytes} [Wed Oct 27 15:58:13 2021] DELETE /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672/os-volume_attachments/edff6846-9aa2-4888-8ad9-b3c115a453d3 => generated 154 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 27 15:58:13.465488 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-d9c61b90-5fdb-446b-ac65-65f42cc40496 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:58:13.466885 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-d9c61b90-5fdb-446b-ac65-65f42cc40496 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: 62c89161-c119-48b2-839d-712db798ff96] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:58:13.472527 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-d9c61b90-5fdb-446b-ac65-65f42cc40496 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:58:13.472962 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-d9c61b90-5fdb-446b-ac65-65f42cc40496 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:58:13.473715 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-d9c61b90-5fdb-446b-ac65-65f42cc40496 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:58:13.474140 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-d9c61b90-5fdb-446b-ac65-65f42cc40496 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:58:13.486032 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.wsgi [None req-9de9c7fb-9984-4806-8dd7-301241ebaa23 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-edb55e34-adba-406a-825d-bb498b2d4a9f) Oct 27 15:58:13.486716 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-9de9c7fb-9984-4806-8dd7-301241ebaa23 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-edb55e34-adba-406a-825d-bb498b2d4a9f) {{(pid=122224) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 27 15:58:13.487664 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-9de9c7fb-9984-4806-8dd7-301241ebaa23 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] 10.222.0.64 "DELETE /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54/os-volume_attachments/83c14b0a-376f-4e7f-8127-955f6bf3e3e5" status: 400 len: 269 microversion: 2.1 time: 0.170517 Oct 27 15:58:13.488454 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 786/1501] 10.222.0.64 () {58 vars in 1415 bytes} [Wed Oct 27 15:58:13 2021] DELETE /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54/os-volume_attachments/83c14b0a-376f-4e7f-8127-955f6bf3e3e5 => generated 269 bytes in 172 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 27 15:58:13.494144 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-8f8cdfe7-8a43-46d4-b66f-5a8448822293 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:58:13.494883 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-8f8cdfe7-8a43-46d4-b66f-5a8448822293 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] [instance: a79303e6-05ad-4901-96b7-ce845b4016f4] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:58:13.503055 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-8f8cdfe7-8a43-46d4-b66f-5a8448822293 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:58:13.503545 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-8f8cdfe7-8a43-46d4-b66f-5a8448822293 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:58:13.504525 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-8f8cdfe7-8a43-46d4-b66f-5a8448822293 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:58:13.505019 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-8f8cdfe7-8a43-46d4-b66f-5a8448822293 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:58:13.506150 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-d9c61b90-5fdb-446b-ac65-65f42cc40496 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044446 Oct 27 15:58:13.506865 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 716/1502] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Oct 27 15:58:13 2021] GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 15:58:13.511078 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-b2e422b0-e9cc-4818-a200-73eb897c1a19 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:58:13.511582 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-b2e422b0-e9cc-4818-a200-73eb897c1a19 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] [instance: 013da7c4-ac69-4554-827b-d68e9bac0e54] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:58:13.517851 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-b2e422b0-e9cc-4818-a200-73eb897c1a19 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:58:13.518286 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-b2e422b0-e9cc-4818-a200-73eb897c1a19 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:58:13.519038 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-b2e422b0-e9cc-4818-a200-73eb897c1a19 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:58:13.519460 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-b2e422b0-e9cc-4818-a200-73eb897c1a19 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:58:13.569848 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-8f8cdfe7-8a43-46d4-b66f-5a8448822293 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c757a383a434a4c9b1b928087af8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8818377e744d4f6ba65560705c191f0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:58:13.578464 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-8f8cdfe7-8a43-46d4-b66f-5a8448822293 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] 10.222.0.64 "GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4" status: 200 len: 1226 microversion: 2.1 time: 0.088340 Oct 27 15:58:13.579430 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 787/1503] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:58:13 2021] GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4 => generated 1226 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 15:58:13.583741 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-23ab1346-9986-4c32-b15d-37f5bf237a02 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:58:13.584255 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-23ab1346-9986-4c32-b15d-37f5bf237a02 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:58:13.590030 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-23ab1346-9986-4c32-b15d-37f5bf237a02 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:58:13.590476 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-23ab1346-9986-4c32-b15d-37f5bf237a02 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:58:13.591784 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-23ab1346-9986-4c32-b15d-37f5bf237a02 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:58:13.592246 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-23ab1346-9986-4c32-b15d-37f5bf237a02 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:58:13.607189 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.objects.instance [None req-b2e422b0-e9cc-4818-a200-73eb897c1a19 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lazy-loading 'services' on Instance uuid 013da7c4-ac69-4554-827b-d68e9bac0e54 {{(pid=122225) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 27 15:58:13.665807 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.wsgi [None req-23ab1346-9986-4c32-b15d-37f5bf237a02 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] HTTP exception thrown: Instance a115c672-012e-4e45-b5c9-4427e7b66672 is not attached to volume edff6846-9aa2-4888-8ad9-b3c115a453d3 Oct 27 15:58:13.666419 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-23ab1346-9986-4c32-b15d-37f5bf237a02 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Returning 404 to user: Instance a115c672-012e-4e45-b5c9-4427e7b66672 is not attached to volume edff6846-9aa2-4888-8ad9-b3c115a453d3 {{(pid=122224) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 27 15:58:13.667344 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-23ab1346-9986-4c32-b15d-37f5bf237a02 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "DELETE /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672/os-volume_attachments/edff6846-9aa2-4888-8ad9-b3c115a453d3" status: 404 len: 154 microversion: 2.20 time: 0.087222 Oct 27 15:58:13.667915 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 788/1504] 10.222.0.64 () {60 vars in 1456 bytes} [Wed Oct 27 15:58:13 2021] DELETE /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672/os-volume_attachments/edff6846-9aa2-4888-8ad9-b3c115a453d3 => generated 154 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 27 15:58:13.673225 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-18e72f1d-0d79-4db6-8cd5-fc1d2b5ff129 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:58:13.674129 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-18e72f1d-0d79-4db6-8cd5-fc1d2b5ff129 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: 62c89161-c119-48b2-839d-712db798ff96] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:58:13.679867 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-18e72f1d-0d79-4db6-8cd5-fc1d2b5ff129 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:58:13.680324 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-18e72f1d-0d79-4db6-8cd5-fc1d2b5ff129 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:58:13.681092 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-18e72f1d-0d79-4db6-8cd5-fc1d2b5ff129 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:58:13.681530 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-18e72f1d-0d79-4db6-8cd5-fc1d2b5ff129 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:58:13.692936 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.wsgi [None req-b2e422b0-e9cc-4818-a200-73eb897c1a19 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-91128342-b9e5-4709-b39f-44b410345589) Oct 27 15:58:13.693662 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-b2e422b0-e9cc-4818-a200-73eb897c1a19 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-91128342-b9e5-4709-b39f-44b410345589) {{(pid=122225) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 27 15:58:13.694572 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-b2e422b0-e9cc-4818-a200-73eb897c1a19 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] 10.222.0.64 "DELETE /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54/os-volume_attachments/83c14b0a-376f-4e7f-8127-955f6bf3e3e5" status: 400 len: 269 microversion: 2.1 time: 0.186928 Oct 27 15:58:13.696359 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 717/1505] 10.222.0.64 () {58 vars in 1415 bytes} [Wed Oct 27 15:58:13 2021] DELETE /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54/os-volume_attachments/83c14b0a-376f-4e7f-8127-955f6bf3e3e5 => generated 269 bytes in 189 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 27 15:58:13.701149 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-4cd396e2-31b7-4ebe-8032-6ce65e761917 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:58:13.701963 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-4cd396e2-31b7-4ebe-8032-6ce65e761917 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] [instance: a79303e6-05ad-4901-96b7-ce845b4016f4] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:58:13.709889 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-4cd396e2-31b7-4ebe-8032-6ce65e761917 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:58:13.710333 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-4cd396e2-31b7-4ebe-8032-6ce65e761917 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:58:13.711095 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-4cd396e2-31b7-4ebe-8032-6ce65e761917 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:58:13.712348 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-18e72f1d-0d79-4db6-8cd5-fc1d2b5ff129 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043209 Oct 27 15:58:13.712649 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-4cd396e2-31b7-4ebe-8032-6ce65e761917 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:58:13.712942 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 789/1506] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Oct 27 15:58:13 2021] GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 15:58:13.718182 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-2d21a56c-a501-47bf-823b-6462cc2ab61e tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:58:13.718815 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-2d21a56c-a501-47bf-823b-6462cc2ab61e tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] [instance: 013da7c4-ac69-4554-827b-d68e9bac0e54] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:58:13.724449 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-2d21a56c-a501-47bf-823b-6462cc2ab61e tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:58:13.724900 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-2d21a56c-a501-47bf-823b-6462cc2ab61e tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:58:13.725676 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-2d21a56c-a501-47bf-823b-6462cc2ab61e tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:58:13.726109 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-2d21a56c-a501-47bf-823b-6462cc2ab61e tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:58:13.777453 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-4cd396e2-31b7-4ebe-8032-6ce65e761917 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c757a383a434a4c9b1b928087af8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8818377e744d4f6ba65560705c191f0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:58:13.785475 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-4cd396e2-31b7-4ebe-8032-6ce65e761917 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] 10.222.0.64 "GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4" status: 200 len: 1226 microversion: 2.1 time: 0.088180 Oct 27 15:58:13.786054 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 718/1507] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:58:13 2021] GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4 => generated 1226 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 15:58:13.790530 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-4520d910-46e4-4be7-827c-3fa7c1f609ee tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:58:13.791012 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-4520d910-46e4-4be7-827c-3fa7c1f609ee tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:58:13.796677 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-4520d910-46e4-4be7-827c-3fa7c1f609ee tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:58:13.797150 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-4520d910-46e4-4be7-827c-3fa7c1f609ee tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:58:13.797932 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-4520d910-46e4-4be7-827c-3fa7c1f609ee tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:58:13.798368 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-4520d910-46e4-4be7-827c-3fa7c1f609ee tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:59:17.099128 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 27 15:59:17.099767 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: Wed Oct 27 15:59:17 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54/os-volume_attachments/83c14b0a-376f-4e7f-8127-955f6bf3e3e5 (ip 10.222.0.64) !!! Oct 27 15:59:17.277891 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.objects.instance [None req-2d21a56c-a501-47bf-823b-6462cc2ab61e tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lazy-loading 'services' on Instance uuid 013da7c4-ac69-4554-827b-d68e9bac0e54 {{(pid=122224) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 27 15:59:17.474697 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.wsgi [None req-4520d910-46e4-4be7-827c-3fa7c1f609ee tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] HTTP exception thrown: Instance a115c672-012e-4e45-b5c9-4427e7b66672 is not attached to volume edff6846-9aa2-4888-8ad9-b3c115a453d3 Oct 27 15:59:17.475344 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-4520d910-46e4-4be7-827c-3fa7c1f609ee tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Returning 404 to user: Instance a115c672-012e-4e45-b5c9-4427e7b66672 is not attached to volume edff6846-9aa2-4888-8ad9-b3c115a453d3 {{(pid=122225) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 27 15:59:17.476257 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-4520d910-46e4-4be7-827c-3fa7c1f609ee tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "DELETE /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672/os-volume_attachments/edff6846-9aa2-4888-8ad9-b3c115a453d3" status: 404 len: 154 microversion: 2.20 time: 63.689224 Oct 27 15:59:17.476819 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 719/1508] 10.222.0.64 () {60 vars in 1456 bytes} [Wed Oct 27 15:58:13 2021] DELETE /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672/os-volume_attachments/edff6846-9aa2-4888-8ad9-b3c115a453d3 => generated 154 bytes in 63690 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 27 15:59:17.587697 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.wsgi [None req-2d21a56c-a501-47bf-823b-6462cc2ab61e tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-f3429fe5-a1ce-40c6-90d0-de187475ae11) Oct 27 15:59:17.588430 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-2d21a56c-a501-47bf-823b-6462cc2ab61e tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-f3429fe5-a1ce-40c6-90d0-de187475ae11) {{(pid=122224) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 27 15:59:17.589781 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-2d21a56c-a501-47bf-823b-6462cc2ab61e tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] 10.222.0.64 "DELETE /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54/os-volume_attachments/83c14b0a-376f-4e7f-8127-955f6bf3e3e5" status: 400 len: 269 microversion: 2.1 time: 63.875921 Oct 27 15:59:17.590920 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 790/1509] 10.222.0.64 () {58 vars in 1415 bytes} [Wed Oct 27 15:58:13 2021] DELETE /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54/os-volume_attachments/83c14b0a-376f-4e7f-8127-955f6bf3e3e5 => generated 269 bytes in 63877 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 27 15:59:17.596522 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-0d81c07f-00fa-42cd-bfe2-52e614cfa838 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:59:17.597139 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-0d81c07f-00fa-42cd-bfe2-52e614cfa838 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] [instance: a79303e6-05ad-4901-96b7-ce845b4016f4] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:59:17.601506 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-c8f07119-2682-4131-9a88-aa61dc494ee7 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:59:17.602816 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-c8f07119-2682-4131-9a88-aa61dc494ee7 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: 62c89161-c119-48b2-839d-712db798ff96] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:59:17.603536 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-0d81c07f-00fa-42cd-bfe2-52e614cfa838 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:59:17.604320 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-0d81c07f-00fa-42cd-bfe2-52e614cfa838 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:59:17.605302 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-0d81c07f-00fa-42cd-bfe2-52e614cfa838 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:59:17.606503 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-0d81c07f-00fa-42cd-bfe2-52e614cfa838 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:59:17.611942 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-c8f07119-2682-4131-9a88-aa61dc494ee7 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:59:17.612216 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-c8f07119-2682-4131-9a88-aa61dc494ee7 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:59:17.612970 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-c8f07119-2682-4131-9a88-aa61dc494ee7 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:59:17.613435 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-c8f07119-2682-4131-9a88-aa61dc494ee7 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:59:17.641184 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-0d81c07f-00fa-42cd-bfe2-52e614cfa838 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:59:17.641955 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-0d81c07f-00fa-42cd-bfe2-52e614cfa838 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:59:17.642420 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.objects.instance [None req-0d81c07f-00fa-42cd-bfe2-52e614cfa838 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lazy-loading 'fault' on Instance uuid a79303e6-05ad-4901-96b7-ce845b4016f4 {{(pid=122224) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 27 15:59:17.647805 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-c8f07119-2682-4131-9a88-aa61dc494ee7 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.169273 Oct 27 15:59:17.648916 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 720/1510] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Oct 27 15:59:17 2021] GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments => generated 197 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 15:59:17.653779 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-df5246bc-f2f5-43a2-b296-1b614640a6c1 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:59:17.654270 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-df5246bc-f2f5-43a2-b296-1b614640a6c1 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] [instance: 013da7c4-ac69-4554-827b-d68e9bac0e54] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:59:17.660101 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-df5246bc-f2f5-43a2-b296-1b614640a6c1 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:59:17.660549 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-df5246bc-f2f5-43a2-b296-1b614640a6c1 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:59:17.661468 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-df5246bc-f2f5-43a2-b296-1b614640a6c1 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:59:17.662037 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-df5246bc-f2f5-43a2-b296-1b614640a6c1 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:59:17.687748 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-0d81c07f-00fa-42cd-bfe2-52e614cfa838 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c757a383a434a4c9b1b928087af8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8818377e744d4f6ba65560705c191f0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:59:17.694986 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-0d81c07f-00fa-42cd-bfe2-52e614cfa838 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] 10.222.0.64 "GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4" status: 200 len: 1185 microversion: 2.1 time: 0.102818 Oct 27 15:59:17.695599 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 791/1511] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:59:17 2021] GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4 => generated 1185 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 15:59:17.700923 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-e02a8a74-b7b3-4b79-b6a4-17faad363b8a tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:59:17.701431 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-e02a8a74-b7b3-4b79-b6a4-17faad363b8a tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:59:17.707627 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-e02a8a74-b7b3-4b79-b6a4-17faad363b8a tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:59:17.708124 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-e02a8a74-b7b3-4b79-b6a4-17faad363b8a tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:59:17.708897 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-e02a8a74-b7b3-4b79-b6a4-17faad363b8a tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:59:17.709323 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-e02a8a74-b7b3-4b79-b6a4-17faad363b8a tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:59:17.755251 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.objects.instance [None req-df5246bc-f2f5-43a2-b296-1b614640a6c1 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lazy-loading 'services' on Instance uuid 013da7c4-ac69-4554-827b-d68e9bac0e54 {{(pid=122225) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 27 15:59:17.790613 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.wsgi [None req-e02a8a74-b7b3-4b79-b6a4-17faad363b8a tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] HTTP exception thrown: Instance a115c672-012e-4e45-b5c9-4427e7b66672 is not attached to volume edff6846-9aa2-4888-8ad9-b3c115a453d3 Oct 27 15:59:17.791329 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-e02a8a74-b7b3-4b79-b6a4-17faad363b8a tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Returning 404 to user: Instance a115c672-012e-4e45-b5c9-4427e7b66672 is not attached to volume edff6846-9aa2-4888-8ad9-b3c115a453d3 {{(pid=122224) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 27 15:59:17.792314 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-e02a8a74-b7b3-4b79-b6a4-17faad363b8a tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "DELETE /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672/os-volume_attachments/edff6846-9aa2-4888-8ad9-b3c115a453d3" status: 404 len: 154 microversion: 2.20 time: 0.095777 Oct 27 15:59:17.792955 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 792/1512] 10.222.0.64 () {60 vars in 1456 bytes} [Wed Oct 27 15:59:17 2021] DELETE /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672/os-volume_attachments/edff6846-9aa2-4888-8ad9-b3c115a453d3 => generated 154 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 27 15:59:17.798356 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-855fbcbd-98ca-4361-8cc1-6c6c0f2a28bd tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:59:17.799349 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-855fbcbd-98ca-4361-8cc1-6c6c0f2a28bd tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: 62c89161-c119-48b2-839d-712db798ff96] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:59:17.805624 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-855fbcbd-98ca-4361-8cc1-6c6c0f2a28bd tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:59:17.806084 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-855fbcbd-98ca-4361-8cc1-6c6c0f2a28bd tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:59:17.806875 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-855fbcbd-98ca-4361-8cc1-6c6c0f2a28bd tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:59:17.807314 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-855fbcbd-98ca-4361-8cc1-6c6c0f2a28bd tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:59:17.816983 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.wsgi [None req-df5246bc-f2f5-43a2-b296-1b614640a6c1 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-5fc8932d-2b3e-48ce-942e-d88c14db103d) Oct 27 15:59:17.817641 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-df5246bc-f2f5-43a2-b296-1b614640a6c1 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-5fc8932d-2b3e-48ce-942e-d88c14db103d) {{(pid=122225) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 27 15:59:17.818669 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-df5246bc-f2f5-43a2-b296-1b614640a6c1 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] 10.222.0.64 "DELETE /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54/os-volume_attachments/83c14b0a-376f-4e7f-8127-955f6bf3e3e5" status: 400 len: 269 microversion: 2.1 time: 0.169075 Oct 27 15:59:17.819218 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 721/1513] 10.222.0.64 () {58 vars in 1415 bytes} [Wed Oct 27 15:59:17 2021] DELETE /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54/os-volume_attachments/83c14b0a-376f-4e7f-8127-955f6bf3e3e5 => generated 269 bytes in 170 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 27 15:59:17.823572 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-f960b264-f0f2-4d0f-9ec8-bf16eb9288e0 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:59:17.824209 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-f960b264-f0f2-4d0f-9ec8-bf16eb9288e0 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] [instance: a79303e6-05ad-4901-96b7-ce845b4016f4] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:59:17.830686 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-f960b264-f0f2-4d0f-9ec8-bf16eb9288e0 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:59:17.831129 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-f960b264-f0f2-4d0f-9ec8-bf16eb9288e0 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:59:17.831929 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-f960b264-f0f2-4d0f-9ec8-bf16eb9288e0 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:59:17.832368 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-f960b264-f0f2-4d0f-9ec8-bf16eb9288e0 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:59:17.841621 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-855fbcbd-98ca-4361-8cc1-6c6c0f2a28bd tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047525 Oct 27 15:59:17.842390 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 793/1514] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Oct 27 15:59:17 2021] GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 15:59:17.846564 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.wsgi [None req-f960b264-f0f2-4d0f-9ec8-bf16eb9288e0 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] HTTP exception thrown: Instance a79303e6-05ad-4901-96b7-ce845b4016f4 could not be found. Oct 27 15:59:17.847317 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-f960b264-f0f2-4d0f-9ec8-bf16eb9288e0 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Returning 404 to user: Instance a79303e6-05ad-4901-96b7-ce845b4016f4 could not be found. {{(pid=122225) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 27 15:59:17.848176 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-f960b264-f0f2-4d0f-9ec8-bf16eb9288e0 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] 10.222.0.64 "GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4" status: 404 len: 111 microversion: 2.1 time: 0.028042 Oct 27 15:59:17.848724 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 722/1515] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:59:17 2021] GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 15:59:17.850741 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-dcc4bd03-de36-4db1-964b-b6dcfe62a59c tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:59:17.851723 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-dcc4bd03-de36-4db1-964b-b6dcfe62a59c tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:59:17.858320 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-dcc4bd03-de36-4db1-964b-b6dcfe62a59c tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:59:17.858763 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-dcc4bd03-de36-4db1-964b-b6dcfe62a59c tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:59:17.859534 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-dcc4bd03-de36-4db1-964b-b6dcfe62a59c tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:59:17.859988 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-dcc4bd03-de36-4db1-964b-b6dcfe62a59c tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:59:17.891457 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-dcc4bd03-de36-4db1-964b-b6dcfe62a59c tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.044421 Oct 27 15:59:17.892079 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 794/1516] 10.222.0.64 () {60 vars in 1342 bytes} [Wed Oct 27 15:59:17 2021] GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 15:59:17.908747 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-6beee8ad-6d81-460f-9854-cfe19f0b9be0 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-525892292", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-2050413747", "security_groups": [{"name": "tempest-secgroup-smoke-338213581"}], "block_device_mapping_v2": [{"uuid": "82e8083f-419e-4058-a996-da93713d7f80", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "816f1cdd-21be-4397-bf09-ccc55a5f04b0"}]}} {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 15:59:17.953833 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-00be4149-6e78-41b5-8b63-52b2a11c385a tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:59:17.954323 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-00be4149-6e78-41b5-8b63-52b2a11c385a tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:59:17.959983 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-00be4149-6e78-41b5-8b63-52b2a11c385a tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:59:17.960432 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-00be4149-6e78-41b5-8b63-52b2a11c385a tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:59:17.961199 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-00be4149-6e78-41b5-8b63-52b2a11c385a tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:59:17.961637 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-00be4149-6e78-41b5-8b63-52b2a11c385a tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:59:17.987826 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-00be4149-6e78-41b5-8b63-52b2a11c385a tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] Going to try to terminate instance {{(pid=122224) delete /opt/stack/nova/nova/compute/api.py:2612}} Oct 27 15:59:17.994028 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.compute.api [None req-00be4149-6e78-41b5-8b63-52b2a11c385a tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] Working on deleting snapshot 4934f4fd-fe4c-4b35-beae-527dadbc75e6 from shelved instance... Oct 27 15:59:18.036320 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.network.neutron [None req-6beee8ad-6d81-460f-9854-cfe19f0b9be0 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] validate_networks() for [('816f1cdd-21be-4397-bf09-ccc55a5f04b0', None, None, None, None, None)] {{(pid=122225) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Oct 27 15:59:18.506968 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.virt.hardware [None req-6beee8ad-6d81-460f-9854-cfe19f0b9be0 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Flavor limits 0:0:0 {{(pid=122225) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 15:59:18.508164 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.virt.hardware [None req-6beee8ad-6d81-460f-9854-cfe19f0b9be0 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Image limits 0:0:0 {{(pid=122225) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 15:59:18.508836 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.virt.hardware [None req-6beee8ad-6d81-460f-9854-cfe19f0b9be0 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Flavor pref 0:0:0 {{(pid=122225) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 15:59:18.509301 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.virt.hardware [None req-6beee8ad-6d81-460f-9854-cfe19f0b9be0 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Image pref 0:0:0 {{(pid=122225) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 15:59:18.509781 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.virt.hardware [None req-6beee8ad-6d81-460f-9854-cfe19f0b9be0 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122225) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 15:59:18.519506 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-6beee8ad-6d81-460f-9854-cfe19f0b9be0 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:59:18.524212 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-6beee8ad-6d81-460f-9854-cfe19f0b9be0 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:59:18.525044 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-6beee8ad-6d81-460f-9854-cfe19f0b9be0 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:59:18.525581 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-6beee8ad-6d81-460f-9854-cfe19f0b9be0 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:59:18.551460 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.quota [None req-6beee8ad-6d81-460f-9854-cfe19f0b9be0 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Getting quotas for project 8818377e744d4f6ba65560705c191f0a. Resources: {'ram', 'instances', 'cores'} {{(pid=122225) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 27 15:59:18.555534 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.quota [None req-6beee8ad-6d81-460f-9854-cfe19f0b9be0 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Getting quotas for user 4c757a383a434a4c9b1b928087af8de7 and project 8818377e744d4f6ba65560705c191f0a. Resources: {'ram', 'instances', 'cores'} {{(pid=122225) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 27 15:59:18.655046 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-6beee8ad-6d81-460f-9854-cfe19f0b9be0 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Going to run 1 instances... {{(pid=122225) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Oct 27 15:59:18.657302 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-6beee8ad-6d81-460f-9854-cfe19f0b9be0 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] [instance: 29977596-4757-448f-9923-e7a17e2b6133] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='82e8083f-419e-4058-a996-da93713d7f80',volume_size=None,volume_type=None)] {{(pid=122225) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Oct 27 15:59:18.728926 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.wsgi [None req-6beee8ad-6d81-460f-9854-cfe19f0b9be0 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Volume 82e8083f-419e-4058-a996-da93713d7f80 status must be available or downloading to reserve, but the current status is in-use. (HTTP 400) (Request-ID: req-0806d77a-40ba-4d31-af16-805f6bcbb4d3) Oct 27 15:59:18.729938 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-6beee8ad-6d81-460f-9854-cfe19f0b9be0 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Volume 82e8083f-419e-4058-a996-da93713d7f80 status must be available or downloading to reserve, but the current status is in-use. (HTTP 400) (Request-ID: req-0806d77a-40ba-4d31-af16-805f6bcbb4d3) {{(pid=122225) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 27 15:59:18.731443 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-6beee8ad-6d81-460f-9854-cfe19f0b9be0 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 400 len: 295 microversion: 2.1 time: 0.826163 Oct 27 15:59:18.732154 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 723/1517] 10.222.0.64 () {60 vars in 1146 bytes} [Wed Oct 27 15:59:17 2021] POST /compute/v2.1/servers => generated 295 bytes in 828 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 27 15:59:18.735020 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-00be4149-6e78-41b5-8b63-52b2a11c385a tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] Doing local delete in cell c943b248-24a3-4c90-8911-04b0b8d5cf35(cell1) {{(pid=122224) _delete /opt/stack/nova/nova/compute/api.py:2437}} Oct 27 15:59:18.735814 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-00be4149-6e78-41b5-8b63-52b2a11c385a tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:59:18.736275 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-00be4149-6e78-41b5-8b63-52b2a11c385a tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:59:18.736689 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.compute.api [None req-00be4149-6e78-41b5-8b63-52b2a11c385a tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] instance is in SHELVED_OFFLOADED state, cleanup the instance's info from database. Oct 27 15:59:18.743311 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.network.neutron [None req-00be4149-6e78-41b5-8b63-52b2a11c385a tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] deallocate_for_instance() {{(pid=122224) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1672}} Oct 27 15:59:18.854380 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-78764b7f-ccd0-4289-89a1-9e32919302bc tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 15:59:18.855402 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-78764b7f-ccd0-4289-89a1-9e32919302bc tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: 62c89161-c119-48b2-839d-712db798ff96] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:59:18.863963 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-78764b7f-ccd0-4289-89a1-9e32919302bc tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:59:18.864420 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-78764b7f-ccd0-4289-89a1-9e32919302bc tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:59:18.865209 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-78764b7f-ccd0-4289-89a1-9e32919302bc tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:59:18.865645 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-78764b7f-ccd0-4289-89a1-9e32919302bc tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:59:18.960659 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-78764b7f-ccd0-4289-89a1-9e32919302bc tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "POST /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/action" status: 200 len: 91131 microversion: 2.1 time: 0.110109 Oct 27 15:59:18.961264 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 724/1518] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Oct 27 15:59:18 2021] POST /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96/action => generated 91131 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 15:59:19.650948 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-f8ae44bb-b8a1-407f-b80d-b9dc709e2695 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:59:19.651894 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-f8ae44bb-b8a1-407f-b80d-b9dc709e2695 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] [instance: a79303e6-05ad-4901-96b7-ce845b4016f4] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:59:19.661960 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-f8ae44bb-b8a1-407f-b80d-b9dc709e2695 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:59:19.662945 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-f8ae44bb-b8a1-407f-b80d-b9dc709e2695 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:59:19.664477 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-f8ae44bb-b8a1-407f-b80d-b9dc709e2695 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:59:19.665216 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-f8ae44bb-b8a1-407f-b80d-b9dc709e2695 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:59:19.679667 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.wsgi [None req-f8ae44bb-b8a1-407f-b80d-b9dc709e2695 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] HTTP exception thrown: Instance a79303e6-05ad-4901-96b7-ce845b4016f4 could not be found. Oct 27 15:59:19.680475 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-f8ae44bb-b8a1-407f-b80d-b9dc709e2695 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Returning 404 to user: Instance a79303e6-05ad-4901-96b7-ce845b4016f4 could not be found. {{(pid=122225) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 27 15:59:19.681314 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-f8ae44bb-b8a1-407f-b80d-b9dc709e2695 tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] 10.222.0.64 "DELETE /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4" status: 404 len: 111 microversion: 2.1 time: 0.038156 Oct 27 15:59:19.681876 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 725/1519] 10.222.0.64 () {58 vars in 1238 bytes} [Wed Oct 27 15:59:19 2021] DELETE /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 27 15:59:19.693796 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-f1c72bb8-ac9c-4321-96f1-aba8761addfa tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:59:19.693796 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-f1c72bb8-ac9c-4321-96f1-aba8761addfa tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] [instance: a79303e6-05ad-4901-96b7-ce845b4016f4] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:59:19.698846 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-f1c72bb8-ac9c-4321-96f1-aba8761addfa tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:59:19.699298 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-f1c72bb8-ac9c-4321-96f1-aba8761addfa tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:59:19.701137 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-f1c72bb8-ac9c-4321-96f1-aba8761addfa tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:59:19.701569 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-f1c72bb8-ac9c-4321-96f1-aba8761addfa tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:59:19.715820 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.wsgi [None req-f1c72bb8-ac9c-4321-96f1-aba8761addfa tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] HTTP exception thrown: Instance a79303e6-05ad-4901-96b7-ce845b4016f4 could not be found. Oct 27 15:59:19.716431 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-f1c72bb8-ac9c-4321-96f1-aba8761addfa tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Returning 404 to user: Instance a79303e6-05ad-4901-96b7-ce845b4016f4 could not be found. {{(pid=122225) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 27 15:59:19.717262 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-f1c72bb8-ac9c-4321-96f1-aba8761addfa tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] 10.222.0.64 "GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4" status: 404 len: 111 microversion: 2.1 time: 0.030367 Oct 27 15:59:19.717806 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 726/1520] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 15:59:19 2021] GET /compute/v2.1/servers/a79303e6-05ad-4901-96b7-ce845b4016f4 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 27 15:59:20.064780 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.network.neutron [None req-00be4149-6e78-41b5-8b63-52b2a11c385a tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] Updating instance_info_cache with network_info: [] {{(pid=122224) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Oct 27 15:59:20.137492 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [req-4ed7fab4-d071-4fb3-b5a0-ec3a95f16182 req-0135519a-9b0d-4ffa-84a1-b837b01fc5a0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a115c672-012e-4e45-b5c9-4427e7b66672", "name": "network-vif-deleted", "tag": "c9ac335c-5a25-416c-803f-ac2f3d462176"}]} {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 15:59:20.139065 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 27 15:59:20.139065 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: warnings.warn(msg) Oct 27 15:59:20.149156 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [req-4ed7fab4-d071-4fb3-b5a0-ec3a95f16182 req-0135519a-9b0d-4ffa-84a1-b837b01fc5a0 service nova] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:59:20.149701 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [req-4ed7fab4-d071-4fb3-b5a0-ec3a95f16182 req-0135519a-9b0d-4ffa-84a1-b837b01fc5a0 service nova] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:59:20.161610 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.compute.server_external_events [req-4ed7fab4-d071-4fb3-b5a0-ec3a95f16182 req-0135519a-9b0d-4ffa-84a1-b837b01fc5a0 service nova] Unable to find a host for instance a115c672-012e-4e45-b5c9-4427e7b66672. Dropping event network-vif-deleted {{(pid=122225) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:138}} Oct 27 15:59:20.162514 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [req-4ed7fab4-d071-4fb3-b5a0-ec3a95f16182 req-0135519a-9b0d-4ffa-84a1-b837b01fc5a0 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.107019 Oct 27 15:59:20.163114 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 727/1521] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Oct 27 15:59:20 2021] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 108 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Oct 27 15:59:20.327132 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.scheduler.client.report [None req-00be4149-6e78-41b5-8b63-52b2a11c385a tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Deleted allocations for instance a115c672-012e-4e45-b5c9-4427e7b66672 Oct 27 15:59:20.470664 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-00be4149-6e78-41b5-8b63-52b2a11c385a tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "DELETE /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672" status: 204 len: 0 microversion: 2.20 time: 2.520379 Oct 27 15:59:20.471364 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 795/1522] 10.222.0.64 () {60 vars in 1279 bytes} [Wed Oct 27 15:59:17 2021] DELETE /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672 => generated 0 bytes in 2522 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 27 15:59:20.479734 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-e7370a2e-b199-45a0-8efa-d440493f16d8 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:59:20.480367 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-e7370a2e-b199-45a0-8efa-d440493f16d8 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:59:20.486869 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-e7370a2e-b199-45a0-8efa-d440493f16d8 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:59:20.487317 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-e7370a2e-b199-45a0-8efa-d440493f16d8 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:59:20.488110 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-e7370a2e-b199-45a0-8efa-d440493f16d8 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:59:20.488537 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-e7370a2e-b199-45a0-8efa-d440493f16d8 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:59:20.505520 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.wsgi [None req-e7370a2e-b199-45a0-8efa-d440493f16d8 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] HTTP exception thrown: Instance a115c672-012e-4e45-b5c9-4427e7b66672 could not be found. Oct 27 15:59:20.506130 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-e7370a2e-b199-45a0-8efa-d440493f16d8 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Returning 404 to user: Instance a115c672-012e-4e45-b5c9-4427e7b66672 could not be found. {{(pid=122225) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 27 15:59:20.506989 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-e7370a2e-b199-45a0-8efa-d440493f16d8 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672" status: 404 len: 111 microversion: 2.20 time: 0.031215 Oct 27 15:59:20.507534 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 728/1523] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Oct 27 15:59:20 2021] GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 27 15:59:20.517013 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-7a7b5635-341a-469d-80eb-bde699f80eb7 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Calling method '.version_select at 0x7fbc0604aa60>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:59:20.535587 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-7a7b5635-341a-469d-80eb-bde699f80eb7 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1925595656" status: 204 len: 0 microversion: 2.20 time: 0.023192 Oct 27 15:59:20.536127 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 796/1524] 10.222.0.64 () {60 vars in 1261 bytes} [Wed Oct 27 15:59:20 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1925595656 => generated 0 bytes in 25 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Oct 27 15:59:21.408724 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-bf486ac0-698f-4f66-89fa-9d0224bf8ece tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Action: 'create', calling method: .version_select at 0x7fbc067ba5e0>, body: {"keypair": {"name": "tempest-keypair-1671170217"}} {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 15:59:21.437682 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.quota [None req-bf486ac0-698f-4f66-89fa-9d0224bf8ece tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Getting quotas for project 230ec93c7707410da240669b0a3e26a0. Resources: {'key_pairs'} {{(pid=122225) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 27 15:59:21.441342 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.quota [None req-bf486ac0-698f-4f66-89fa-9d0224bf8ece tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Getting quotas for user ad48647323604612934a420a1accc6e8 and project 230ec93c7707410da240669b0a3e26a0. Resources: {'key_pairs'} {{(pid=122225) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 27 15:59:21.617361 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.quota [None req-bf486ac0-698f-4f66-89fa-9d0224bf8ece tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Getting quotas for project 230ec93c7707410da240669b0a3e26a0. Resources: {'key_pairs'} {{(pid=122225) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 27 15:59:21.621025 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.quota [None req-bf486ac0-698f-4f66-89fa-9d0224bf8ece tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Getting quotas for user ad48647323604612934a420a1accc6e8 and project 230ec93c7707410da240669b0a3e26a0. Resources: {'key_pairs'} {{(pid=122225) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 27 15:59:21.634611 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-bf486ac0-698f-4f66-89fa-9d0224bf8ece tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "POST /compute/v2.1/os-keypairs" status: 201 len: 2320 microversion: 2.20 time: 0.229683 Oct 27 15:59:21.635200 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 729/1525] 10.222.0.64 () {62 vars in 1198 bytes} [Wed Oct 27 15:59:21 2021] POST /compute/v2.1/os-keypairs => generated 2320 bytes in 231 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Oct 27 15:59:22.942352 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-82d4dee2-97bb-4328-965c-95d93b02b19d tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1185944054", "imageRef": "b585ffbc-6a36-48c9-81b3-e26f9bd0fcba", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "8d1899d8-4d9e-4203-b7a3-8e2aac0591d6"}], "security_groups": [{"name": "tempest-securitygroup--1431112569"}], "key_name": "tempest-keypair-1671170217", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 15:59:23.043339 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.network.neutron [None req-82d4dee2-97bb-4328-965c-95d93b02b19d tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] validate_networks() for [('8d1899d8-4d9e-4203-b7a3-8e2aac0591d6', None, None, None, None, None)] {{(pid=122224) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Oct 27 15:59:23.478957 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.virt.hardware [None req-82d4dee2-97bb-4328-965c-95d93b02b19d tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Flavor limits 0:0:0 {{(pid=122224) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 15:59:23.479385 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.virt.hardware [None req-82d4dee2-97bb-4328-965c-95d93b02b19d tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Image limits 0:0:0 {{(pid=122224) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 15:59:23.479875 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.virt.hardware [None req-82d4dee2-97bb-4328-965c-95d93b02b19d tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Flavor pref 0:0:0 {{(pid=122224) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 15:59:23.480297 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.virt.hardware [None req-82d4dee2-97bb-4328-965c-95d93b02b19d tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Image pref 0:0:0 {{(pid=122224) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 15:59:23.481604 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.virt.hardware [None req-82d4dee2-97bb-4328-965c-95d93b02b19d tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122224) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 15:59:23.490323 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-82d4dee2-97bb-4328-965c-95d93b02b19d tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:59:23.490772 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-82d4dee2-97bb-4328-965c-95d93b02b19d tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:59:23.491575 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-82d4dee2-97bb-4328-965c-95d93b02b19d tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:59:23.492118 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-82d4dee2-97bb-4328-965c-95d93b02b19d tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:59:23.508695 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.quota [None req-82d4dee2-97bb-4328-965c-95d93b02b19d tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Getting quotas for project 230ec93c7707410da240669b0a3e26a0. Resources: {'ram', 'instances', 'cores'} {{(pid=122224) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 27 15:59:23.513002 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.quota [None req-82d4dee2-97bb-4328-965c-95d93b02b19d tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Getting quotas for user ad48647323604612934a420a1accc6e8 and project 230ec93c7707410da240669b0a3e26a0. Resources: {'ram', 'instances', 'cores'} {{(pid=122224) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 27 15:59:23.523667 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-82d4dee2-97bb-4328-965c-95d93b02b19d tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Going to run 1 instances... {{(pid=122224) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Oct 27 15:59:23.526220 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-82d4dee2-97bb-4328-965c-95d93b02b19d tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: 9f9373f8-c3ad-4d3c-ac64-e5edf9cb4cd6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b585ffbc-6a36-48c9-81b3-e26f9bd0fcba',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122224) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Oct 27 15:59:23.572514 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-82d4dee2-97bb-4328-965c-95d93b02b19d tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.634145 Oct 27 15:59:23.573088 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 797/1526] 10.222.0.64 () {62 vars in 1187 bytes} [Wed Oct 27 15:59:22 2021] POST /compute/v2.1/servers => generated 402 bytes in 636 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 27 15:59:23.584013 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-1e38dfbd-6574-44b4-be79-2be5ac98254b tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:59:23.584748 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-1e38dfbd-6574-44b4-be79-2be5ac98254b tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: 9f9373f8-c3ad-4d3c-ac64-e5edf9cb4cd6] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:59:23.640892 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-1e38dfbd-6574-44b4-be79-2be5ac98254b tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:59:23.648677 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-1e38dfbd-6574-44b4-be79-2be5ac98254b tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:59:23.650198 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-1e38dfbd-6574-44b4-be79-2be5ac98254b tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:59:23.651300 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-1e38dfbd-6574-44b4-be79-2be5ac98254b tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "GET /compute/v2.1/servers/9f9373f8-c3ad-4d3c-ac64-e5edf9cb4cd6" status: 200 len: 1282 microversion: 2.20 time: 0.071680 Oct 27 15:59:23.651877 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 730/1527] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Oct 27 15:59:23 2021] GET /compute/v2.1/servers/9f9373f8-c3ad-4d3c-ac64-e5edf9cb4cd6 => generated 1282 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 15:59:24.671053 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-12e387c2-e921-43be-95a2-fba90f6f2094 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:59:24.671658 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-12e387c2-e921-43be-95a2-fba90f6f2094 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: 9f9373f8-c3ad-4d3c-ac64-e5edf9cb4cd6] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:59:24.679621 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-12e387c2-e921-43be-95a2-fba90f6f2094 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:59:24.680108 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-12e387c2-e921-43be-95a2-fba90f6f2094 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:59:24.680933 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-12e387c2-e921-43be-95a2-fba90f6f2094 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:59:24.681375 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-12e387c2-e921-43be-95a2-fba90f6f2094 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:59:24.763659 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-12e387c2-e921-43be-95a2-fba90f6f2094 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:59:24.771502 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-12e387c2-e921-43be-95a2-fba90f6f2094 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:59:24.773071 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-12e387c2-e921-43be-95a2-fba90f6f2094 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:59:24.774170 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-12e387c2-e921-43be-95a2-fba90f6f2094 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "GET /compute/v2.1/servers/9f9373f8-c3ad-4d3c-ac64-e5edf9cb4cd6" status: 200 len: 1340 microversion: 2.20 time: 0.107521 Oct 27 15:59:24.774733 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 798/1528] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Oct 27 15:59:24 2021] GET /compute/v2.1/servers/9f9373f8-c3ad-4d3c-ac64-e5edf9cb4cd6 => generated 1340 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 15:59:25.791602 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-90a31471-86c1-481f-bdf0-1bfd6bd4047d tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:59:25.792328 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-90a31471-86c1-481f-bdf0-1bfd6bd4047d tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: 9f9373f8-c3ad-4d3c-ac64-e5edf9cb4cd6] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:59:25.802460 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-90a31471-86c1-481f-bdf0-1bfd6bd4047d tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:59:25.802904 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-90a31471-86c1-481f-bdf0-1bfd6bd4047d tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:59:25.803889 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-90a31471-86c1-481f-bdf0-1bfd6bd4047d tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:59:25.804684 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-90a31471-86c1-481f-bdf0-1bfd6bd4047d tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:59:25.935014 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-90a31471-86c1-481f-bdf0-1bfd6bd4047d tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:59:25.953547 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-90a31471-86c1-481f-bdf0-1bfd6bd4047d tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:59:25.956278 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-90a31471-86c1-481f-bdf0-1bfd6bd4047d tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:59:25.957433 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-90a31471-86c1-481f-bdf0-1bfd6bd4047d tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "GET /compute/v2.1/servers/9f9373f8-c3ad-4d3c-ac64-e5edf9cb4cd6" status: 200 len: 1408 microversion: 2.20 time: 0.169647 Oct 27 15:59:25.969393 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 731/1529] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Oct 27 15:59:25 2021] GET /compute/v2.1/servers/9f9373f8-c3ad-4d3c-ac64-e5edf9cb4cd6 => generated 1408 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 15:59:25.969692 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [req-836c6b9a-98e2-4155-96c2-ba5921f45487 req-f5ceccd7-9131-4d96-97bd-df621df209a5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9f9373f8-c3ad-4d3c-ac64-e5edf9cb4cd6", "tag": "43a7889c-6014-4503-ab2d-82b1da4e36bd"}]} {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 15:59:25.969692 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 27 15:59:25.969692 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: warnings.warn(msg) Oct 27 15:59:25.969692 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [req-836c6b9a-98e2-4155-96c2-ba5921f45487 req-f5ceccd7-9131-4d96-97bd-df621df209a5 service nova] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:59:25.969692 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [req-836c6b9a-98e2-4155-96c2-ba5921f45487 req-f5ceccd7-9131-4d96-97bd-df621df209a5 service nova] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:59:25.983924 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.compute.server_external_events [req-836c6b9a-98e2-4155-96c2-ba5921f45487 req-f5ceccd7-9131-4d96-97bd-df621df209a5 service nova] Creating event network-changed:43a7889c-6014-4503-ab2d-82b1da4e36bd for instance 9f9373f8-c3ad-4d3c-ac64-e5edf9cb4cd6 on hv-cinder-80070 Oct 27 15:59:25.987673 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: ERROR oslo.messaging._drivers.impl_rabbit [req-836c6b9a-98e2-4155-96c2-ba5921f45487 req-f5ceccd7-9131-4d96-97bd-df621df209a5 service nova] [c878c084-90cb-4c2e-925f-63d625b899c3] AMQP server on 10.222.0.64:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 27 15:59:26.976831 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-96d5aff9-e821-434b-90dc-bcd1c15a279e tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:59:26.977431 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-96d5aff9-e821-434b-90dc-bcd1c15a279e tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: 9f9373f8-c3ad-4d3c-ac64-e5edf9cb4cd6] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:59:26.984300 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-96d5aff9-e821-434b-90dc-bcd1c15a279e tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:59:26.984767 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-96d5aff9-e821-434b-90dc-bcd1c15a279e tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:59:26.985557 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-96d5aff9-e821-434b-90dc-bcd1c15a279e tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:59:26.985983 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-96d5aff9-e821-434b-90dc-bcd1c15a279e tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:59:27.004213 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO oslo.messaging._drivers.impl_rabbit [req-836c6b9a-98e2-4155-96c2-ba5921f45487 req-f5ceccd7-9131-4d96-97bd-df621df209a5 service nova] [c878c084-90cb-4c2e-925f-63d625b899c3] Reconnected to AMQP server on 10.222.0.64:5672 via [amqp] client with port 41358. Oct 27 15:59:27.009352 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [req-836c6b9a-98e2-4155-96c2-ba5921f45487 req-f5ceccd7-9131-4d96-97bd-df621df209a5 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 1.054375 Oct 27 15:59:27.010510 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 799/1530] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Oct 27 15:59:25 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 1056 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 15:59:27.117012 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-96d5aff9-e821-434b-90dc-bcd1c15a279e tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:59:27.126197 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-96d5aff9-e821-434b-90dc-bcd1c15a279e tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:59:27.127720 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-96d5aff9-e821-434b-90dc-bcd1c15a279e tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:59:27.132870 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-96d5aff9-e821-434b-90dc-bcd1c15a279e tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "GET /compute/v2.1/servers/9f9373f8-c3ad-4d3c-ac64-e5edf9cb4cd6" status: 200 len: 1408 microversion: 2.20 time: 0.155777 Oct 27 15:59:27.132870 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 732/1531] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Oct 27 15:59:26 2021] GET /compute/v2.1/servers/9f9373f8-c3ad-4d3c-ac64-e5edf9cb4cd6 => generated 1408 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 15:59:28.148457 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-b4aa3bf8-3f70-4cb3-9d65-58c905fad1b8 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:59:28.149148 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-b4aa3bf8-3f70-4cb3-9d65-58c905fad1b8 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: 9f9373f8-c3ad-4d3c-ac64-e5edf9cb4cd6] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:59:28.156007 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-b4aa3bf8-3f70-4cb3-9d65-58c905fad1b8 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:59:28.156453 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-b4aa3bf8-3f70-4cb3-9d65-58c905fad1b8 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:59:28.157222 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-b4aa3bf8-3f70-4cb3-9d65-58c905fad1b8 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:59:28.157661 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-b4aa3bf8-3f70-4cb3-9d65-58c905fad1b8 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:59:28.288163 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-b4aa3bf8-3f70-4cb3-9d65-58c905fad1b8 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:59:28.297791 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-b4aa3bf8-3f70-4cb3-9d65-58c905fad1b8 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:59:28.299273 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-b4aa3bf8-3f70-4cb3-9d65-58c905fad1b8 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:59:28.300421 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-b4aa3bf8-3f70-4cb3-9d65-58c905fad1b8 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "GET /compute/v2.1/servers/9f9373f8-c3ad-4d3c-ac64-e5edf9cb4cd6" status: 200 len: 1408 microversion: 2.20 time: 0.156547 Oct 27 15:59:28.300980 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 800/1532] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Oct 27 15:59:28 2021] GET /compute/v2.1/servers/9f9373f8-c3ad-4d3c-ac64-e5edf9cb4cd6 => generated 1408 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 15:59:29.318331 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-430efd9d-88a5-4538-9441-1e6309d642af tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:59:29.319079 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-430efd9d-88a5-4538-9441-1e6309d642af tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: 9f9373f8-c3ad-4d3c-ac64-e5edf9cb4cd6] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:59:29.326229 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-430efd9d-88a5-4538-9441-1e6309d642af tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:59:29.326677 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-430efd9d-88a5-4538-9441-1e6309d642af tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:59:29.327455 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-430efd9d-88a5-4538-9441-1e6309d642af tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:59:29.327923 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-430efd9d-88a5-4538-9441-1e6309d642af tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:59:29.456170 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-430efd9d-88a5-4538-9441-1e6309d642af tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:59:29.463773 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-430efd9d-88a5-4538-9441-1e6309d642af tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:59:29.466213 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-430efd9d-88a5-4538-9441-1e6309d642af tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:59:29.467228 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-430efd9d-88a5-4538-9441-1e6309d642af tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "GET /compute/v2.1/servers/9f9373f8-c3ad-4d3c-ac64-e5edf9cb4cd6" status: 200 len: 1408 microversion: 2.20 time: 0.152616 Oct 27 15:59:29.467778 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 733/1533] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Oct 27 15:59:29 2021] GET /compute/v2.1/servers/9f9373f8-c3ad-4d3c-ac64-e5edf9cb4cd6 => generated 1408 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 15:59:30.360106 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [req-7a2e562c-260f-445e-89d2-8aca57c83c16 req-163045b8-eb24-4c52-b7bc-df61df8b17c9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9f9373f8-c3ad-4d3c-ac64-e5edf9cb4cd6", "name": "network-vif-plugged", "status": "completed", "tag": "43a7889c-6014-4503-ab2d-82b1da4e36bd"}]} {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 15:59:30.361631 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 27 15:59:30.361631 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: warnings.warn(msg) Oct 27 15:59:30.369164 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [req-7a2e562c-260f-445e-89d2-8aca57c83c16 req-163045b8-eb24-4c52-b7bc-df61df8b17c9 service nova] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:59:30.369608 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [req-7a2e562c-260f-445e-89d2-8aca57c83c16 req-163045b8-eb24-4c52-b7bc-df61df8b17c9 service nova] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:59:30.381015 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.compute.server_external_events [req-7a2e562c-260f-445e-89d2-8aca57c83c16 req-163045b8-eb24-4c52-b7bc-df61df8b17c9 service nova] Creating event network-vif-plugged:43a7889c-6014-4503-ab2d-82b1da4e36bd for instance 9f9373f8-c3ad-4d3c-ac64-e5edf9cb4cd6 on hv-cinder-80070 Oct 27 15:59:30.386860 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [req-7a2e562c-260f-445e-89d2-8aca57c83c16 req-163045b8-eb24-4c52-b7bc-df61df8b17c9 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094007 Oct 27 15:59:30.388536 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 801/1534] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Oct 27 15:59:30 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 15:59:30.486052 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-b697e3cc-64a6-427a-ab02-11275ff56b83 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:59:30.486775 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-b697e3cc-64a6-427a-ab02-11275ff56b83 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: 9f9373f8-c3ad-4d3c-ac64-e5edf9cb4cd6] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:59:30.492839 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-b697e3cc-64a6-427a-ab02-11275ff56b83 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:59:30.493281 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-b697e3cc-64a6-427a-ab02-11275ff56b83 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:59:30.494048 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-b697e3cc-64a6-427a-ab02-11275ff56b83 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:59:30.494480 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-b697e3cc-64a6-427a-ab02-11275ff56b83 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:59:30.624300 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-b697e3cc-64a6-427a-ab02-11275ff56b83 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:59:30.631956 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-b697e3cc-64a6-427a-ab02-11275ff56b83 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:59:30.633676 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-b697e3cc-64a6-427a-ab02-11275ff56b83 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:59:30.634778 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-b697e3cc-64a6-427a-ab02-11275ff56b83 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "GET /compute/v2.1/servers/9f9373f8-c3ad-4d3c-ac64-e5edf9cb4cd6" status: 200 len: 1408 microversion: 2.20 time: 0.152492 Oct 27 15:59:30.635322 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 734/1535] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Oct 27 15:59:30 2021] GET /compute/v2.1/servers/9f9373f8-c3ad-4d3c-ac64-e5edf9cb4cd6 => generated 1408 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 15:59:31.658674 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-3a5041d9-80ae-4b34-8f39-7047af53e037 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:59:31.659612 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-3a5041d9-80ae-4b34-8f39-7047af53e037 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: 9f9373f8-c3ad-4d3c-ac64-e5edf9cb4cd6] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:59:31.666207 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-3a5041d9-80ae-4b34-8f39-7047af53e037 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:59:31.666641 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-3a5041d9-80ae-4b34-8f39-7047af53e037 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:59:31.667624 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-3a5041d9-80ae-4b34-8f39-7047af53e037 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:59:31.668632 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-3a5041d9-80ae-4b34-8f39-7047af53e037 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:59:31.799672 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-3a5041d9-80ae-4b34-8f39-7047af53e037 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:59:31.807955 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-3a5041d9-80ae-4b34-8f39-7047af53e037 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:59:31.810015 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-3a5041d9-80ae-4b34-8f39-7047af53e037 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:59:31.811131 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-3a5041d9-80ae-4b34-8f39-7047af53e037 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "GET /compute/v2.1/servers/9f9373f8-c3ad-4d3c-ac64-e5edf9cb4cd6" status: 200 len: 1408 microversion: 2.20 time: 0.159253 Oct 27 15:59:31.811693 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 802/1536] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Oct 27 15:59:31 2021] GET /compute/v2.1/servers/9f9373f8-c3ad-4d3c-ac64-e5edf9cb4cd6 => generated 1408 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 15:59:32.830598 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-39be0bbc-2247-485b-8c71-16cb61aaf0d1 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:59:32.831286 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-39be0bbc-2247-485b-8c71-16cb61aaf0d1 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: 9f9373f8-c3ad-4d3c-ac64-e5edf9cb4cd6] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:59:32.839211 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-39be0bbc-2247-485b-8c71-16cb61aaf0d1 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:59:32.840339 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-39be0bbc-2247-485b-8c71-16cb61aaf0d1 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:59:32.843632 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-39be0bbc-2247-485b-8c71-16cb61aaf0d1 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:59:32.843632 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-39be0bbc-2247-485b-8c71-16cb61aaf0d1 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:59:32.977085 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-39be0bbc-2247-485b-8c71-16cb61aaf0d1 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:59:32.985949 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-39be0bbc-2247-485b-8c71-16cb61aaf0d1 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:59:32.988215 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-39be0bbc-2247-485b-8c71-16cb61aaf0d1 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 15:59:32.988746 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-39be0bbc-2247-485b-8c71-16cb61aaf0d1 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "GET /compute/v2.1/servers/9f9373f8-c3ad-4d3c-ac64-e5edf9cb4cd6" status: 200 len: 1601 microversion: 2.20 time: 0.162048 Oct 27 15:59:32.989733 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 735/1537] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Oct 27 15:59:32 2021] GET /compute/v2.1/servers/9f9373f8-c3ad-4d3c-ac64-e5edf9cb4cd6 => generated 1601 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 15:59:33.006814 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-ce07384f-0cc0-40c1-ba20-553f8432c6db tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 15:59:33.007386 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-ce07384f-0cc0-40c1-ba20-553f8432c6db tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: 9f9373f8-c3ad-4d3c-ac64-e5edf9cb4cd6] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:59:33.014282 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-ce07384f-0cc0-40c1-ba20-553f8432c6db tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:59:33.014718 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-ce07384f-0cc0-40c1-ba20-553f8432c6db tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:59:33.015490 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-ce07384f-0cc0-40c1-ba20-553f8432c6db tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:59:33.015959 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-ce07384f-0cc0-40c1-ba20-553f8432c6db tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:59:33.116910 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-ce07384f-0cc0-40c1-ba20-553f8432c6db tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "GET /compute/v2.1/servers/9f9373f8-c3ad-4d3c-ac64-e5edf9cb4cd6/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.113806 Oct 27 15:59:33.117560 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 803/1538] 10.222.0.64 () {60 vars in 1315 bytes} [Wed Oct 27 15:59:33 2021] GET /compute/v2.1/servers/9f9373f8-c3ad-4d3c-ac64-e5edf9cb4cd6/os-interface => generated 285 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 15:59:34.575826 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-1b4d35e0-264b-452b-90aa-33504d0ecaf8 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 15:59:34.579808 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-1b4d35e0-264b-452b-90aa-33504d0ecaf8 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: 9f9373f8-c3ad-4d3c-ac64-e5edf9cb4cd6] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:59:34.586993 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-1b4d35e0-264b-452b-90aa-33504d0ecaf8 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:59:34.587895 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-1b4d35e0-264b-452b-90aa-33504d0ecaf8 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:59:34.589275 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-1b4d35e0-264b-452b-90aa-33504d0ecaf8 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:59:34.590529 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-1b4d35e0-264b-452b-90aa-33504d0ecaf8 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:59:34.644045 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [req-014c3c28-398d-4662-b426-d8cd5461df85 req-7dbdcd35-a81f-4ecd-a293-1ea8b377acd9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9f9373f8-c3ad-4d3c-ac64-e5edf9cb4cd6", "tag": "43a7889c-6014-4503-ab2d-82b1da4e36bd"}]} {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 15:59:34.645937 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 27 15:59:34.645937 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: warnings.warn(msg) Oct 27 15:59:34.652829 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [req-014c3c28-398d-4662-b426-d8cd5461df85 req-7dbdcd35-a81f-4ecd-a293-1ea8b377acd9 service nova] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:59:34.653232 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [req-014c3c28-398d-4662-b426-d8cd5461df85 req-7dbdcd35-a81f-4ecd-a293-1ea8b377acd9 service nova] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:59:34.661303 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-1b4d35e0-264b-452b-90aa-33504d0ecaf8 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "POST /compute/v2.1/servers/9f9373f8-c3ad-4d3c-ac64-e5edf9cb4cd6/action" status: 200 len: 14 microversion: 2.20 time: 0.093361 Oct 27 15:59:34.663027 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 736/1539] 10.222.0.64 () {62 vars in 1318 bytes} [Wed Oct 27 15:59:34 2021] POST /compute/v2.1/servers/9f9373f8-c3ad-4d3c-ac64-e5edf9cb4cd6/action => generated 14 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 15:59:34.667117 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.compute.server_external_events [req-014c3c28-398d-4662-b426-d8cd5461df85 req-7dbdcd35-a81f-4ecd-a293-1ea8b377acd9 service nova] Creating event network-changed:43a7889c-6014-4503-ab2d-82b1da4e36bd for instance 9f9373f8-c3ad-4d3c-ac64-e5edf9cb4cd6 on hv-cinder-80070 Oct 27 15:59:34.672844 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [req-014c3c28-398d-4662-b426-d8cd5461df85 req-7dbdcd35-a81f-4ecd-a293-1ea8b377acd9 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.101937 Oct 27 15:59:34.673732 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 804/1540] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Oct 27 15:59:34 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 15:59:35.673255 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-69e10696-8813-4199-8745-c62a2b4d70a9 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 15:59:35.674279 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-69e10696-8813-4199-8745-c62a2b4d70a9 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: 9f9373f8-c3ad-4d3c-ac64-e5edf9cb4cd6] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:59:35.682222 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-69e10696-8813-4199-8745-c62a2b4d70a9 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:59:35.682740 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-69e10696-8813-4199-8745-c62a2b4d70a9 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:59:35.684200 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-69e10696-8813-4199-8745-c62a2b4d70a9 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:59:35.684687 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-69e10696-8813-4199-8745-c62a2b4d70a9 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:59:35.753569 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-69e10696-8813-4199-8745-c62a2b4d70a9 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "POST /compute/v2.1/servers/9f9373f8-c3ad-4d3c-ac64-e5edf9cb4cd6/action" status: 200 len: 14 microversion: 2.20 time: 0.084168 Oct 27 15:59:35.754271 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 737/1541] 10.222.0.64 () {62 vars in 1318 bytes} [Wed Oct 27 15:59:35 2021] POST /compute/v2.1/servers/9f9373f8-c3ad-4d3c-ac64-e5edf9cb4cd6/action => generated 14 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 15:59:36.765081 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-bcdede05-d958-41f6-960f-bf7e83746b31 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 15:59:36.766071 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-bcdede05-d958-41f6-960f-bf7e83746b31 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: 9f9373f8-c3ad-4d3c-ac64-e5edf9cb4cd6] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:59:36.772533 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-bcdede05-d958-41f6-960f-bf7e83746b31 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:59:36.772975 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-bcdede05-d958-41f6-960f-bf7e83746b31 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:59:36.774043 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-bcdede05-d958-41f6-960f-bf7e83746b31 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:59:36.774468 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-bcdede05-d958-41f6-960f-bf7e83746b31 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:59:36.842974 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-bcdede05-d958-41f6-960f-bf7e83746b31 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "POST /compute/v2.1/servers/9f9373f8-c3ad-4d3c-ac64-e5edf9cb4cd6/action" status: 200 len: 14 microversion: 2.20 time: 0.082150 Oct 27 15:59:36.844335 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 805/1542] 10.222.0.64 () {62 vars in 1318 bytes} [Wed Oct 27 15:59:36 2021] POST /compute/v2.1/servers/9f9373f8-c3ad-4d3c-ac64-e5edf9cb4cd6/action => generated 14 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 15:59:37.854459 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-9ec0c9b7-a555-45e9-a92a-f823b7a67ae2 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 15:59:37.856628 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-9ec0c9b7-a555-45e9-a92a-f823b7a67ae2 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: 9f9373f8-c3ad-4d3c-ac64-e5edf9cb4cd6] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:59:37.863563 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-9ec0c9b7-a555-45e9-a92a-f823b7a67ae2 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:59:37.864038 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-9ec0c9b7-a555-45e9-a92a-f823b7a67ae2 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:59:37.864811 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-9ec0c9b7-a555-45e9-a92a-f823b7a67ae2 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:59:37.865247 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-9ec0c9b7-a555-45e9-a92a-f823b7a67ae2 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:59:37.929359 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-9ec0c9b7-a555-45e9-a92a-f823b7a67ae2 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "POST /compute/v2.1/servers/9f9373f8-c3ad-4d3c-ac64-e5edf9cb4cd6/action" status: 200 len: 14 microversion: 2.20 time: 0.078836 Oct 27 15:59:37.930182 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 738/1543] 10.222.0.64 () {62 vars in 1318 bytes} [Wed Oct 27 15:59:37 2021] POST /compute/v2.1/servers/9f9373f8-c3ad-4d3c-ac64-e5edf9cb4cd6/action => generated 14 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 15:59:38.941148 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-02776886-c1e5-45b1-b349-f61b13f03d99 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 15:59:38.942126 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-02776886-c1e5-45b1-b349-f61b13f03d99 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: 9f9373f8-c3ad-4d3c-ac64-e5edf9cb4cd6] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:59:38.949198 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-02776886-c1e5-45b1-b349-f61b13f03d99 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:59:38.949637 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-02776886-c1e5-45b1-b349-f61b13f03d99 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:59:38.950406 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-02776886-c1e5-45b1-b349-f61b13f03d99 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:59:38.950830 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-02776886-c1e5-45b1-b349-f61b13f03d99 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:59:39.008171 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-02776886-c1e5-45b1-b349-f61b13f03d99 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "POST /compute/v2.1/servers/9f9373f8-c3ad-4d3c-ac64-e5edf9cb4cd6/action" status: 200 len: 14 microversion: 2.20 time: 0.070925 Oct 27 15:59:39.008805 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 806/1544] 10.222.0.64 () {62 vars in 1318 bytes} [Wed Oct 27 15:59:38 2021] POST /compute/v2.1/servers/9f9373f8-c3ad-4d3c-ac64-e5edf9cb4cd6/action => generated 14 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 15:59:40.019382 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-3a3ffa33-de53-4a20-b2b0-fcab8931806a tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 15:59:40.020403 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-3a3ffa33-de53-4a20-b2b0-fcab8931806a tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: 9f9373f8-c3ad-4d3c-ac64-e5edf9cb4cd6] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:59:40.027805 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-3a3ffa33-de53-4a20-b2b0-fcab8931806a tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:59:40.028276 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-3a3ffa33-de53-4a20-b2b0-fcab8931806a tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:59:40.029046 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-3a3ffa33-de53-4a20-b2b0-fcab8931806a tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:59:40.029482 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-3a3ffa33-de53-4a20-b2b0-fcab8931806a tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:59:40.087385 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-3a3ffa33-de53-4a20-b2b0-fcab8931806a tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "POST /compute/v2.1/servers/9f9373f8-c3ad-4d3c-ac64-e5edf9cb4cd6/action" status: 200 len: 14 microversion: 2.20 time: 0.071878 Oct 27 15:59:40.091444 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 739/1545] 10.222.0.64 () {62 vars in 1318 bytes} [Wed Oct 27 15:59:40 2021] POST /compute/v2.1/servers/9f9373f8-c3ad-4d3c-ac64-e5edf9cb4cd6/action => generated 14 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 15:59:41.099570 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-21670c81-3ddd-4dd8-94bf-0f0c0a1bb482 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 15:59:41.100593 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-21670c81-3ddd-4dd8-94bf-0f0c0a1bb482 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: 9f9373f8-c3ad-4d3c-ac64-e5edf9cb4cd6] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:59:41.107663 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-21670c81-3ddd-4dd8-94bf-0f0c0a1bb482 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:59:41.108140 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-21670c81-3ddd-4dd8-94bf-0f0c0a1bb482 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:59:41.108920 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-21670c81-3ddd-4dd8-94bf-0f0c0a1bb482 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:59:41.109356 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-21670c81-3ddd-4dd8-94bf-0f0c0a1bb482 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:59:41.167979 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-21670c81-3ddd-4dd8-94bf-0f0c0a1bb482 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "POST /compute/v2.1/servers/9f9373f8-c3ad-4d3c-ac64-e5edf9cb4cd6/action" status: 200 len: 14 microversion: 2.20 time: 0.072383 Oct 27 15:59:41.168761 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 807/1546] 10.222.0.64 () {62 vars in 1318 bytes} [Wed Oct 27 15:59:41 2021] POST /compute/v2.1/servers/9f9373f8-c3ad-4d3c-ac64-e5edf9cb4cd6/action => generated 14 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 15:59:42.179353 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-b2919396-b3ca-49ca-aa19-d4cc96a9eacc tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 15:59:42.180359 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-b2919396-b3ca-49ca-aa19-d4cc96a9eacc tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: 9f9373f8-c3ad-4d3c-ac64-e5edf9cb4cd6] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:59:42.188613 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-b2919396-b3ca-49ca-aa19-d4cc96a9eacc tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:59:42.189625 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-b2919396-b3ca-49ca-aa19-d4cc96a9eacc tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:59:42.189736 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-b2919396-b3ca-49ca-aa19-d4cc96a9eacc tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:59:42.190159 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-b2919396-b3ca-49ca-aa19-d4cc96a9eacc tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:59:42.254863 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-b2919396-b3ca-49ca-aa19-d4cc96a9eacc tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "POST /compute/v2.1/servers/9f9373f8-c3ad-4d3c-ac64-e5edf9cb4cd6/action" status: 200 len: 14 microversion: 2.20 time: 0.079354 Oct 27 15:59:42.255501 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 740/1547] 10.222.0.64 () {62 vars in 1318 bytes} [Wed Oct 27 15:59:42 2021] POST /compute/v2.1/servers/9f9373f8-c3ad-4d3c-ac64-e5edf9cb4cd6/action => generated 14 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 15:59:43.266597 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-9605432b-1d07-4649-874a-93cbd047594e tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 15:59:43.267616 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-9605432b-1d07-4649-874a-93cbd047594e tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: 9f9373f8-c3ad-4d3c-ac64-e5edf9cb4cd6] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:59:43.274642 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-9605432b-1d07-4649-874a-93cbd047594e tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:59:43.275084 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-9605432b-1d07-4649-874a-93cbd047594e tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:59:43.275840 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-9605432b-1d07-4649-874a-93cbd047594e tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:59:43.276294 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-9605432b-1d07-4649-874a-93cbd047594e tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:59:43.335769 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-9605432b-1d07-4649-874a-93cbd047594e tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "POST /compute/v2.1/servers/9f9373f8-c3ad-4d3c-ac64-e5edf9cb4cd6/action" status: 200 len: 14 microversion: 2.20 time: 0.073022 Oct 27 15:59:43.336418 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 808/1548] 10.222.0.64 () {62 vars in 1318 bytes} [Wed Oct 27 15:59:43 2021] POST /compute/v2.1/servers/9f9373f8-c3ad-4d3c-ac64-e5edf9cb4cd6/action => generated 14 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 15:59:44.347630 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-5e624277-fe8f-480f-8c06-5d5a21213954 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 15:59:44.348687 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-5e624277-fe8f-480f-8c06-5d5a21213954 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: 9f9373f8-c3ad-4d3c-ac64-e5edf9cb4cd6] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:59:44.356137 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-5e624277-fe8f-480f-8c06-5d5a21213954 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:59:44.356607 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-5e624277-fe8f-480f-8c06-5d5a21213954 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:59:44.357614 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-5e624277-fe8f-480f-8c06-5d5a21213954 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:59:44.357947 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-5e624277-fe8f-480f-8c06-5d5a21213954 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:59:44.436241 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-5e624277-fe8f-480f-8c06-5d5a21213954 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "POST /compute/v2.1/servers/9f9373f8-c3ad-4d3c-ac64-e5edf9cb4cd6/action" status: 200 len: 12758 microversion: 2.20 time: 0.092676 Oct 27 15:59:44.436919 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 741/1549] 10.222.0.64 () {62 vars in 1318 bytes} [Wed Oct 27 15:59:44 2021] POST /compute/v2.1/servers/9f9373f8-c3ad-4d3c-ac64-e5edf9cb4cd6/action => generated 12758 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 27 15:59:45.447143 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-47f96cd5-87c5-49ec-9ff9-5793c4803860 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 15:59:45.448164 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-47f96cd5-87c5-49ec-9ff9-5793c4803860 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: 9f9373f8-c3ad-4d3c-ac64-e5edf9cb4cd6] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:59:45.455599 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-47f96cd5-87c5-49ec-9ff9-5793c4803860 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:59:45.456072 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-47f96cd5-87c5-49ec-9ff9-5793c4803860 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:59:45.456836 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-47f96cd5-87c5-49ec-9ff9-5793c4803860 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:59:45.457265 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-47f96cd5-87c5-49ec-9ff9-5793c4803860 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:59:45.536309 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-47f96cd5-87c5-49ec-9ff9-5793c4803860 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "POST /compute/v2.1/servers/9f9373f8-c3ad-4d3c-ac64-e5edf9cb4cd6/action" status: 200 len: 18449 microversion: 2.20 time: 0.093054 Oct 27 15:59:45.536984 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 809/1550] 10.222.0.64 () {62 vars in 1318 bytes} [Wed Oct 27 15:59:45 2021] POST /compute/v2.1/servers/9f9373f8-c3ad-4d3c-ac64-e5edf9cb4cd6/action => generated 18449 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 27 15:59:46.550356 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-e879deed-e516-4c6e-a651-f1ad04e1b938 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 15:59:46.551370 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-e879deed-e516-4c6e-a651-f1ad04e1b938 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: 9f9373f8-c3ad-4d3c-ac64-e5edf9cb4cd6] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:59:46.558182 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-e879deed-e516-4c6e-a651-f1ad04e1b938 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:59:46.559284 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-e879deed-e516-4c6e-a651-f1ad04e1b938 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:59:46.560096 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-e879deed-e516-4c6e-a651-f1ad04e1b938 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:59:46.560526 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-e879deed-e516-4c6e-a651-f1ad04e1b938 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:59:46.630528 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-e879deed-e516-4c6e-a651-f1ad04e1b938 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "POST /compute/v2.1/servers/9f9373f8-c3ad-4d3c-ac64-e5edf9cb4cd6/action" status: 200 len: 19342 microversion: 2.20 time: 0.085344 Oct 27 15:59:46.631166 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 742/1551] 10.222.0.64 () {62 vars in 1318 bytes} [Wed Oct 27 15:59:46 2021] POST /compute/v2.1/servers/9f9373f8-c3ad-4d3c-ac64-e5edf9cb4cd6/action => generated 19342 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 27 15:59:47.642868 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-fbdb4dc0-68d6-44eb-a265-311071897a5d tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 15:59:47.643876 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-fbdb4dc0-68d6-44eb-a265-311071897a5d tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: 9f9373f8-c3ad-4d3c-ac64-e5edf9cb4cd6] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:59:47.650672 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-fbdb4dc0-68d6-44eb-a265-311071897a5d tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:59:47.651118 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-fbdb4dc0-68d6-44eb-a265-311071897a5d tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:59:47.652409 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-fbdb4dc0-68d6-44eb-a265-311071897a5d tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:59:47.652904 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-fbdb4dc0-68d6-44eb-a265-311071897a5d tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:59:47.727559 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-fbdb4dc0-68d6-44eb-a265-311071897a5d tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "POST /compute/v2.1/servers/9f9373f8-c3ad-4d3c-ac64-e5edf9cb4cd6/action" status: 200 len: 22021 microversion: 2.20 time: 0.088527 Oct 27 15:59:47.728095 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 810/1552] 10.222.0.64 () {62 vars in 1318 bytes} [Wed Oct 27 15:59:47 2021] POST /compute/v2.1/servers/9f9373f8-c3ad-4d3c-ac64-e5edf9cb4cd6/action => generated 22021 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 27 15:59:48.739287 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-8b0cbaee-7502-475e-a588-fa28fe0f6010 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 15:59:48.740401 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-8b0cbaee-7502-475e-a588-fa28fe0f6010 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: 9f9373f8-c3ad-4d3c-ac64-e5edf9cb4cd6] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:59:48.747313 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-8b0cbaee-7502-475e-a588-fa28fe0f6010 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:59:48.747687 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-8b0cbaee-7502-475e-a588-fa28fe0f6010 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:59:48.748473 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-8b0cbaee-7502-475e-a588-fa28fe0f6010 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:59:48.748898 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-8b0cbaee-7502-475e-a588-fa28fe0f6010 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:59:48.821958 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-8b0cbaee-7502-475e-a588-fa28fe0f6010 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "POST /compute/v2.1/servers/9f9373f8-c3ad-4d3c-ac64-e5edf9cb4cd6/action" status: 200 len: 23235 microversion: 2.20 time: 0.086537 Oct 27 15:59:48.822589 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 743/1553] 10.222.0.64 () {62 vars in 1318 bytes} [Wed Oct 27 15:59:48 2021] POST /compute/v2.1/servers/9f9373f8-c3ad-4d3c-ac64-e5edf9cb4cd6/action => generated 23235 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 27 15:59:49.834911 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-1081f7e3-72dc-44e0-aba5-efbfec0cde86 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 15:59:49.835799 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-1081f7e3-72dc-44e0-aba5-efbfec0cde86 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: 9f9373f8-c3ad-4d3c-ac64-e5edf9cb4cd6] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:59:49.842871 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-1081f7e3-72dc-44e0-aba5-efbfec0cde86 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:59:49.843309 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-1081f7e3-72dc-44e0-aba5-efbfec0cde86 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:59:49.844100 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-1081f7e3-72dc-44e0-aba5-efbfec0cde86 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:59:49.844533 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-1081f7e3-72dc-44e0-aba5-efbfec0cde86 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:59:49.915596 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-1081f7e3-72dc-44e0-aba5-efbfec0cde86 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "POST /compute/v2.1/servers/9f9373f8-c3ad-4d3c-ac64-e5edf9cb4cd6/action" status: 200 len: 25026 microversion: 2.20 time: 0.084695 Oct 27 15:59:49.916396 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 811/1554] 10.222.0.64 () {62 vars in 1318 bytes} [Wed Oct 27 15:59:49 2021] POST /compute/v2.1/servers/9f9373f8-c3ad-4d3c-ac64-e5edf9cb4cd6/action => generated 25026 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 27 15:59:50.927077 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-314efb35-7325-4c38-88bb-fac9508dcc27 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 15:59:50.928100 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-314efb35-7325-4c38-88bb-fac9508dcc27 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: 9f9373f8-c3ad-4d3c-ac64-e5edf9cb4cd6] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:59:50.935075 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-314efb35-7325-4c38-88bb-fac9508dcc27 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:59:50.935515 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-314efb35-7325-4c38-88bb-fac9508dcc27 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:59:50.936304 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-314efb35-7325-4c38-88bb-fac9508dcc27 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:59:50.936735 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-314efb35-7325-4c38-88bb-fac9508dcc27 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:59:51.016342 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-314efb35-7325-4c38-88bb-fac9508dcc27 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "POST /compute/v2.1/servers/9f9373f8-c3ad-4d3c-ac64-e5edf9cb4cd6/action" status: 200 len: 26547 microversion: 2.20 time: 0.093155 Oct 27 15:59:51.017162 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 744/1555] 10.222.0.64 () {62 vars in 1318 bytes} [Wed Oct 27 15:59:50 2021] POST /compute/v2.1/servers/9f9373f8-c3ad-4d3c-ac64-e5edf9cb4cd6/action => generated 26547 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 27 15:59:52.029245 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-01d1bb59-1988-49c4-b59d-1d009b88b019 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 15:59:52.030325 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-01d1bb59-1988-49c4-b59d-1d009b88b019 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: 9f9373f8-c3ad-4d3c-ac64-e5edf9cb4cd6] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:59:52.039191 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-01d1bb59-1988-49c4-b59d-1d009b88b019 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:59:52.039642 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-01d1bb59-1988-49c4-b59d-1d009b88b019 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:59:52.040490 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-01d1bb59-1988-49c4-b59d-1d009b88b019 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:59:52.040928 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-01d1bb59-1988-49c4-b59d-1d009b88b019 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:59:52.125842 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-01d1bb59-1988-49c4-b59d-1d009b88b019 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "POST /compute/v2.1/servers/9f9373f8-c3ad-4d3c-ac64-e5edf9cb4cd6/action" status: 200 len: 27633 microversion: 2.20 time: 0.101110 Oct 27 15:59:52.126478 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 812/1556] 10.222.0.64 () {62 vars in 1318 bytes} [Wed Oct 27 15:59:52 2021] POST /compute/v2.1/servers/9f9373f8-c3ad-4d3c-ac64-e5edf9cb4cd6/action => generated 27633 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 27 15:59:53.137474 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-7cb8455a-a179-47a8-a010-d4225a76838c tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 15:59:53.138465 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-7cb8455a-a179-47a8-a010-d4225a76838c tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: 9f9373f8-c3ad-4d3c-ac64-e5edf9cb4cd6] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:59:53.145289 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-7cb8455a-a179-47a8-a010-d4225a76838c tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:59:53.145736 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-7cb8455a-a179-47a8-a010-d4225a76838c tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:59:53.146502 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-7cb8455a-a179-47a8-a010-d4225a76838c tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:59:53.146935 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-7cb8455a-a179-47a8-a010-d4225a76838c tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:59:53.230716 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-7cb8455a-a179-47a8-a010-d4225a76838c tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "POST /compute/v2.1/servers/9f9373f8-c3ad-4d3c-ac64-e5edf9cb4cd6/action" status: 200 len: 28073 microversion: 2.20 time: 0.096892 Oct 27 15:59:53.231377 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 745/1557] 10.222.0.64 () {62 vars in 1318 bytes} [Wed Oct 27 15:59:53 2021] POST /compute/v2.1/servers/9f9373f8-c3ad-4d3c-ac64-e5edf9cb4cd6/action => generated 28073 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 27 15:59:54.242368 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-026f4c41-4d9f-474c-b3aa-bc674902077c tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 15:59:54.243353 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-026f4c41-4d9f-474c-b3aa-bc674902077c tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: 9f9373f8-c3ad-4d3c-ac64-e5edf9cb4cd6] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:59:54.250238 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-026f4c41-4d9f-474c-b3aa-bc674902077c tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:59:54.250728 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-026f4c41-4d9f-474c-b3aa-bc674902077c tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:59:54.251501 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-026f4c41-4d9f-474c-b3aa-bc674902077c tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:59:54.251953 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-026f4c41-4d9f-474c-b3aa-bc674902077c tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:59:54.325069 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-026f4c41-4d9f-474c-b3aa-bc674902077c tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "POST /compute/v2.1/servers/9f9373f8-c3ad-4d3c-ac64-e5edf9cb4cd6/action" status: 200 len: 28216 microversion: 2.20 time: 0.086721 Oct 27 15:59:54.325718 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 813/1558] 10.222.0.64 () {62 vars in 1318 bytes} [Wed Oct 27 15:59:54 2021] POST /compute/v2.1/servers/9f9373f8-c3ad-4d3c-ac64-e5edf9cb4cd6/action => generated 28216 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 27 15:59:55.337376 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-f92351eb-a08e-4f85-a7ad-7661cac7d9c4 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 15:59:55.338361 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-f92351eb-a08e-4f85-a7ad-7661cac7d9c4 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: 9f9373f8-c3ad-4d3c-ac64-e5edf9cb4cd6] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:59:55.345904 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-f92351eb-a08e-4f85-a7ad-7661cac7d9c4 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:59:55.346375 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-f92351eb-a08e-4f85-a7ad-7661cac7d9c4 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:59:55.347154 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-f92351eb-a08e-4f85-a7ad-7661cac7d9c4 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:59:55.347579 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-f92351eb-a08e-4f85-a7ad-7661cac7d9c4 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:59:55.413119 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-f92351eb-a08e-4f85-a7ad-7661cac7d9c4 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "POST /compute/v2.1/servers/9f9373f8-c3ad-4d3c-ac64-e5edf9cb4cd6/action" status: 200 len: 28216 microversion: 2.20 time: 0.079714 Oct 27 15:59:55.413746 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 746/1559] 10.222.0.64 () {62 vars in 1318 bytes} [Wed Oct 27 15:59:55 2021] POST /compute/v2.1/servers/9f9373f8-c3ad-4d3c-ac64-e5edf9cb4cd6/action => generated 28216 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 27 15:59:56.425296 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-6e7098df-b942-490f-a808-940e46c7cba5 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 15:59:56.426182 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-6e7098df-b942-490f-a808-940e46c7cba5 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: 9f9373f8-c3ad-4d3c-ac64-e5edf9cb4cd6] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:59:56.433476 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-6e7098df-b942-490f-a808-940e46c7cba5 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:59:56.433940 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-6e7098df-b942-490f-a808-940e46c7cba5 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:59:56.434709 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-6e7098df-b942-490f-a808-940e46c7cba5 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:59:56.435134 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-6e7098df-b942-490f-a808-940e46c7cba5 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:59:56.509842 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-6e7098df-b942-490f-a808-940e46c7cba5 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "POST /compute/v2.1/servers/9f9373f8-c3ad-4d3c-ac64-e5edf9cb4cd6/action" status: 200 len: 28507 microversion: 2.20 time: 0.088558 Oct 27 15:59:56.510541 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 814/1560] 10.222.0.64 () {62 vars in 1318 bytes} [Wed Oct 27 15:59:56 2021] POST /compute/v2.1/servers/9f9373f8-c3ad-4d3c-ac64-e5edf9cb4cd6/action => generated 28507 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 27 15:59:57.523142 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-4f769db8-4808-4dc6-8e26-600f1bc9057a tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 15:59:57.524170 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-4f769db8-4808-4dc6-8e26-600f1bc9057a tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: 9f9373f8-c3ad-4d3c-ac64-e5edf9cb4cd6] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:59:57.531555 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-4f769db8-4808-4dc6-8e26-600f1bc9057a tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:59:57.532057 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-4f769db8-4808-4dc6-8e26-600f1bc9057a tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:59:57.532817 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-4f769db8-4808-4dc6-8e26-600f1bc9057a tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:59:57.533250 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-4f769db8-4808-4dc6-8e26-600f1bc9057a tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:59:57.610978 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-4f769db8-4808-4dc6-8e26-600f1bc9057a tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "POST /compute/v2.1/servers/9f9373f8-c3ad-4d3c-ac64-e5edf9cb4cd6/action" status: 200 len: 28675 microversion: 2.20 time: 0.091741 Oct 27 15:59:57.611619 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 747/1561] 10.222.0.64 () {62 vars in 1318 bytes} [Wed Oct 27 15:59:57 2021] POST /compute/v2.1/servers/9f9373f8-c3ad-4d3c-ac64-e5edf9cb4cd6/action => generated 28675 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 27 15:59:58.623204 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-6fc80248-9de8-459a-abdb-f0f5de2a416c tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 15:59:58.624209 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-6fc80248-9de8-459a-abdb-f0f5de2a416c tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: 9f9373f8-c3ad-4d3c-ac64-e5edf9cb4cd6] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:59:58.631089 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-6fc80248-9de8-459a-abdb-f0f5de2a416c tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:59:58.631525 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-6fc80248-9de8-459a-abdb-f0f5de2a416c tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:59:58.632320 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-6fc80248-9de8-459a-abdb-f0f5de2a416c tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:59:58.632750 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-6fc80248-9de8-459a-abdb-f0f5de2a416c tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:59:58.699610 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-6fc80248-9de8-459a-abdb-f0f5de2a416c tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "POST /compute/v2.1/servers/9f9373f8-c3ad-4d3c-ac64-e5edf9cb4cd6/action" status: 200 len: 28675 microversion: 2.20 time: 0.080346 Oct 27 15:59:58.703507 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 815/1562] 10.222.0.64 () {62 vars in 1318 bytes} [Wed Oct 27 15:59:58 2021] POST /compute/v2.1/servers/9f9373f8-c3ad-4d3c-ac64-e5edf9cb4cd6/action => generated 28675 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 27 15:59:59.711092 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-63384218-e1e5-42a8-9f87-ade159a7dfb9 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 15:59:59.712124 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-63384218-e1e5-42a8-9f87-ade159a7dfb9 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: 9f9373f8-c3ad-4d3c-ac64-e5edf9cb4cd6] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 15:59:59.719503 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-63384218-e1e5-42a8-9f87-ade159a7dfb9 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:59:59.719988 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-63384218-e1e5-42a8-9f87-ade159a7dfb9 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:59:59.720763 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-63384218-e1e5-42a8-9f87-ade159a7dfb9 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 15:59:59.721206 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-63384218-e1e5-42a8-9f87-ade159a7dfb9 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 15:59:59.784908 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-63384218-e1e5-42a8-9f87-ade159a7dfb9 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "POST /compute/v2.1/servers/9f9373f8-c3ad-4d3c-ac64-e5edf9cb4cd6/action" status: 200 len: 28675 microversion: 2.20 time: 0.077646 Oct 27 15:59:59.785596 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 748/1563] 10.222.0.64 () {62 vars in 1318 bytes} [Wed Oct 27 15:59:59 2021] POST /compute/v2.1/servers/9f9373f8-c3ad-4d3c-ac64-e5edf9cb4cd6/action => generated 28675 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 27 16:00:00.797329 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-b27f514c-2178-4c97-b927-bd1508cdbc94 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 16:00:00.798945 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-b27f514c-2178-4c97-b927-bd1508cdbc94 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: 9f9373f8-c3ad-4d3c-ac64-e5edf9cb4cd6] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:00:00.806130 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-b27f514c-2178-4c97-b927-bd1508cdbc94 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:00:00.806584 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-b27f514c-2178-4c97-b927-bd1508cdbc94 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:00:00.807611 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-b27f514c-2178-4c97-b927-bd1508cdbc94 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:00:00.808144 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-b27f514c-2178-4c97-b927-bd1508cdbc94 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:00:00.897682 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-b27f514c-2178-4c97-b927-bd1508cdbc94 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "POST /compute/v2.1/servers/9f9373f8-c3ad-4d3c-ac64-e5edf9cb4cd6/action" status: 200 len: 30010 microversion: 2.20 time: 0.104422 Oct 27 16:00:00.898372 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 816/1564] 10.222.0.64 () {62 vars in 1318 bytes} [Wed Oct 27 16:00:00 2021] POST /compute/v2.1/servers/9f9373f8-c3ad-4d3c-ac64-e5edf9cb4cd6/action => generated 30010 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 27 16:00:01.910151 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-98cca99b-e570-4250-89b2-c4f647c153f7 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 16:00:01.911146 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-98cca99b-e570-4250-89b2-c4f647c153f7 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: 9f9373f8-c3ad-4d3c-ac64-e5edf9cb4cd6] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:00:01.918754 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-98cca99b-e570-4250-89b2-c4f647c153f7 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:00:01.918754 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-98cca99b-e570-4250-89b2-c4f647c153f7 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:00:01.919389 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-98cca99b-e570-4250-89b2-c4f647c153f7 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:00:01.919817 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-98cca99b-e570-4250-89b2-c4f647c153f7 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:00:01.995018 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-98cca99b-e570-4250-89b2-c4f647c153f7 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "POST /compute/v2.1/servers/9f9373f8-c3ad-4d3c-ac64-e5edf9cb4cd6/action" status: 200 len: 32019 microversion: 2.20 time: 0.088886 Oct 27 16:00:01.996905 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 749/1565] 10.222.0.64 () {62 vars in 1318 bytes} [Wed Oct 27 16:00:01 2021] POST /compute/v2.1/servers/9f9373f8-c3ad-4d3c-ac64-e5edf9cb4cd6/action => generated 32019 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 27 16:00:03.007437 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-17f7338c-2a56-40b3-9294-d71af4d962ed tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 16:00:03.008452 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-17f7338c-2a56-40b3-9294-d71af4d962ed tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: 9f9373f8-c3ad-4d3c-ac64-e5edf9cb4cd6] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:00:03.015947 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-17f7338c-2a56-40b3-9294-d71af4d962ed tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:00:03.016392 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-17f7338c-2a56-40b3-9294-d71af4d962ed tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:00:03.017148 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-17f7338c-2a56-40b3-9294-d71af4d962ed tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:00:03.017572 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-17f7338c-2a56-40b3-9294-d71af4d962ed tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:00:03.091452 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-17f7338c-2a56-40b3-9294-d71af4d962ed tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "POST /compute/v2.1/servers/9f9373f8-c3ad-4d3c-ac64-e5edf9cb4cd6/action" status: 200 len: 33472 microversion: 2.20 time: 0.087824 Oct 27 16:00:03.092061 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 817/1566] 10.222.0.64 () {62 vars in 1318 bytes} [Wed Oct 27 16:00:03 2021] POST /compute/v2.1/servers/9f9373f8-c3ad-4d3c-ac64-e5edf9cb4cd6/action => generated 33472 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 27 16:00:04.103832 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-0409ef60-82af-431c-afd2-0d8247bc2e9c tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 16:00:04.105470 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-0409ef60-82af-431c-afd2-0d8247bc2e9c tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: 9f9373f8-c3ad-4d3c-ac64-e5edf9cb4cd6] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:00:04.112490 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-0409ef60-82af-431c-afd2-0d8247bc2e9c tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:00:04.112934 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-0409ef60-82af-431c-afd2-0d8247bc2e9c tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:00:04.113696 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-0409ef60-82af-431c-afd2-0d8247bc2e9c tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:00:04.114122 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-0409ef60-82af-431c-afd2-0d8247bc2e9c tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:00:04.191754 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-0409ef60-82af-431c-afd2-0d8247bc2e9c tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "POST /compute/v2.1/servers/9f9373f8-c3ad-4d3c-ac64-e5edf9cb4cd6/action" status: 200 len: 34510 microversion: 2.20 time: 0.091912 Oct 27 16:00:04.192644 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 750/1567] 10.222.0.64 () {62 vars in 1318 bytes} [Wed Oct 27 16:00:04 2021] POST /compute/v2.1/servers/9f9373f8-c3ad-4d3c-ac64-e5edf9cb4cd6/action => generated 34510 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 27 16:00:05.203964 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-dfa5ddea-16c6-445d-a453-51a050cb3aa4 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 16:00:05.204953 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-dfa5ddea-16c6-445d-a453-51a050cb3aa4 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: 9f9373f8-c3ad-4d3c-ac64-e5edf9cb4cd6] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:00:05.211001 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-dfa5ddea-16c6-445d-a453-51a050cb3aa4 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:00:05.211440 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-dfa5ddea-16c6-445d-a453-51a050cb3aa4 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:00:05.212233 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-dfa5ddea-16c6-445d-a453-51a050cb3aa4 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:00:05.212660 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-dfa5ddea-16c6-445d-a453-51a050cb3aa4 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:00:05.289489 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-dfa5ddea-16c6-445d-a453-51a050cb3aa4 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "POST /compute/v2.1/servers/9f9373f8-c3ad-4d3c-ac64-e5edf9cb4cd6/action" status: 200 len: 35551 microversion: 2.20 time: 0.089360 Oct 27 16:00:05.290363 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 818/1568] 10.222.0.64 () {62 vars in 1318 bytes} [Wed Oct 27 16:00:05 2021] POST /compute/v2.1/servers/9f9373f8-c3ad-4d3c-ac64-e5edf9cb4cd6/action => generated 35551 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 27 16:00:06.302245 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-0237a79c-2032-42fa-9317-7489fecfad24 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 16:00:06.303235 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-0237a79c-2032-42fa-9317-7489fecfad24 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: 9f9373f8-c3ad-4d3c-ac64-e5edf9cb4cd6] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:00:06.310620 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-0237a79c-2032-42fa-9317-7489fecfad24 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:00:06.311066 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-0237a79c-2032-42fa-9317-7489fecfad24 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:00:06.311837 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-0237a79c-2032-42fa-9317-7489fecfad24 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:00:06.312291 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-0237a79c-2032-42fa-9317-7489fecfad24 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:00:06.385767 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-0237a79c-2032-42fa-9317-7489fecfad24 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "POST /compute/v2.1/servers/9f9373f8-c3ad-4d3c-ac64-e5edf9cb4cd6/action" status: 200 len: 37027 microversion: 2.20 time: 0.087438 Oct 27 16:00:06.386699 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 751/1569] 10.222.0.64 () {62 vars in 1318 bytes} [Wed Oct 27 16:00:06 2021] POST /compute/v2.1/servers/9f9373f8-c3ad-4d3c-ac64-e5edf9cb4cd6/action => generated 37027 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 27 16:00:07.398853 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-f85b327d-4066-4b6c-8dd0-4c3fd907cfd3 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 16:00:07.399837 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-f85b327d-4066-4b6c-8dd0-4c3fd907cfd3 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: 9f9373f8-c3ad-4d3c-ac64-e5edf9cb4cd6] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:00:07.407374 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-f85b327d-4066-4b6c-8dd0-4c3fd907cfd3 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:00:07.407818 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-f85b327d-4066-4b6c-8dd0-4c3fd907cfd3 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:00:07.408620 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-f85b327d-4066-4b6c-8dd0-4c3fd907cfd3 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:00:07.409051 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-f85b327d-4066-4b6c-8dd0-4c3fd907cfd3 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:00:07.480533 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-f85b327d-4066-4b6c-8dd0-4c3fd907cfd3 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "POST /compute/v2.1/servers/9f9373f8-c3ad-4d3c-ac64-e5edf9cb4cd6/action" status: 200 len: 38234 microversion: 2.20 time: 0.085227 Oct 27 16:00:07.481408 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 819/1570] 10.222.0.64 () {62 vars in 1318 bytes} [Wed Oct 27 16:00:07 2021] POST /compute/v2.1/servers/9f9373f8-c3ad-4d3c-ac64-e5edf9cb4cd6/action => generated 38234 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 27 16:00:08.492799 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-3f1c2d9d-def2-437c-b6a6-0cc368beedfe tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 16:00:08.493778 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-3f1c2d9d-def2-437c-b6a6-0cc368beedfe tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: 9f9373f8-c3ad-4d3c-ac64-e5edf9cb4cd6] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:00:08.501417 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-3f1c2d9d-def2-437c-b6a6-0cc368beedfe tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:00:08.501860 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-3f1c2d9d-def2-437c-b6a6-0cc368beedfe tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:00:08.502631 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-3f1c2d9d-def2-437c-b6a6-0cc368beedfe tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:00:08.503059 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-3f1c2d9d-def2-437c-b6a6-0cc368beedfe tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:00:08.567378 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-3f1c2d9d-def2-437c-b6a6-0cc368beedfe tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "POST /compute/v2.1/servers/9f9373f8-c3ad-4d3c-ac64-e5edf9cb4cd6/action" status: 200 len: 38234 microversion: 2.20 time: 0.078208 Oct 27 16:00:08.568350 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 752/1571] 10.222.0.64 () {62 vars in 1318 bytes} [Wed Oct 27 16:00:08 2021] POST /compute/v2.1/servers/9f9373f8-c3ad-4d3c-ac64-e5edf9cb4cd6/action => generated 38234 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 27 16:00:09.582384 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-6b41125c-c8b3-4009-ab10-44be6ac4ebf5 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 16:00:09.583362 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-6b41125c-c8b3-4009-ab10-44be6ac4ebf5 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: 9f9373f8-c3ad-4d3c-ac64-e5edf9cb4cd6] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:00:09.591076 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-6b41125c-c8b3-4009-ab10-44be6ac4ebf5 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:00:09.591517 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-6b41125c-c8b3-4009-ab10-44be6ac4ebf5 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:00:09.592324 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-6b41125c-c8b3-4009-ab10-44be6ac4ebf5 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:00:09.592749 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-6b41125c-c8b3-4009-ab10-44be6ac4ebf5 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:00:09.655927 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-6b41125c-c8b3-4009-ab10-44be6ac4ebf5 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "POST /compute/v2.1/servers/9f9373f8-c3ad-4d3c-ac64-e5edf9cb4cd6/action" status: 200 len: 38234 microversion: 2.20 time: 0.077457 Oct 27 16:00:09.656854 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 820/1572] 10.222.0.64 () {62 vars in 1318 bytes} [Wed Oct 27 16:00:09 2021] POST /compute/v2.1/servers/9f9373f8-c3ad-4d3c-ac64-e5edf9cb4cd6/action => generated 38234 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 27 16:00:10.667901 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-0ff09ba4-b75e-46b8-8d19-746116d35559 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 16:00:10.668888 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-0ff09ba4-b75e-46b8-8d19-746116d35559 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: 9f9373f8-c3ad-4d3c-ac64-e5edf9cb4cd6] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:00:10.676464 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-0ff09ba4-b75e-46b8-8d19-746116d35559 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:00:10.676925 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-0ff09ba4-b75e-46b8-8d19-746116d35559 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:00:10.677707 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-0ff09ba4-b75e-46b8-8d19-746116d35559 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:00:10.678184 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-0ff09ba4-b75e-46b8-8d19-746116d35559 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:00:10.739482 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-0ff09ba4-b75e-46b8-8d19-746116d35559 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "POST /compute/v2.1/servers/9f9373f8-c3ad-4d3c-ac64-e5edf9cb4cd6/action" status: 200 len: 38234 microversion: 2.20 time: 0.075383 Oct 27 16:00:10.740190 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 753/1573] 10.222.0.64 () {62 vars in 1318 bytes} [Wed Oct 27 16:00:10 2021] POST /compute/v2.1/servers/9f9373f8-c3ad-4d3c-ac64-e5edf9cb4cd6/action => generated 38234 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 27 16:00:11.753367 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-5a5dcb94-e134-47a2-89ab-01de26750c27 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 16:00:11.754369 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-5a5dcb94-e134-47a2-89ab-01de26750c27 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: 9f9373f8-c3ad-4d3c-ac64-e5edf9cb4cd6] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:00:11.761966 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-5a5dcb94-e134-47a2-89ab-01de26750c27 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:00:11.762335 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-5a5dcb94-e134-47a2-89ab-01de26750c27 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:00:11.763145 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-5a5dcb94-e134-47a2-89ab-01de26750c27 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:00:11.763581 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-5a5dcb94-e134-47a2-89ab-01de26750c27 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:00:11.833556 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-5a5dcb94-e134-47a2-89ab-01de26750c27 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "POST /compute/v2.1/servers/9f9373f8-c3ad-4d3c-ac64-e5edf9cb4cd6/action" status: 200 len: 38377 microversion: 2.20 time: 0.084239 Oct 27 16:00:11.834470 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 821/1574] 10.222.0.64 () {62 vars in 1318 bytes} [Wed Oct 27 16:00:11 2021] POST /compute/v2.1/servers/9f9373f8-c3ad-4d3c-ac64-e5edf9cb4cd6/action => generated 38377 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 27 16:00:11.845272 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-587f7282-060b-4410-a804-5860bad4deb2 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:00:11.845875 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-587f7282-060b-4410-a804-5860bad4deb2 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: 9f9373f8-c3ad-4d3c-ac64-e5edf9cb4cd6] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:00:11.853254 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-587f7282-060b-4410-a804-5860bad4deb2 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:00:11.853729 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-587f7282-060b-4410-a804-5860bad4deb2 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:00:11.854995 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-587f7282-060b-4410-a804-5860bad4deb2 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:00:11.855455 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-587f7282-060b-4410-a804-5860bad4deb2 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:00:11.879448 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-587f7282-060b-4410-a804-5860bad4deb2 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "GET /compute/v2.1/servers/9f9373f8-c3ad-4d3c-ac64-e5edf9cb4cd6/ips" status: 200 len: 151 microversion: 2.20 time: 0.038408 Oct 27 16:00:11.880061 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 754/1575] 10.222.0.64 () {60 vars in 1288 bytes} [Wed Oct 27 16:00:11 2021] GET /compute/v2.1/servers/9f9373f8-c3ad-4d3c-ac64-e5edf9cb4cd6/ips => generated 151 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 16:00:57.200193 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 27 16:00:57.200881 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: Wed Oct 27 16:00:57 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Oct 27 16:02:37.117261 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 27 16:02:37.117875 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: Wed Oct 27 16:02:37 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Oct 27 16:02:41.472862 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 27 16:02:41.473473 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: Wed Oct 27 16:02:41 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Oct 27 16:02:58.985428 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 27 16:02:58.986076 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: Wed Oct 27 16:02:58 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Oct 27 16:03:01.453873 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 27 16:03:01.454474 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: Wed Oct 27 16:03:01 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Oct 27 16:04:17.218639 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 27 16:04:17.219234 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: Wed Oct 27 16:04:17 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Oct 27 16:04:25.599268 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 27 16:04:25.599948 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: Wed Oct 27 16:04:25 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Oct 27 16:05:17.106532 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: ERROR oslo.messaging._drivers.impl_rabbit [-] [9e5083a7-54ed-4130-8943-3bf7cba382f9] AMQP server on 10.222.0.64:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 27 16:05:17.112299 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-9b1d3050-e038-4093-8a2b-3ef485a848c7 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:05:17.113266 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-9b1d3050-e038-4093-8a2b-3ef485a848c7 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] [instance: 013da7c4-ac69-4554-827b-d68e9bac0e54] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:05:17.124945 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-9b1d3050-e038-4093-8a2b-3ef485a848c7 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:05:17.125689 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-9b1d3050-e038-4093-8a2b-3ef485a848c7 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:05:17.127023 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-9b1d3050-e038-4093-8a2b-3ef485a848c7 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:05:17.127774 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-9b1d3050-e038-4093-8a2b-3ef485a848c7 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:05:17.179177 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-9b1d3050-e038-4093-8a2b-3ef485a848c7 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] [instance: 013da7c4-ac69-4554-827b-d68e9bac0e54] Going to try to terminate instance {{(pid=122224) delete /opt/stack/nova/nova/compute/api.py:2612}} Oct 27 16:05:17.295456 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-9b1d3050-e038-4093-8a2b-3ef485a848c7 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] 10.222.0.64 "DELETE /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54" status: 204 len: 0 microversion: 2.1 time: 0.192025 Oct 27 16:05:17.296170 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 822/1576] 10.222.0.64 () {58 vars in 1238 bytes} [Wed Oct 27 16:05:17 2021] DELETE /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 16:05:17.304594 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: ERROR oslo.messaging._drivers.impl_rabbit [-] [974aee41-ada3-4d82-a5f5-5a715e2d6c08] AMQP server on 10.222.0.64:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 27 16:05:17.308540 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-ed1a607e-8992-4d9f-a3b0-a2da158f2a0d tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:05:17.309170 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-ed1a607e-8992-4d9f-a3b0-a2da158f2a0d tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] [instance: 013da7c4-ac69-4554-827b-d68e9bac0e54] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:05:17.316898 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-ed1a607e-8992-4d9f-a3b0-a2da158f2a0d tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:05:17.317105 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-ed1a607e-8992-4d9f-a3b0-a2da158f2a0d tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:05:17.318103 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-ed1a607e-8992-4d9f-a3b0-a2da158f2a0d tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:05:17.318551 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-ed1a607e-8992-4d9f-a3b0-a2da158f2a0d tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:05:17.537628 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-ed1a607e-8992-4d9f-a3b0-a2da158f2a0d tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6be4749041442787482b6e06b6c40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73f3238988e4e1293ad782712a1da53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 16:05:17.545928 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-ed1a607e-8992-4d9f-a3b0-a2da158f2a0d tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] 10.222.0.64 "GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54" status: 200 len: 1560 microversion: 2.1 time: 0.243744 Oct 27 16:05:17.546498 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 755/1577] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 16:05:17 2021] GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54 => generated 1560 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 16:05:18.564695 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-d88ed6b7-a9f5-448f-a5d0-2baf07e8bcf4 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:05:18.567094 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-d88ed6b7-a9f5-448f-a5d0-2baf07e8bcf4 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] [instance: 013da7c4-ac69-4554-827b-d68e9bac0e54] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:05:18.586925 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO oslo.messaging._drivers.impl_rabbit [-] [9e5083a7-54ed-4130-8943-3bf7cba382f9] Reconnected to AMQP server on 10.222.0.64:5672 via [amqp] client with port 44804. Oct 27 16:05:18.589218 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-d88ed6b7-a9f5-448f-a5d0-2baf07e8bcf4 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:05:18.589661 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-d88ed6b7-a9f5-448f-a5d0-2baf07e8bcf4 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:05:18.590440 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-d88ed6b7-a9f5-448f-a5d0-2baf07e8bcf4 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:05:18.590902 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-d88ed6b7-a9f5-448f-a5d0-2baf07e8bcf4 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:05:18.774365 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-d88ed6b7-a9f5-448f-a5d0-2baf07e8bcf4 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6be4749041442787482b6e06b6c40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73f3238988e4e1293ad782712a1da53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 16:05:18.783777 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-d88ed6b7-a9f5-448f-a5d0-2baf07e8bcf4 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] 10.222.0.64 "GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54" status: 200 len: 1560 microversion: 2.1 time: 0.223162 Oct 27 16:05:18.785765 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 823/1578] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 16:05:18 2021] GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54 => generated 1560 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 16:05:19.496998 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-a8bd7cea-a492-48b1-8ab3-29754654370b tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] Calling method '.version_select at 0x7fbc06678820>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:05:19.546516 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-a8bd7cea-a492-48b1-8ab3-29754654370b tempest-TestVolumeBootPattern-68227852 tempest-TestVolumeBootPattern-68227852-project] 10.222.0.64 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-2050413747" status: 202 len: 0 microversion: 2.1 time: 0.053530 Oct 27 16:05:19.547104 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 756/1579] 10.222.0.64 () {58 vars in 1262 bytes} [Wed Oct 27 16:05:19 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-2050413747 => generated 0 bytes in 55 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 16:05:19.802523 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-ab71f2a2-7bab-4b7b-9b75-16b09050b2df tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:05:19.803217 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-ab71f2a2-7bab-4b7b-9b75-16b09050b2df tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] [instance: 013da7c4-ac69-4554-827b-d68e9bac0e54] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:05:19.809707 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-ab71f2a2-7bab-4b7b-9b75-16b09050b2df tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:05:19.810146 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-ab71f2a2-7bab-4b7b-9b75-16b09050b2df tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:05:19.810928 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-ab71f2a2-7bab-4b7b-9b75-16b09050b2df tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:05:19.811360 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-ab71f2a2-7bab-4b7b-9b75-16b09050b2df tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:05:20.024446 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-ab71f2a2-7bab-4b7b-9b75-16b09050b2df tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6be4749041442787482b6e06b6c40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73f3238988e4e1293ad782712a1da53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 16:05:20.032674 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-ab71f2a2-7bab-4b7b-9b75-16b09050b2df tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] 10.222.0.64 "GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54" status: 200 len: 1560 microversion: 2.1 time: 0.233972 Oct 27 16:05:20.033260 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 824/1580] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 16:05:19 2021] GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54 => generated 1560 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 16:05:21.056938 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-7f165942-04c8-4356-8cc4-40acdb03fb28 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:05:21.057814 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-7f165942-04c8-4356-8cc4-40acdb03fb28 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] [instance: 013da7c4-ac69-4554-827b-d68e9bac0e54] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:05:21.059673 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO oslo.messaging._drivers.impl_rabbit [-] [974aee41-ada3-4d82-a5f5-5a715e2d6c08] Reconnected to AMQP server on 10.222.0.64:5672 via [amqp] client with port 44820. Oct 27 16:05:21.066854 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-7f165942-04c8-4356-8cc4-40acdb03fb28 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:05:21.067297 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-7f165942-04c8-4356-8cc4-40acdb03fb28 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:05:21.068174 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-7f165942-04c8-4356-8cc4-40acdb03fb28 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:05:21.068623 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-7f165942-04c8-4356-8cc4-40acdb03fb28 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:05:21.270604 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-7f165942-04c8-4356-8cc4-40acdb03fb28 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6be4749041442787482b6e06b6c40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73f3238988e4e1293ad782712a1da53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 16:05:21.285551 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-7f165942-04c8-4356-8cc4-40acdb03fb28 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] 10.222.0.64 "GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54" status: 200 len: 1560 microversion: 2.1 time: 0.231762 Oct 27 16:05:21.287072 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 757/1581] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 16:05:21 2021] GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54 => generated 1560 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 16:05:22.318981 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-47d1405f-2f50-4bd0-aa68-34b0c29bc22c tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:05:22.320388 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-47d1405f-2f50-4bd0-aa68-34b0c29bc22c tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] [instance: 013da7c4-ac69-4554-827b-d68e9bac0e54] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:05:22.329537 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-47d1405f-2f50-4bd0-aa68-34b0c29bc22c tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:05:22.330318 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-47d1405f-2f50-4bd0-aa68-34b0c29bc22c tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:05:22.332696 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-47d1405f-2f50-4bd0-aa68-34b0c29bc22c tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:05:22.333605 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-47d1405f-2f50-4bd0-aa68-34b0c29bc22c tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:05:22.700389 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-47d1405f-2f50-4bd0-aa68-34b0c29bc22c tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6be4749041442787482b6e06b6c40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73f3238988e4e1293ad782712a1da53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 16:05:22.718528 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-47d1405f-2f50-4bd0-aa68-34b0c29bc22c tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] 10.222.0.64 "GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54" status: 200 len: 1560 microversion: 2.1 time: 0.407039 Oct 27 16:05:22.720600 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 825/1582] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 16:05:22 2021] GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54 => generated 1560 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 16:05:23.756103 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-afc906eb-2993-40a3-9311-c5668c1b8070 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:05:23.756103 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-afc906eb-2993-40a3-9311-c5668c1b8070 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] [instance: 013da7c4-ac69-4554-827b-d68e9bac0e54] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:05:23.756103 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-afc906eb-2993-40a3-9311-c5668c1b8070 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:05:23.756103 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-afc906eb-2993-40a3-9311-c5668c1b8070 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:05:23.756868 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-afc906eb-2993-40a3-9311-c5668c1b8070 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:05:23.756868 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-afc906eb-2993-40a3-9311-c5668c1b8070 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:05:24.150532 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-afc906eb-2993-40a3-9311-c5668c1b8070 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6be4749041442787482b6e06b6c40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73f3238988e4e1293ad782712a1da53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 16:05:24.162282 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-afc906eb-2993-40a3-9311-c5668c1b8070 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] 10.222.0.64 "GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54" status: 200 len: 1560 microversion: 2.1 time: 0.420850 Oct 27 16:05:24.163229 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 758/1583] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 16:05:23 2021] GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54 => generated 1560 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 16:05:25.180580 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-b67fa9a3-f7f2-4953-817b-804b6bebf7f2 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:05:25.181474 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-b67fa9a3-f7f2-4953-817b-804b6bebf7f2 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] [instance: 013da7c4-ac69-4554-827b-d68e9bac0e54] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:05:25.188656 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-b67fa9a3-f7f2-4953-817b-804b6bebf7f2 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:05:25.189101 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-b67fa9a3-f7f2-4953-817b-804b6bebf7f2 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:05:25.189904 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-b67fa9a3-f7f2-4953-817b-804b6bebf7f2 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:05:25.190824 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-b67fa9a3-f7f2-4953-817b-804b6bebf7f2 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:05:25.370766 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-b67fa9a3-f7f2-4953-817b-804b6bebf7f2 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6be4749041442787482b6e06b6c40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73f3238988e4e1293ad782712a1da53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 16:05:25.381687 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-b67fa9a3-f7f2-4953-817b-804b6bebf7f2 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] 10.222.0.64 "GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54" status: 200 len: 1560 microversion: 2.1 time: 0.205620 Oct 27 16:05:25.382901 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 826/1584] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 16:05:25 2021] GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54 => generated 1560 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 16:05:26.401511 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-77c59fdb-b604-460e-b657-3144a74a65c0 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:05:26.402474 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-77c59fdb-b604-460e-b657-3144a74a65c0 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] [instance: 013da7c4-ac69-4554-827b-d68e9bac0e54] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:05:26.411445 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-77c59fdb-b604-460e-b657-3144a74a65c0 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:05:26.411802 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-77c59fdb-b604-460e-b657-3144a74a65c0 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:05:26.412627 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-77c59fdb-b604-460e-b657-3144a74a65c0 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:05:26.413060 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-77c59fdb-b604-460e-b657-3144a74a65c0 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:05:26.632868 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-77c59fdb-b604-460e-b657-3144a74a65c0 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6be4749041442787482b6e06b6c40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73f3238988e4e1293ad782712a1da53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 16:05:26.640887 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-77c59fdb-b604-460e-b657-3144a74a65c0 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] 10.222.0.64 "GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54" status: 200 len: 1560 microversion: 2.1 time: 0.243527 Oct 27 16:05:26.641454 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 759/1585] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 16:05:26 2021] GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54 => generated 1560 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 16:05:27.661034 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-c16b9e98-2cdd-4a31-bbaf-195c6578bcd3 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:05:27.661964 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-c16b9e98-2cdd-4a31-bbaf-195c6578bcd3 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] [instance: 013da7c4-ac69-4554-827b-d68e9bac0e54] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:05:27.671269 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-c16b9e98-2cdd-4a31-bbaf-195c6578bcd3 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:05:27.672046 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-c16b9e98-2cdd-4a31-bbaf-195c6578bcd3 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:05:27.673178 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-c16b9e98-2cdd-4a31-bbaf-195c6578bcd3 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:05:27.673707 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-c16b9e98-2cdd-4a31-bbaf-195c6578bcd3 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:05:27.927251 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-c16b9e98-2cdd-4a31-bbaf-195c6578bcd3 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6be4749041442787482b6e06b6c40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73f3238988e4e1293ad782712a1da53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 16:05:27.935415 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-c16b9e98-2cdd-4a31-bbaf-195c6578bcd3 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] 10.222.0.64 "GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54" status: 200 len: 1560 microversion: 2.1 time: 0.280165 Oct 27 16:05:27.936301 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 827/1586] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 16:05:27 2021] GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54 => generated 1560 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 16:05:28.960646 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-64121b33-ac73-42cf-8826-b77d70061ab0 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:05:28.961885 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-64121b33-ac73-42cf-8826-b77d70061ab0 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] [instance: 013da7c4-ac69-4554-827b-d68e9bac0e54] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:05:28.969835 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-64121b33-ac73-42cf-8826-b77d70061ab0 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:05:28.970287 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-64121b33-ac73-42cf-8826-b77d70061ab0 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:05:28.971070 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-64121b33-ac73-42cf-8826-b77d70061ab0 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:05:28.971530 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-64121b33-ac73-42cf-8826-b77d70061ab0 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:05:29.159610 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-64121b33-ac73-42cf-8826-b77d70061ab0 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6be4749041442787482b6e06b6c40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73f3238988e4e1293ad782712a1da53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 16:05:29.167461 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-64121b33-ac73-42cf-8826-b77d70061ab0 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] 10.222.0.64 "GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54" status: 200 len: 1560 microversion: 2.1 time: 0.214812 Oct 27 16:05:29.168179 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 760/1587] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 16:05:28 2021] GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54 => generated 1560 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 16:05:30.185650 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-3be8c542-f130-42d1-a7c4-c794ed687a9d tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:05:30.186287 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-3be8c542-f130-42d1-a7c4-c794ed687a9d tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] [instance: 013da7c4-ac69-4554-827b-d68e9bac0e54] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:05:30.193294 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-3be8c542-f130-42d1-a7c4-c794ed687a9d tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:05:30.193738 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-3be8c542-f130-42d1-a7c4-c794ed687a9d tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:05:30.194516 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-3be8c542-f130-42d1-a7c4-c794ed687a9d tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:05:30.194951 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-3be8c542-f130-42d1-a7c4-c794ed687a9d tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:05:30.325058 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-3be8c542-f130-42d1-a7c4-c794ed687a9d tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6be4749041442787482b6e06b6c40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73f3238988e4e1293ad782712a1da53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 16:05:30.333518 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-3be8c542-f130-42d1-a7c4-c794ed687a9d tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] 10.222.0.64 "GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54" status: 200 len: 1560 microversion: 2.1 time: 0.151569 Oct 27 16:05:30.337774 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 828/1588] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 16:05:30 2021] GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 16:05:31.358805 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-88cc0ab9-e795-4ab8-9247-6da617af3eda tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:05:31.359376 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-88cc0ab9-e795-4ab8-9247-6da617af3eda tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] [instance: 013da7c4-ac69-4554-827b-d68e9bac0e54] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:05:31.366314 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-88cc0ab9-e795-4ab8-9247-6da617af3eda tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:05:31.366748 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-88cc0ab9-e795-4ab8-9247-6da617af3eda tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:05:31.367513 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-88cc0ab9-e795-4ab8-9247-6da617af3eda tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:05:31.367978 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-88cc0ab9-e795-4ab8-9247-6da617af3eda tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:05:31.508328 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-88cc0ab9-e795-4ab8-9247-6da617af3eda tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6be4749041442787482b6e06b6c40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73f3238988e4e1293ad782712a1da53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 16:05:31.520759 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-88cc0ab9-e795-4ab8-9247-6da617af3eda tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] 10.222.0.64 "GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54" status: 200 len: 1560 microversion: 2.1 time: 0.165170 Oct 27 16:05:31.521812 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 761/1589] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 16:05:31 2021] GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54 => generated 1560 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 16:05:32.540402 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-e689b2c1-9cd7-4a9b-88ac-492c150b8387 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:05:32.541123 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-e689b2c1-9cd7-4a9b-88ac-492c150b8387 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] [instance: 013da7c4-ac69-4554-827b-d68e9bac0e54] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:05:32.556920 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-e689b2c1-9cd7-4a9b-88ac-492c150b8387 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:05:32.556920 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-e689b2c1-9cd7-4a9b-88ac-492c150b8387 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:05:32.556920 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-e689b2c1-9cd7-4a9b-88ac-492c150b8387 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:05:32.556920 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-e689b2c1-9cd7-4a9b-88ac-492c150b8387 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:05:32.694233 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-e689b2c1-9cd7-4a9b-88ac-492c150b8387 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6be4749041442787482b6e06b6c40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73f3238988e4e1293ad782712a1da53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 16:05:32.703272 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-e689b2c1-9cd7-4a9b-88ac-492c150b8387 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] 10.222.0.64 "GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54" status: 200 len: 1560 microversion: 2.1 time: 0.167206 Oct 27 16:05:32.703771 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 829/1590] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 16:05:32 2021] GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54 => generated 1560 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 16:05:33.724013 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-e504dc9c-6e2b-4355-a99c-e079c1020991 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:05:33.724735 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-e504dc9c-6e2b-4355-a99c-e079c1020991 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] [instance: 013da7c4-ac69-4554-827b-d68e9bac0e54] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:05:33.734490 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-e504dc9c-6e2b-4355-a99c-e079c1020991 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:05:33.735102 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-e504dc9c-6e2b-4355-a99c-e079c1020991 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:05:33.736332 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-e504dc9c-6e2b-4355-a99c-e079c1020991 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:05:33.737515 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-e504dc9c-6e2b-4355-a99c-e079c1020991 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:05:33.888189 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-e504dc9c-6e2b-4355-a99c-e079c1020991 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6be4749041442787482b6e06b6c40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73f3238988e4e1293ad782712a1da53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 16:05:33.902923 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-e504dc9c-6e2b-4355-a99c-e079c1020991 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] 10.222.0.64 "GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54" status: 200 len: 1560 microversion: 2.1 time: 0.183364 Oct 27 16:05:33.903230 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 762/1591] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 16:05:33 2021] GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54 => generated 1560 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 16:05:34.921982 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-ec439901-69e4-433b-a6b8-105ee79138db tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:05:34.922683 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-ec439901-69e4-433b-a6b8-105ee79138db tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] [instance: 013da7c4-ac69-4554-827b-d68e9bac0e54] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:05:34.930347 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-ec439901-69e4-433b-a6b8-105ee79138db tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:05:34.930931 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-ec439901-69e4-433b-a6b8-105ee79138db tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:05:34.933960 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-ec439901-69e4-433b-a6b8-105ee79138db tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:05:34.933960 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-ec439901-69e4-433b-a6b8-105ee79138db tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:05:35.075749 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-ec439901-69e4-433b-a6b8-105ee79138db tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6be4749041442787482b6e06b6c40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73f3238988e4e1293ad782712a1da53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 16:05:35.089019 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-ec439901-69e4-433b-a6b8-105ee79138db tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] 10.222.0.64 "GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54" status: 200 len: 1560 microversion: 2.1 time: 0.170596 Oct 27 16:05:35.090105 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 830/1592] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 16:05:34 2021] GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54 => generated 1560 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 16:05:36.110746 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-d4c18c89-935a-4d07-88fe-de5cbd7d44df tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:05:36.111475 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-d4c18c89-935a-4d07-88fe-de5cbd7d44df tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] [instance: 013da7c4-ac69-4554-827b-d68e9bac0e54] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:05:36.119184 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-d4c18c89-935a-4d07-88fe-de5cbd7d44df tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:05:36.119665 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-d4c18c89-935a-4d07-88fe-de5cbd7d44df tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:05:36.120479 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-d4c18c89-935a-4d07-88fe-de5cbd7d44df tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:05:36.120915 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-d4c18c89-935a-4d07-88fe-de5cbd7d44df tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:05:36.254973 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-d4c18c89-935a-4d07-88fe-de5cbd7d44df tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6be4749041442787482b6e06b6c40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73f3238988e4e1293ad782712a1da53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 16:05:36.266762 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-d4c18c89-935a-4d07-88fe-de5cbd7d44df tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] 10.222.0.64 "GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54" status: 200 len: 1560 microversion: 2.1 time: 0.159333 Oct 27 16:05:36.267640 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 763/1593] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 16:05:36 2021] GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54 => generated 1560 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 16:05:37.285399 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-9f41446d-d43e-4bcf-95cc-9234bdc632e3 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:05:37.286004 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-9f41446d-d43e-4bcf-95cc-9234bdc632e3 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] [instance: 013da7c4-ac69-4554-827b-d68e9bac0e54] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:05:37.292967 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-9f41446d-d43e-4bcf-95cc-9234bdc632e3 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:05:37.293415 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-9f41446d-d43e-4bcf-95cc-9234bdc632e3 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:05:37.294227 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-9f41446d-d43e-4bcf-95cc-9234bdc632e3 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:05:37.294658 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-9f41446d-d43e-4bcf-95cc-9234bdc632e3 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:05:37.435045 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-9f41446d-d43e-4bcf-95cc-9234bdc632e3 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6be4749041442787482b6e06b6c40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73f3238988e4e1293ad782712a1da53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 16:05:37.443251 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-9f41446d-d43e-4bcf-95cc-9234bdc632e3 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] 10.222.0.64 "GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54" status: 200 len: 1560 microversion: 2.1 time: 0.162470 Oct 27 16:05:37.443838 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 831/1594] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 16:05:37 2021] GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54 => generated 1560 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 16:05:38.460994 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-cf5cc7f6-2421-4bd1-b934-2ba08e7c7a2c tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:05:38.461609 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-cf5cc7f6-2421-4bd1-b934-2ba08e7c7a2c tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] [instance: 013da7c4-ac69-4554-827b-d68e9bac0e54] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:05:38.469008 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-cf5cc7f6-2421-4bd1-b934-2ba08e7c7a2c tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:05:38.469458 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-cf5cc7f6-2421-4bd1-b934-2ba08e7c7a2c tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:05:38.470309 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-cf5cc7f6-2421-4bd1-b934-2ba08e7c7a2c tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:05:38.470728 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-cf5cc7f6-2421-4bd1-b934-2ba08e7c7a2c tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:05:38.610837 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-cf5cc7f6-2421-4bd1-b934-2ba08e7c7a2c tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6be4749041442787482b6e06b6c40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73f3238988e4e1293ad782712a1da53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 16:05:38.619993 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-cf5cc7f6-2421-4bd1-b934-2ba08e7c7a2c tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] 10.222.0.64 "GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54" status: 200 len: 1560 microversion: 2.1 time: 0.162784 Oct 27 16:05:38.620565 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 764/1595] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 16:05:38 2021] GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54 => generated 1560 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 16:05:39.637776 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-281e0d76-0efe-4e7b-a328-353e16214316 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:05:39.638427 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-281e0d76-0efe-4e7b-a328-353e16214316 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] [instance: 013da7c4-ac69-4554-827b-d68e9bac0e54] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:05:39.644828 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-281e0d76-0efe-4e7b-a328-353e16214316 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:05:39.645272 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-281e0d76-0efe-4e7b-a328-353e16214316 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:05:39.646050 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-281e0d76-0efe-4e7b-a328-353e16214316 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:05:39.646554 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-281e0d76-0efe-4e7b-a328-353e16214316 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:05:39.782981 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-281e0d76-0efe-4e7b-a328-353e16214316 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6be4749041442787482b6e06b6c40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73f3238988e4e1293ad782712a1da53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 16:05:39.792545 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-281e0d76-0efe-4e7b-a328-353e16214316 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] 10.222.0.64 "GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54" status: 200 len: 1560 microversion: 2.1 time: 0.158418 Oct 27 16:05:39.793146 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 832/1596] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 16:05:39 2021] GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54 => generated 1560 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 16:05:40.811406 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-651145d4-1223-4350-9f68-160ba3112219 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:05:40.812053 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-651145d4-1223-4350-9f68-160ba3112219 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] [instance: 013da7c4-ac69-4554-827b-d68e9bac0e54] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:05:40.821688 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-651145d4-1223-4350-9f68-160ba3112219 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:05:40.822122 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-651145d4-1223-4350-9f68-160ba3112219 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:05:40.823076 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-651145d4-1223-4350-9f68-160ba3112219 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:05:40.823599 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-651145d4-1223-4350-9f68-160ba3112219 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:05:40.974955 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-651145d4-1223-4350-9f68-160ba3112219 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6be4749041442787482b6e06b6c40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73f3238988e4e1293ad782712a1da53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 16:05:40.983579 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-651145d4-1223-4350-9f68-160ba3112219 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] 10.222.0.64 "GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54" status: 200 len: 1560 microversion: 2.1 time: 0.175817 Oct 27 16:05:40.984189 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 765/1597] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 16:05:40 2021] GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54 => generated 1560 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 16:05:42.001177 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-9139b00c-6776-4351-b260-c60211992ede tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:05:42.001773 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-9139b00c-6776-4351-b260-c60211992ede tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] [instance: 013da7c4-ac69-4554-827b-d68e9bac0e54] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:05:42.010129 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-9139b00c-6776-4351-b260-c60211992ede tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:05:42.010607 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-9139b00c-6776-4351-b260-c60211992ede tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:05:42.011409 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-9139b00c-6776-4351-b260-c60211992ede tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:05:42.011823 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-9139b00c-6776-4351-b260-c60211992ede tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:05:42.170779 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-9139b00c-6776-4351-b260-c60211992ede tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6be4749041442787482b6e06b6c40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73f3238988e4e1293ad782712a1da53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 16:05:42.180057 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-9139b00c-6776-4351-b260-c60211992ede tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] 10.222.0.64 "GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54" status: 200 len: 1560 microversion: 2.1 time: 0.182666 Oct 27 16:05:42.180676 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 833/1598] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 16:05:41 2021] GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54 => generated 1560 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 16:05:43.197762 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-bbf4dd89-623c-45a3-bcbf-af9e2528c839 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:05:43.198352 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-bbf4dd89-623c-45a3-bcbf-af9e2528c839 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] [instance: 013da7c4-ac69-4554-827b-d68e9bac0e54] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:05:43.205253 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-bbf4dd89-623c-45a3-bcbf-af9e2528c839 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:05:43.205744 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-bbf4dd89-623c-45a3-bcbf-af9e2528c839 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:05:43.206679 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-bbf4dd89-623c-45a3-bcbf-af9e2528c839 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:05:43.207159 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-bbf4dd89-623c-45a3-bcbf-af9e2528c839 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:05:43.348407 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-bbf4dd89-623c-45a3-bcbf-af9e2528c839 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6be4749041442787482b6e06b6c40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73f3238988e4e1293ad782712a1da53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 16:05:43.356684 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-bbf4dd89-623c-45a3-bcbf-af9e2528c839 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] 10.222.0.64 "GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54" status: 200 len: 1560 microversion: 2.1 time: 0.162578 Oct 27 16:05:43.357260 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 766/1599] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 16:05:43 2021] GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54 => generated 1560 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 16:05:44.374551 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-f2f71298-bf23-4e32-a473-332786846bc4 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:05:44.375165 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-f2f71298-bf23-4e32-a473-332786846bc4 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] [instance: 013da7c4-ac69-4554-827b-d68e9bac0e54] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:05:44.382228 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-f2f71298-bf23-4e32-a473-332786846bc4 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:05:44.382670 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-f2f71298-bf23-4e32-a473-332786846bc4 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:05:44.383498 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-f2f71298-bf23-4e32-a473-332786846bc4 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:05:44.383926 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-f2f71298-bf23-4e32-a473-332786846bc4 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:05:44.520382 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-f2f71298-bf23-4e32-a473-332786846bc4 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6be4749041442787482b6e06b6c40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73f3238988e4e1293ad782712a1da53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 16:05:44.529004 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-f2f71298-bf23-4e32-a473-332786846bc4 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] 10.222.0.64 "GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54" status: 200 len: 1560 microversion: 2.1 time: 0.158199 Oct 27 16:05:44.529590 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 834/1600] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 16:05:44 2021] GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54 => generated 1560 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 16:05:45.545748 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-4d1bc14f-56e2-4cf2-9a7b-6562e07ea609 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:05:45.546352 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-4d1bc14f-56e2-4cf2-9a7b-6562e07ea609 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] [instance: 013da7c4-ac69-4554-827b-d68e9bac0e54] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:05:45.554601 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-4d1bc14f-56e2-4cf2-9a7b-6562e07ea609 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:05:45.555052 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-4d1bc14f-56e2-4cf2-9a7b-6562e07ea609 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:05:45.555835 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-4d1bc14f-56e2-4cf2-9a7b-6562e07ea609 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:05:45.556297 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-4d1bc14f-56e2-4cf2-9a7b-6562e07ea609 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:05:45.694051 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-4d1bc14f-56e2-4cf2-9a7b-6562e07ea609 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6be4749041442787482b6e06b6c40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73f3238988e4e1293ad782712a1da53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 16:05:45.702208 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-4d1bc14f-56e2-4cf2-9a7b-6562e07ea609 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] 10.222.0.64 "GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54" status: 200 len: 1560 microversion: 2.1 time: 0.160043 Oct 27 16:05:45.702790 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 767/1601] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 16:05:45 2021] GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54 => generated 1560 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 16:05:46.721777 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-b9f77f35-afa6-45cc-9abd-ad67f899db7e tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:05:46.722516 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-b9f77f35-afa6-45cc-9abd-ad67f899db7e tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] [instance: 013da7c4-ac69-4554-827b-d68e9bac0e54] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:05:46.729390 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-b9f77f35-afa6-45cc-9abd-ad67f899db7e tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:05:46.729828 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-b9f77f35-afa6-45cc-9abd-ad67f899db7e tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:05:46.730599 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-b9f77f35-afa6-45cc-9abd-ad67f899db7e tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:05:46.731031 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-b9f77f35-afa6-45cc-9abd-ad67f899db7e tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:05:46.868577 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-b9f77f35-afa6-45cc-9abd-ad67f899db7e tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6be4749041442787482b6e06b6c40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73f3238988e4e1293ad782712a1da53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 16:05:46.878888 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-b9f77f35-afa6-45cc-9abd-ad67f899db7e tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] 10.222.0.64 "GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54" status: 200 len: 1560 microversion: 2.1 time: 0.161175 Oct 27 16:05:46.879628 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 835/1602] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 16:05:46 2021] GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54 => generated 1560 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 16:05:47.898064 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-b556dd41-50e7-4e07-be09-96050d3a5bce tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:05:47.898903 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-b556dd41-50e7-4e07-be09-96050d3a5bce tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] [instance: 013da7c4-ac69-4554-827b-d68e9bac0e54] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:05:47.905363 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-b556dd41-50e7-4e07-be09-96050d3a5bce tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:05:47.905806 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-b556dd41-50e7-4e07-be09-96050d3a5bce tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:05:47.906585 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-b556dd41-50e7-4e07-be09-96050d3a5bce tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:05:47.907013 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-b556dd41-50e7-4e07-be09-96050d3a5bce tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:05:48.084124 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-b556dd41-50e7-4e07-be09-96050d3a5bce tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6be4749041442787482b6e06b6c40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73f3238988e4e1293ad782712a1da53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 16:05:48.092604 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-b556dd41-50e7-4e07-be09-96050d3a5bce tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] 10.222.0.64 "GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54" status: 200 len: 1560 microversion: 2.1 time: 0.198318 Oct 27 16:05:48.093192 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 768/1603] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 16:05:47 2021] GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54 => generated 1560 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 16:05:49.109763 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-38b34df0-eb4d-4777-bcb9-39077a13eea2 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:05:49.110374 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-38b34df0-eb4d-4777-bcb9-39077a13eea2 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] [instance: 013da7c4-ac69-4554-827b-d68e9bac0e54] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:05:49.117215 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-38b34df0-eb4d-4777-bcb9-39077a13eea2 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:05:49.117663 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-38b34df0-eb4d-4777-bcb9-39077a13eea2 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:05:49.118436 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-38b34df0-eb4d-4777-bcb9-39077a13eea2 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:05:49.118868 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-38b34df0-eb4d-4777-bcb9-39077a13eea2 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:05:49.242212 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-38b34df0-eb4d-4777-bcb9-39077a13eea2 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6be4749041442787482b6e06b6c40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73f3238988e4e1293ad782712a1da53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 16:05:49.250096 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-38b34df0-eb4d-4777-bcb9-39077a13eea2 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] 10.222.0.64 "GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54" status: 200 len: 1560 microversion: 2.1 time: 0.144036 Oct 27 16:05:49.250667 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 836/1604] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 16:05:49 2021] GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54 => generated 1560 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 16:05:50.267169 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-3842be94-e716-40de-81d0-06a7c8464ff8 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:05:50.268401 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-3842be94-e716-40de-81d0-06a7c8464ff8 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] [instance: 013da7c4-ac69-4554-827b-d68e9bac0e54] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:05:50.274504 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-3842be94-e716-40de-81d0-06a7c8464ff8 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:05:50.274952 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-3842be94-e716-40de-81d0-06a7c8464ff8 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:05:50.275723 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-3842be94-e716-40de-81d0-06a7c8464ff8 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:05:50.276182 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-3842be94-e716-40de-81d0-06a7c8464ff8 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:05:50.405592 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-3842be94-e716-40de-81d0-06a7c8464ff8 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6be4749041442787482b6e06b6c40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73f3238988e4e1293ad782712a1da53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 16:05:50.415233 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-3842be94-e716-40de-81d0-06a7c8464ff8 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] 10.222.0.64 "GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54" status: 200 len: 1560 microversion: 2.1 time: 0.151679 Oct 27 16:05:50.415843 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 769/1605] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 16:05:50 2021] GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 16:05:51.436228 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-4e3e3de3-a72a-44cb-a195-501d41d65058 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:05:51.437216 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-4e3e3de3-a72a-44cb-a195-501d41d65058 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] [instance: 013da7c4-ac69-4554-827b-d68e9bac0e54] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:05:51.448895 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-4e3e3de3-a72a-44cb-a195-501d41d65058 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:05:51.449670 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-4e3e3de3-a72a-44cb-a195-501d41d65058 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:05:51.450780 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-4e3e3de3-a72a-44cb-a195-501d41d65058 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:05:51.451447 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-4e3e3de3-a72a-44cb-a195-501d41d65058 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:05:51.598669 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-4e3e3de3-a72a-44cb-a195-501d41d65058 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6be4749041442787482b6e06b6c40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73f3238988e4e1293ad782712a1da53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 16:05:51.606506 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-4e3e3de3-a72a-44cb-a195-501d41d65058 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] 10.222.0.64 "GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54" status: 200 len: 1560 microversion: 2.1 time: 0.175586 Oct 27 16:05:51.607089 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 837/1606] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 16:05:51 2021] GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54 => generated 1560 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 16:05:52.624441 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-459c866d-d209-4105-876b-e75f23384c4b tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:05:52.625089 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-459c866d-d209-4105-876b-e75f23384c4b tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] [instance: 013da7c4-ac69-4554-827b-d68e9bac0e54] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:05:52.631615 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-459c866d-d209-4105-876b-e75f23384c4b tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:05:52.632093 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-459c866d-d209-4105-876b-e75f23384c4b tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:05:52.632856 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-459c866d-d209-4105-876b-e75f23384c4b tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:05:52.633281 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-459c866d-d209-4105-876b-e75f23384c4b tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:05:52.766104 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-459c866d-d209-4105-876b-e75f23384c4b tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6be4749041442787482b6e06b6c40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73f3238988e4e1293ad782712a1da53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 16:05:52.775716 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-459c866d-d209-4105-876b-e75f23384c4b tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] 10.222.0.64 "GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54" status: 200 len: 1560 microversion: 2.1 time: 0.154916 Oct 27 16:05:52.776349 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 770/1607] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 16:05:52 2021] GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54 => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 16:05:53.793883 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-d75dbde9-99e0-4f59-a6ef-4dac60e72285 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:05:53.794722 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-d75dbde9-99e0-4f59-a6ef-4dac60e72285 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] [instance: 013da7c4-ac69-4554-827b-d68e9bac0e54] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:05:53.802206 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-d75dbde9-99e0-4f59-a6ef-4dac60e72285 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:05:53.802707 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-d75dbde9-99e0-4f59-a6ef-4dac60e72285 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:05:53.803492 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-d75dbde9-99e0-4f59-a6ef-4dac60e72285 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:05:53.803964 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-d75dbde9-99e0-4f59-a6ef-4dac60e72285 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:05:53.935260 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-d75dbde9-99e0-4f59-a6ef-4dac60e72285 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6be4749041442787482b6e06b6c40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73f3238988e4e1293ad782712a1da53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 16:05:53.943274 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-d75dbde9-99e0-4f59-a6ef-4dac60e72285 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] 10.222.0.64 "GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54" status: 200 len: 1560 microversion: 2.1 time: 0.153311 Oct 27 16:05:53.943834 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 838/1608] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 16:05:53 2021] GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54 => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 16:05:54.962062 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-89cbe96e-ad1f-4b13-848c-e11fcd24c3e2 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:05:54.962674 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-89cbe96e-ad1f-4b13-848c-e11fcd24c3e2 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] [instance: 013da7c4-ac69-4554-827b-d68e9bac0e54] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:05:54.969447 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-89cbe96e-ad1f-4b13-848c-e11fcd24c3e2 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:05:54.969984 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-89cbe96e-ad1f-4b13-848c-e11fcd24c3e2 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:05:54.971472 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-89cbe96e-ad1f-4b13-848c-e11fcd24c3e2 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:05:54.971971 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-89cbe96e-ad1f-4b13-848c-e11fcd24c3e2 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:05:55.103614 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-89cbe96e-ad1f-4b13-848c-e11fcd24c3e2 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6be4749041442787482b6e06b6c40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73f3238988e4e1293ad782712a1da53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 16:05:55.111619 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-89cbe96e-ad1f-4b13-848c-e11fcd24c3e2 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] 10.222.0.64 "GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54" status: 200 len: 1560 microversion: 2.1 time: 0.154028 Oct 27 16:05:55.112225 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 771/1609] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 16:05:54 2021] GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54 => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 16:05:56.130067 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-273f6c2a-1e6b-45dd-b540-59c9fd1c2271 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:05:56.130621 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-273f6c2a-1e6b-45dd-b540-59c9fd1c2271 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] [instance: 013da7c4-ac69-4554-827b-d68e9bac0e54] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:05:56.137001 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-273f6c2a-1e6b-45dd-b540-59c9fd1c2271 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:05:56.137447 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-273f6c2a-1e6b-45dd-b540-59c9fd1c2271 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:05:56.138215 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-273f6c2a-1e6b-45dd-b540-59c9fd1c2271 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:05:56.138646 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-273f6c2a-1e6b-45dd-b540-59c9fd1c2271 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:05:56.262658 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-273f6c2a-1e6b-45dd-b540-59c9fd1c2271 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6be4749041442787482b6e06b6c40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73f3238988e4e1293ad782712a1da53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 16:05:56.271184 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-273f6c2a-1e6b-45dd-b540-59c9fd1c2271 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] 10.222.0.64 "GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54" status: 200 len: 1560 microversion: 2.1 time: 0.145668 Oct 27 16:05:56.271741 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 839/1610] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 16:05:56 2021] GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54 => generated 1560 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 16:05:57.136400 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 27 16:05:57.137061 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: Wed Oct 27 16:05:57 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Oct 27 16:05:57.288092 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-fb8065f9-7574-402c-a651-30bebc53efd1 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:05:57.288847 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-fb8065f9-7574-402c-a651-30bebc53efd1 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] [instance: 013da7c4-ac69-4554-827b-d68e9bac0e54] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:05:57.295241 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-fb8065f9-7574-402c-a651-30bebc53efd1 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:05:57.295673 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-fb8065f9-7574-402c-a651-30bebc53efd1 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:05:57.296289 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-fb8065f9-7574-402c-a651-30bebc53efd1 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:05:57.296724 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-fb8065f9-7574-402c-a651-30bebc53efd1 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:05:57.477086 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-fb8065f9-7574-402c-a651-30bebc53efd1 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6be4749041442787482b6e06b6c40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73f3238988e4e1293ad782712a1da53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 16:05:57.490554 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-fb8065f9-7574-402c-a651-30bebc53efd1 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] 10.222.0.64 "GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54" status: 200 len: 1560 microversion: 2.1 time: 0.205782 Oct 27 16:05:57.491577 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 772/1611] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 16:05:57 2021] GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54 => generated 1560 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 16:05:58.508989 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-bdeb8b2c-e0df-4700-8fc9-b11e80fd6cb7 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:05:58.509592 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-bdeb8b2c-e0df-4700-8fc9-b11e80fd6cb7 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] [instance: 013da7c4-ac69-4554-827b-d68e9bac0e54] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:05:58.516265 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-bdeb8b2c-e0df-4700-8fc9-b11e80fd6cb7 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:05:58.516936 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-bdeb8b2c-e0df-4700-8fc9-b11e80fd6cb7 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:05:58.518337 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-bdeb8b2c-e0df-4700-8fc9-b11e80fd6cb7 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:05:58.518337 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-bdeb8b2c-e0df-4700-8fc9-b11e80fd6cb7 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:05:58.641149 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-bdeb8b2c-e0df-4700-8fc9-b11e80fd6cb7 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6be4749041442787482b6e06b6c40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73f3238988e4e1293ad782712a1da53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 16:05:58.648931 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-bdeb8b2c-e0df-4700-8fc9-b11e80fd6cb7 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] 10.222.0.64 "GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54" status: 200 len: 1560 microversion: 2.1 time: 0.143602 Oct 27 16:05:58.649491 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 840/1612] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 16:05:58 2021] GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54 => generated 1560 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 16:05:59.666132 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-225175ae-bdd1-44f8-a81f-be903cf176ba tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:05:59.666740 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-225175ae-bdd1-44f8-a81f-be903cf176ba tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] [instance: 013da7c4-ac69-4554-827b-d68e9bac0e54] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:05:59.673401 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-225175ae-bdd1-44f8-a81f-be903cf176ba tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:05:59.673839 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-225175ae-bdd1-44f8-a81f-be903cf176ba tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:05:59.674616 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-225175ae-bdd1-44f8-a81f-be903cf176ba tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:05:59.675071 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-225175ae-bdd1-44f8-a81f-be903cf176ba tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:05:59.808297 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-225175ae-bdd1-44f8-a81f-be903cf176ba tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6be4749041442787482b6e06b6c40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73f3238988e4e1293ad782712a1da53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 16:05:59.817165 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-225175ae-bdd1-44f8-a81f-be903cf176ba tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] 10.222.0.64 "GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54" status: 200 len: 1560 microversion: 2.1 time: 0.154684 Oct 27 16:05:59.817745 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 773/1613] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 16:05:59 2021] GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54 => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 16:06:00.834096 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-7b2b0bfe-fdc9-43d1-932c-42addac640a3 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:06:00.834729 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-7b2b0bfe-fdc9-43d1-932c-42addac640a3 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] [instance: 013da7c4-ac69-4554-827b-d68e9bac0e54] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:06:00.841314 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-7b2b0bfe-fdc9-43d1-932c-42addac640a3 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:06:00.841753 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-7b2b0bfe-fdc9-43d1-932c-42addac640a3 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:06:00.842526 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-7b2b0bfe-fdc9-43d1-932c-42addac640a3 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:06:00.842955 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-7b2b0bfe-fdc9-43d1-932c-42addac640a3 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:06:00.972998 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-7b2b0bfe-fdc9-43d1-932c-42addac640a3 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6be4749041442787482b6e06b6c40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73f3238988e4e1293ad782712a1da53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 16:06:00.981534 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-7b2b0bfe-fdc9-43d1-932c-42addac640a3 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] 10.222.0.64 "GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54" status: 200 len: 1560 microversion: 2.1 time: 0.151618 Oct 27 16:06:00.982111 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 841/1614] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 16:06:00 2021] GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 16:06:01.998501 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-fb183c60-64a7-4ff0-a27b-6930a34a8602 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:06:01.999127 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-fb183c60-64a7-4ff0-a27b-6930a34a8602 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] [instance: 013da7c4-ac69-4554-827b-d68e9bac0e54] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:06:02.006045 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-fb183c60-64a7-4ff0-a27b-6930a34a8602 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:06:02.006591 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-fb183c60-64a7-4ff0-a27b-6930a34a8602 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:06:02.007391 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-fb183c60-64a7-4ff0-a27b-6930a34a8602 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:06:02.007923 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-fb183c60-64a7-4ff0-a27b-6930a34a8602 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:06:02.138770 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-fb183c60-64a7-4ff0-a27b-6930a34a8602 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6be4749041442787482b6e06b6c40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73f3238988e4e1293ad782712a1da53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 16:06:02.146672 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-fb183c60-64a7-4ff0-a27b-6930a34a8602 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] 10.222.0.64 "GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54" status: 200 len: 1560 microversion: 2.1 time: 0.151958 Oct 27 16:06:02.147243 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 774/1615] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 16:06:01 2021] GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 16:06:03.163120 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-1fa582a2-433d-442f-aacd-9ceb5f70bbe8 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:06:03.163726 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-1fa582a2-433d-442f-aacd-9ceb5f70bbe8 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] [instance: 013da7c4-ac69-4554-827b-d68e9bac0e54] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:06:03.169999 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-1fa582a2-433d-442f-aacd-9ceb5f70bbe8 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:06:03.170389 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-1fa582a2-433d-442f-aacd-9ceb5f70bbe8 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:06:03.171155 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-1fa582a2-433d-442f-aacd-9ceb5f70bbe8 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:06:03.171589 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-1fa582a2-433d-442f-aacd-9ceb5f70bbe8 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:06:03.290973 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-1fa582a2-433d-442f-aacd-9ceb5f70bbe8 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6be4749041442787482b6e06b6c40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73f3238988e4e1293ad782712a1da53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 16:06:03.299267 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-1fa582a2-433d-442f-aacd-9ceb5f70bbe8 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] 10.222.0.64 "GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54" status: 200 len: 1560 microversion: 2.1 time: 0.139240 Oct 27 16:06:03.299841 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 842/1616] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 16:06:03 2021] GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54 => generated 1560 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 16:06:04.316373 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-b9afca17-03ff-488b-8c8f-e64e93bcf524 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:06:04.316980 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-b9afca17-03ff-488b-8c8f-e64e93bcf524 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] [instance: 013da7c4-ac69-4554-827b-d68e9bac0e54] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:06:04.323135 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-b9afca17-03ff-488b-8c8f-e64e93bcf524 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:06:04.323574 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-b9afca17-03ff-488b-8c8f-e64e93bcf524 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:06:04.324364 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-b9afca17-03ff-488b-8c8f-e64e93bcf524 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:06:04.324794 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-b9afca17-03ff-488b-8c8f-e64e93bcf524 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:06:04.445031 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-b9afca17-03ff-488b-8c8f-e64e93bcf524 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6be4749041442787482b6e06b6c40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73f3238988e4e1293ad782712a1da53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 16:06:04.452953 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-b9afca17-03ff-488b-8c8f-e64e93bcf524 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] 10.222.0.64 "GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54" status: 200 len: 1560 microversion: 2.1 time: 0.140857 Oct 27 16:06:04.453516 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 775/1617] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 16:06:04 2021] GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54 => generated 1560 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 16:06:05.470942 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-955a6f63-68fc-42f2-8b17-6282ce9e5de4 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:06:05.471487 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-955a6f63-68fc-42f2-8b17-6282ce9e5de4 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] [instance: 013da7c4-ac69-4554-827b-d68e9bac0e54] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:06:05.477702 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-955a6f63-68fc-42f2-8b17-6282ce9e5de4 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:06:05.478152 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-955a6f63-68fc-42f2-8b17-6282ce9e5de4 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:06:05.478915 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-955a6f63-68fc-42f2-8b17-6282ce9e5de4 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:06:05.479351 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-955a6f63-68fc-42f2-8b17-6282ce9e5de4 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:06:05.605932 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-955a6f63-68fc-42f2-8b17-6282ce9e5de4 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6be4749041442787482b6e06b6c40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73f3238988e4e1293ad782712a1da53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 16:06:05.614494 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-955a6f63-68fc-42f2-8b17-6282ce9e5de4 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] 10.222.0.64 "GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54" status: 200 len: 1560 microversion: 2.1 time: 0.147333 Oct 27 16:06:05.615548 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 843/1618] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 16:06:05 2021] GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54 => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 16:06:06.632139 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-47476542-a26f-4bee-ae71-904d910f4e23 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:06:06.632800 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-47476542-a26f-4bee-ae71-904d910f4e23 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] [instance: 013da7c4-ac69-4554-827b-d68e9bac0e54] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:06:06.639500 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-47476542-a26f-4bee-ae71-904d910f4e23 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:06:06.639982 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-47476542-a26f-4bee-ae71-904d910f4e23 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:06:06.640746 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-47476542-a26f-4bee-ae71-904d910f4e23 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:06:06.641441 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-47476542-a26f-4bee-ae71-904d910f4e23 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:06:06.772294 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-47476542-a26f-4bee-ae71-904d910f4e23 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6be4749041442787482b6e06b6c40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73f3238988e4e1293ad782712a1da53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 16:06:06.779904 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-47476542-a26f-4bee-ae71-904d910f4e23 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] 10.222.0.64 "GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54" status: 200 len: 1560 microversion: 2.1 time: 0.151625 Oct 27 16:06:06.780658 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 776/1619] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 16:06:06 2021] GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 16:06:07.796999 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-dcbbe607-a71d-4c87-8d12-7d318ac5709c tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:06:07.797590 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-dcbbe607-a71d-4c87-8d12-7d318ac5709c tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] [instance: 013da7c4-ac69-4554-827b-d68e9bac0e54] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:06:07.803884 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-dcbbe607-a71d-4c87-8d12-7d318ac5709c tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:06:07.804322 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-dcbbe607-a71d-4c87-8d12-7d318ac5709c tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:06:07.805079 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-dcbbe607-a71d-4c87-8d12-7d318ac5709c tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:06:07.805503 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-dcbbe607-a71d-4c87-8d12-7d318ac5709c tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:06:07.927240 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-dcbbe607-a71d-4c87-8d12-7d318ac5709c tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6be4749041442787482b6e06b6c40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73f3238988e4e1293ad782712a1da53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 16:06:07.934932 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-dcbbe607-a71d-4c87-8d12-7d318ac5709c tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] 10.222.0.64 "GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54" status: 200 len: 1560 microversion: 2.1 time: 0.141612 Oct 27 16:06:07.935503 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 844/1620] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 16:06:07 2021] GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54 => generated 1560 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 16:06:08.952697 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-205efa72-e885-4417-8aa1-5c0cf412f976 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:06:08.953306 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-205efa72-e885-4417-8aa1-5c0cf412f976 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] [instance: 013da7c4-ac69-4554-827b-d68e9bac0e54] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:06:08.960655 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-205efa72-e885-4417-8aa1-5c0cf412f976 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:06:08.961103 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-205efa72-e885-4417-8aa1-5c0cf412f976 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:06:08.961893 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-205efa72-e885-4417-8aa1-5c0cf412f976 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:06:08.962329 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-205efa72-e885-4417-8aa1-5c0cf412f976 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:06:09.095698 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-205efa72-e885-4417-8aa1-5c0cf412f976 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6be4749041442787482b6e06b6c40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73f3238988e4e1293ad782712a1da53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 16:06:09.103456 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-205efa72-e885-4417-8aa1-5c0cf412f976 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] 10.222.0.64 "GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54" status: 200 len: 1560 microversion: 2.1 time: 0.154393 Oct 27 16:06:09.104069 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 777/1621] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 16:06:08 2021] GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54 => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 16:06:10.121166 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-6a657e59-c978-4987-bbdd-f765c987d5ef tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:06:10.121763 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-6a657e59-c978-4987-bbdd-f765c987d5ef tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] [instance: 013da7c4-ac69-4554-827b-d68e9bac0e54] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:06:10.129050 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-6a657e59-c978-4987-bbdd-f765c987d5ef tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:06:10.129490 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-6a657e59-c978-4987-bbdd-f765c987d5ef tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:06:10.130249 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-6a657e59-c978-4987-bbdd-f765c987d5ef tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:06:10.130674 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-6a657e59-c978-4987-bbdd-f765c987d5ef tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:06:10.260033 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-6a657e59-c978-4987-bbdd-f765c987d5ef tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6be4749041442787482b6e06b6c40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73f3238988e4e1293ad782712a1da53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 16:06:10.267982 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-6a657e59-c978-4987-bbdd-f765c987d5ef tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] 10.222.0.64 "GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54" status: 200 len: 1560 microversion: 2.1 time: 0.150548 Oct 27 16:06:10.268552 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 845/1622] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 16:06:10 2021] GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 16:06:11.288859 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-25878a49-8c16-4c6a-8ae3-3fd2a6b13896 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:06:11.289817 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-25878a49-8c16-4c6a-8ae3-3fd2a6b13896 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] [instance: 013da7c4-ac69-4554-827b-d68e9bac0e54] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:06:11.299111 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-25878a49-8c16-4c6a-8ae3-3fd2a6b13896 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:06:11.299788 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-25878a49-8c16-4c6a-8ae3-3fd2a6b13896 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:06:11.301019 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-25878a49-8c16-4c6a-8ae3-3fd2a6b13896 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:06:11.301862 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-25878a49-8c16-4c6a-8ae3-3fd2a6b13896 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:06:11.442041 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-25878a49-8c16-4c6a-8ae3-3fd2a6b13896 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6be4749041442787482b6e06b6c40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73f3238988e4e1293ad782712a1da53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 16:06:11.449726 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-25878a49-8c16-4c6a-8ae3-3fd2a6b13896 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] 10.222.0.64 "GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54" status: 200 len: 1560 microversion: 2.1 time: 0.167482 Oct 27 16:06:11.450285 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 778/1623] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 16:06:11 2021] GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54 => generated 1560 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 16:06:12.088613 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-9ea7752f-efd2-4029-bb52-de646754cdda tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:06:12.089228 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-9ea7752f-efd2-4029-bb52-de646754cdda tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: 9f9373f8-c3ad-4d3c-ac64-e5edf9cb4cd6] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:06:12.096235 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-9ea7752f-efd2-4029-bb52-de646754cdda tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:06:12.096771 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-9ea7752f-efd2-4029-bb52-de646754cdda tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:06:12.097555 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-9ea7752f-efd2-4029-bb52-de646754cdda tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:06:12.097988 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-9ea7752f-efd2-4029-bb52-de646754cdda tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:06:12.132155 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-9ea7752f-efd2-4029-bb52-de646754cdda tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: 9f9373f8-c3ad-4d3c-ac64-e5edf9cb4cd6] Going to try to terminate instance {{(pid=122224) delete /opt/stack/nova/nova/compute/api.py:2612}} Oct 27 16:06:12.230798 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-9ea7752f-efd2-4029-bb52-de646754cdda tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "DELETE /compute/v2.1/servers/9f9373f8-c3ad-4d3c-ac64-e5edf9cb4cd6" status: 204 len: 0 microversion: 2.20 time: 0.145823 Oct 27 16:06:12.231575 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 846/1624] 10.222.0.64 () {60 vars in 1279 bytes} [Wed Oct 27 16:06:12 2021] DELETE /compute/v2.1/servers/9f9373f8-c3ad-4d3c-ac64-e5edf9cb4cd6 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 27 16:06:12.241004 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-4b713249-0464-488a-9fcf-5fe19a39d684 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:06:12.241666 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-4b713249-0464-488a-9fcf-5fe19a39d684 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: 9f9373f8-c3ad-4d3c-ac64-e5edf9cb4cd6] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:06:12.247557 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-4b713249-0464-488a-9fcf-5fe19a39d684 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:06:12.248042 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-4b713249-0464-488a-9fcf-5fe19a39d684 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:06:12.248805 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-4b713249-0464-488a-9fcf-5fe19a39d684 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:06:12.249238 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-4b713249-0464-488a-9fcf-5fe19a39d684 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:06:12.384829 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-4b713249-0464-488a-9fcf-5fe19a39d684 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 16:06:12.393498 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-4b713249-0464-488a-9fcf-5fe19a39d684 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 16:06:12.395008 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-4b713249-0464-488a-9fcf-5fe19a39d684 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 16:06:12.396219 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-4b713249-0464-488a-9fcf-5fe19a39d684 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "GET /compute/v2.1/servers/9f9373f8-c3ad-4d3c-ac64-e5edf9cb4cd6" status: 200 len: 1724 microversion: 2.20 time: 0.159030 Oct 27 16:06:12.396997 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 779/1625] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Oct 27 16:06:12 2021] GET /compute/v2.1/servers/9f9373f8-c3ad-4d3c-ac64-e5edf9cb4cd6 => generated 1724 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 16:06:12.468725 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-d5e7c5a1-60f5-4475-9715-c5a3195de608 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:06:12.469430 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-d5e7c5a1-60f5-4475-9715-c5a3195de608 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] [instance: 013da7c4-ac69-4554-827b-d68e9bac0e54] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:06:12.477111 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-d5e7c5a1-60f5-4475-9715-c5a3195de608 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:06:12.477554 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-d5e7c5a1-60f5-4475-9715-c5a3195de608 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:06:12.478332 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-d5e7c5a1-60f5-4475-9715-c5a3195de608 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:06:12.478761 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-d5e7c5a1-60f5-4475-9715-c5a3195de608 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:06:12.620242 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-d5e7c5a1-60f5-4475-9715-c5a3195de608 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6be4749041442787482b6e06b6c40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73f3238988e4e1293ad782712a1da53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 16:06:12.628828 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-d5e7c5a1-60f5-4475-9715-c5a3195de608 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] 10.222.0.64 "GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54" status: 200 len: 1560 microversion: 2.1 time: 0.164217 Oct 27 16:06:12.629396 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 847/1626] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 16:06:12 2021] GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54 => generated 1560 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 16:06:13.415293 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-da92608c-cc27-47cd-8fc1-e74da4c8779b tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:06:13.416687 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-da92608c-cc27-47cd-8fc1-e74da4c8779b tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: 9f9373f8-c3ad-4d3c-ac64-e5edf9cb4cd6] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:06:13.422990 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-da92608c-cc27-47cd-8fc1-e74da4c8779b tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:06:13.424305 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-da92608c-cc27-47cd-8fc1-e74da4c8779b tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:06:13.425100 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-da92608c-cc27-47cd-8fc1-e74da4c8779b tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:06:13.425531 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-da92608c-cc27-47cd-8fc1-e74da4c8779b tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:06:13.492889 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-da92608c-cc27-47cd-8fc1-e74da4c8779b tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 16:06:13.501569 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-da92608c-cc27-47cd-8fc1-e74da4c8779b tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 16:06:13.503236 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-da92608c-cc27-47cd-8fc1-e74da4c8779b tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad48647323604612934a420a1accc6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230ec93c7707410da240669b0a3e26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 16:06:13.504601 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-da92608c-cc27-47cd-8fc1-e74da4c8779b tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "GET /compute/v2.1/servers/9f9373f8-c3ad-4d3c-ac64-e5edf9cb4cd6" status: 200 len: 1656 microversion: 2.20 time: 0.093057 Oct 27 16:06:13.520041 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 780/1627] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Oct 27 16:06:13 2021] GET /compute/v2.1/servers/9f9373f8-c3ad-4d3c-ac64-e5edf9cb4cd6 => generated 1656 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 16:06:13.648518 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-fe6b60ad-ac64-42c6-a1b1-548023ad8796 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:06:13.649627 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-fe6b60ad-ac64-42c6-a1b1-548023ad8796 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] [instance: 013da7c4-ac69-4554-827b-d68e9bac0e54] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:06:13.664198 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-fe6b60ad-ac64-42c6-a1b1-548023ad8796 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:06:13.665343 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-fe6b60ad-ac64-42c6-a1b1-548023ad8796 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:06:13.666446 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-fe6b60ad-ac64-42c6-a1b1-548023ad8796 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:06:13.667095 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-fe6b60ad-ac64-42c6-a1b1-548023ad8796 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:06:13.794633 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [req-9dabdc27-28c1-4f53-9073-87e547a8938c req-0515a9a8-d354-448d-9a48-479143d77d95 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9f9373f8-c3ad-4d3c-ac64-e5edf9cb4cd6", "name": "network-vif-deleted", "tag": "43a7889c-6014-4503-ab2d-82b1da4e36bd"}]} {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 16:06:13.796507 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 27 16:06:13.796507 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: warnings.warn(msg) Oct 27 16:06:13.803910 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [req-9dabdc27-28c1-4f53-9073-87e547a8938c req-0515a9a8-d354-448d-9a48-479143d77d95 service nova] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:06:13.804593 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [req-9dabdc27-28c1-4f53-9073-87e547a8938c req-0515a9a8-d354-448d-9a48-479143d77d95 service nova] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:06:13.822565 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.compute.server_external_events [req-9dabdc27-28c1-4f53-9073-87e547a8938c req-0515a9a8-d354-448d-9a48-479143d77d95 service nova] Creating event network-vif-deleted:43a7889c-6014-4503-ab2d-82b1da4e36bd for instance 9f9373f8-c3ad-4d3c-ac64-e5edf9cb4cd6 on hv-cinder-80070 Oct 27 16:06:13.827587 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [req-9dabdc27-28c1-4f53-9073-87e547a8938c req-0515a9a8-d354-448d-9a48-479143d77d95 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.281123 Oct 27 16:06:13.828476 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 848/1628] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Oct 27 16:06:13 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 16:06:13.867873 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-fe6b60ad-ac64-42c6-a1b1-548023ad8796 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6be4749041442787482b6e06b6c40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73f3238988e4e1293ad782712a1da53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 16:06:13.877636 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-fe6b60ad-ac64-42c6-a1b1-548023ad8796 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] 10.222.0.64 "GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54" status: 200 len: 1560 microversion: 2.1 time: 0.232665 Oct 27 16:06:13.877636 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 781/1629] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 16:06:13 2021] GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54 => generated 1560 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 16:06:14.530952 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-608ee0a4-0b37-4f65-b284-650c8abaa34d tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:06:14.531701 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-608ee0a4-0b37-4f65-b284-650c8abaa34d tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: 9f9373f8-c3ad-4d3c-ac64-e5edf9cb4cd6] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:06:14.538890 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-608ee0a4-0b37-4f65-b284-650c8abaa34d tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:06:14.539339 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-608ee0a4-0b37-4f65-b284-650c8abaa34d tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:06:14.540150 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-608ee0a4-0b37-4f65-b284-650c8abaa34d tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:06:14.540581 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-608ee0a4-0b37-4f65-b284-650c8abaa34d tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:06:14.556010 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.wsgi [None req-608ee0a4-0b37-4f65-b284-650c8abaa34d tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] HTTP exception thrown: Instance 9f9373f8-c3ad-4d3c-ac64-e5edf9cb4cd6 could not be found. Oct 27 16:06:14.556595 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-608ee0a4-0b37-4f65-b284-650c8abaa34d tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Returning 404 to user: Instance 9f9373f8-c3ad-4d3c-ac64-e5edf9cb4cd6 could not be found. {{(pid=122224) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 27 16:06:14.558334 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-608ee0a4-0b37-4f65-b284-650c8abaa34d tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "GET /compute/v2.1/servers/9f9373f8-c3ad-4d3c-ac64-e5edf9cb4cd6" status: 404 len: 111 microversion: 2.20 time: 0.031543 Oct 27 16:06:14.558955 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 849/1630] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Oct 27 16:06:14 2021] GET /compute/v2.1/servers/9f9373f8-c3ad-4d3c-ac64-e5edf9cb4cd6 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Oct 27 16:06:14.568578 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-fd69ad30-679e-4fcf-a2e7-899c11954e66 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Calling method '.version_select at 0x7fbc0655e0d0>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:06:14.589728 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-fd69ad30-679e-4fcf-a2e7-899c11954e66 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1671170217" status: 204 len: 0 microversion: 2.20 time: 0.025581 Oct 27 16:06:14.590316 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 782/1631] 10.222.0.64 () {60 vars in 1261 bytes} [Wed Oct 27 16:06:14 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1671170217 => generated 0 bytes in 27 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 27 16:06:14.894791 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-bb5a89ff-c382-4dd0-97cc-a6a9235ac3dc tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:06:14.895507 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-bb5a89ff-c382-4dd0-97cc-a6a9235ac3dc tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] [instance: 013da7c4-ac69-4554-827b-d68e9bac0e54] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:06:14.901870 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-bb5a89ff-c382-4dd0-97cc-a6a9235ac3dc tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:06:14.902309 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-bb5a89ff-c382-4dd0-97cc-a6a9235ac3dc tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:06:14.903133 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-bb5a89ff-c382-4dd0-97cc-a6a9235ac3dc tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:06:14.903660 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-bb5a89ff-c382-4dd0-97cc-a6a9235ac3dc tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:06:15.051468 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-bb5a89ff-c382-4dd0-97cc-a6a9235ac3dc tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6be4749041442787482b6e06b6c40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73f3238988e4e1293ad782712a1da53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 16:06:15.059948 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-bb5a89ff-c382-4dd0-97cc-a6a9235ac3dc tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] 10.222.0.64 "GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54" status: 200 len: 1560 microversion: 2.1 time: 0.169560 Oct 27 16:06:15.060562 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 850/1632] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 16:06:14 2021] GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54 => generated 1560 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 16:06:16.079071 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-527ea209-1d05-441f-8b2f-b03886146b40 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:06:16.079992 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-527ea209-1d05-441f-8b2f-b03886146b40 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] [instance: 013da7c4-ac69-4554-827b-d68e9bac0e54] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:06:16.087759 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-527ea209-1d05-441f-8b2f-b03886146b40 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:06:16.088414 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-527ea209-1d05-441f-8b2f-b03886146b40 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:06:16.089582 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-527ea209-1d05-441f-8b2f-b03886146b40 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:06:16.090089 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-527ea209-1d05-441f-8b2f-b03886146b40 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:06:16.241753 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-527ea209-1d05-441f-8b2f-b03886146b40 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6be4749041442787482b6e06b6c40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73f3238988e4e1293ad782712a1da53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 16:06:16.249842 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-527ea209-1d05-441f-8b2f-b03886146b40 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] 10.222.0.64 "GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54" status: 200 len: 1560 microversion: 2.1 time: 0.175035 Oct 27 16:06:16.250411 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 783/1633] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 16:06:16 2021] GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54 => generated 1560 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 16:06:17.267934 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-e8865451-d32e-4258-9adc-244abf203639 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:06:17.268628 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-e8865451-d32e-4258-9adc-244abf203639 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] [instance: 013da7c4-ac69-4554-827b-d68e9bac0e54] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:06:17.277823 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-e8865451-d32e-4258-9adc-244abf203639 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:06:17.278994 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-e8865451-d32e-4258-9adc-244abf203639 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:06:17.280343 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-e8865451-d32e-4258-9adc-244abf203639 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:06:17.281119 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-e8865451-d32e-4258-9adc-244abf203639 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:06:17.424724 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-e8865451-d32e-4258-9adc-244abf203639 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6be4749041442787482b6e06b6c40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73f3238988e4e1293ad782712a1da53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 16:06:17.433370 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-e8865451-d32e-4258-9adc-244abf203639 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] 10.222.0.64 "GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54" status: 200 len: 1560 microversion: 2.1 time: 0.169305 Oct 27 16:06:17.433953 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 851/1634] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 16:06:17 2021] GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54 => generated 1560 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 16:06:18.460960 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-c74161ab-cb70-45f8-9f02-06df47034e39 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:06:18.462035 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-c74161ab-cb70-45f8-9f02-06df47034e39 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] [instance: 013da7c4-ac69-4554-827b-d68e9bac0e54] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:06:18.469055 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-c74161ab-cb70-45f8-9f02-06df47034e39 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:06:18.469505 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-c74161ab-cb70-45f8-9f02-06df47034e39 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:06:18.470435 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-c74161ab-cb70-45f8-9f02-06df47034e39 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:06:18.470837 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-c74161ab-cb70-45f8-9f02-06df47034e39 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:06:18.620743 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-c74161ab-cb70-45f8-9f02-06df47034e39 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6be4749041442787482b6e06b6c40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73f3238988e4e1293ad782712a1da53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 16:06:18.635999 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-c74161ab-cb70-45f8-9f02-06df47034e39 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] 10.222.0.64 "GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54" status: 200 len: 1560 microversion: 2.1 time: 0.178827 Oct 27 16:06:18.637492 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 784/1635] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 16:06:18 2021] GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54 => generated 1560 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 16:06:19.005367 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 27 16:06:19.005709 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: Wed Oct 27 16:06:19 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Oct 27 16:06:19.667978 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-cc8513fe-d75a-477f-be43-4fe26048b38b tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:06:19.669869 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-cc8513fe-d75a-477f-be43-4fe26048b38b tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] [instance: 013da7c4-ac69-4554-827b-d68e9bac0e54] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:06:19.681117 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-cc8513fe-d75a-477f-be43-4fe26048b38b tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:06:19.681884 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-cc8513fe-d75a-477f-be43-4fe26048b38b tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:06:19.683211 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-cc8513fe-d75a-477f-be43-4fe26048b38b tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:06:19.684079 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-cc8513fe-d75a-477f-be43-4fe26048b38b tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:06:19.854711 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-cc8513fe-d75a-477f-be43-4fe26048b38b tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6be4749041442787482b6e06b6c40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73f3238988e4e1293ad782712a1da53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 16:06:19.868743 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-cc8513fe-d75a-477f-be43-4fe26048b38b tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] 10.222.0.64 "GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54" status: 200 len: 1560 microversion: 2.1 time: 0.207644 Oct 27 16:06:19.869656 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 852/1636] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 16:06:19 2021] GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54 => generated 1560 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 16:06:20.888720 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-687d62ae-f613-4369-bfa5-ea5bc594e1a4 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:06:20.889744 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-687d62ae-f613-4369-bfa5-ea5bc594e1a4 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] [instance: 013da7c4-ac69-4554-827b-d68e9bac0e54] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:06:20.898357 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-687d62ae-f613-4369-bfa5-ea5bc594e1a4 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:06:20.898945 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-687d62ae-f613-4369-bfa5-ea5bc594e1a4 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:06:20.900557 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-687d62ae-f613-4369-bfa5-ea5bc594e1a4 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:06:20.901093 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-687d62ae-f613-4369-bfa5-ea5bc594e1a4 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:06:21.092186 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-687d62ae-f613-4369-bfa5-ea5bc594e1a4 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6be4749041442787482b6e06b6c40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73f3238988e4e1293ad782712a1da53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 16:06:21.101107 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-687d62ae-f613-4369-bfa5-ea5bc594e1a4 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] 10.222.0.64 "GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54" status: 200 len: 1560 microversion: 2.1 time: 0.216427 Oct 27 16:06:21.101688 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 785/1637] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 16:06:20 2021] GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54 => generated 1560 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 16:06:22.119314 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-fa576d5a-ea99-48d9-ae1e-38f10cce0845 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:06:22.120000 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-fa576d5a-ea99-48d9-ae1e-38f10cce0845 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] [instance: 013da7c4-ac69-4554-827b-d68e9bac0e54] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:06:22.127750 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-fa576d5a-ea99-48d9-ae1e-38f10cce0845 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:06:22.128223 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-fa576d5a-ea99-48d9-ae1e-38f10cce0845 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:06:22.129027 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-fa576d5a-ea99-48d9-ae1e-38f10cce0845 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:06:22.129465 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-fa576d5a-ea99-48d9-ae1e-38f10cce0845 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:06:22.261648 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-fa576d5a-ea99-48d9-ae1e-38f10cce0845 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6be4749041442787482b6e06b6c40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73f3238988e4e1293ad782712a1da53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 16:06:22.270806 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-fa576d5a-ea99-48d9-ae1e-38f10cce0845 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] 10.222.0.64 "GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54" status: 200 len: 1560 microversion: 2.1 time: 0.155662 Oct 27 16:06:22.271394 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 853/1638] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 16:06:22 2021] GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54 => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 16:06:23.288223 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-76633051-a6ef-4b11-a050-8a62e5e77e2c tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:06:23.288816 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-76633051-a6ef-4b11-a050-8a62e5e77e2c tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] [instance: 013da7c4-ac69-4554-827b-d68e9bac0e54] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:06:23.295144 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-76633051-a6ef-4b11-a050-8a62e5e77e2c tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:06:23.295590 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-76633051-a6ef-4b11-a050-8a62e5e77e2c tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:06:23.296406 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-76633051-a6ef-4b11-a050-8a62e5e77e2c tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:06:23.296839 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-76633051-a6ef-4b11-a050-8a62e5e77e2c tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:06:23.426854 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-76633051-a6ef-4b11-a050-8a62e5e77e2c tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6be4749041442787482b6e06b6c40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73f3238988e4e1293ad782712a1da53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 16:06:23.434597 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-76633051-a6ef-4b11-a050-8a62e5e77e2c tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] 10.222.0.64 "GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54" status: 200 len: 1560 microversion: 2.1 time: 0.150247 Oct 27 16:06:23.435171 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 786/1639] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 16:06:23 2021] GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 16:06:24.452687 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-c38a5a54-f1ac-4a0b-9dc8-00a4ca70a114 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:06:24.453324 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-c38a5a54-f1ac-4a0b-9dc8-00a4ca70a114 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] [instance: 013da7c4-ac69-4554-827b-d68e9bac0e54] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:06:24.462338 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-c38a5a54-f1ac-4a0b-9dc8-00a4ca70a114 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:06:24.462791 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-c38a5a54-f1ac-4a0b-9dc8-00a4ca70a114 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:06:24.463597 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-c38a5a54-f1ac-4a0b-9dc8-00a4ca70a114 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:06:24.464065 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-c38a5a54-f1ac-4a0b-9dc8-00a4ca70a114 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:06:24.591358 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-c38a5a54-f1ac-4a0b-9dc8-00a4ca70a114 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6be4749041442787482b6e06b6c40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73f3238988e4e1293ad782712a1da53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 16:06:24.599627 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-c38a5a54-f1ac-4a0b-9dc8-00a4ca70a114 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] 10.222.0.64 "GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54" status: 200 len: 1560 microversion: 2.1 time: 0.150753 Oct 27 16:06:24.600210 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 854/1640] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 16:06:24 2021] GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 16:06:25.615997 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-8967ef54-a9c4-4751-a2ba-cc9a272594df tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:06:25.616569 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-8967ef54-a9c4-4751-a2ba-cc9a272594df tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] [instance: 013da7c4-ac69-4554-827b-d68e9bac0e54] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:06:25.622771 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-8967ef54-a9c4-4751-a2ba-cc9a272594df tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:06:25.623210 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-8967ef54-a9c4-4751-a2ba-cc9a272594df tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:06:25.624006 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-8967ef54-a9c4-4751-a2ba-cc9a272594df tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:06:25.624439 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-8967ef54-a9c4-4751-a2ba-cc9a272594df tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:06:25.755140 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-8967ef54-a9c4-4751-a2ba-cc9a272594df tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6be4749041442787482b6e06b6c40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73f3238988e4e1293ad782712a1da53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 16:06:25.763499 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-8967ef54-a9c4-4751-a2ba-cc9a272594df tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] 10.222.0.64 "GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54" status: 200 len: 1560 microversion: 2.1 time: 0.151209 Oct 27 16:06:25.764111 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 787/1641] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 16:06:25 2021] GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 16:06:26.784170 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-c5f507f2-6a4c-4432-a39c-42a195a64ef1 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:06:26.784783 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-c5f507f2-6a4c-4432-a39c-42a195a64ef1 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] [instance: 013da7c4-ac69-4554-827b-d68e9bac0e54] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:06:26.791122 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-c5f507f2-6a4c-4432-a39c-42a195a64ef1 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:06:26.791566 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-c5f507f2-6a4c-4432-a39c-42a195a64ef1 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:06:26.792377 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-c5f507f2-6a4c-4432-a39c-42a195a64ef1 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:06:26.792829 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-c5f507f2-6a4c-4432-a39c-42a195a64ef1 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:06:26.936230 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-c5f507f2-6a4c-4432-a39c-42a195a64ef1 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6be4749041442787482b6e06b6c40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73f3238988e4e1293ad782712a1da53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 16:06:26.944797 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-c5f507f2-6a4c-4432-a39c-42a195a64ef1 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] 10.222.0.64 "GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54" status: 200 len: 1560 microversion: 2.1 time: 0.164763 Oct 27 16:06:26.945382 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 855/1642] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 16:06:26 2021] GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54 => generated 1560 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 16:06:27.962724 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-a31cc45a-36e0-4cc7-9a35-f0d0297b7f4e tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:06:27.963405 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-a31cc45a-36e0-4cc7-9a35-f0d0297b7f4e tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] [instance: 013da7c4-ac69-4554-827b-d68e9bac0e54] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:06:27.970390 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-a31cc45a-36e0-4cc7-9a35-f0d0297b7f4e tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:06:27.970832 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-a31cc45a-36e0-4cc7-9a35-f0d0297b7f4e tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:06:27.971609 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-a31cc45a-36e0-4cc7-9a35-f0d0297b7f4e tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:06:27.972078 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-a31cc45a-36e0-4cc7-9a35-f0d0297b7f4e tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:06:28.105625 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-a31cc45a-36e0-4cc7-9a35-f0d0297b7f4e tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6be4749041442787482b6e06b6c40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73f3238988e4e1293ad782712a1da53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 16:06:28.114922 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-a31cc45a-36e0-4cc7-9a35-f0d0297b7f4e tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] 10.222.0.64 "GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54" status: 200 len: 1560 microversion: 2.1 time: 0.156255 Oct 27 16:06:28.115510 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 788/1643] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 16:06:27 2021] GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54 => generated 1560 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 16:06:29.144117 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-5d7cd695-f338-443f-a771-c2ac559155bd tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:06:29.144759 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-5d7cd695-f338-443f-a771-c2ac559155bd tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] [instance: 013da7c4-ac69-4554-827b-d68e9bac0e54] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:06:29.152857 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-5d7cd695-f338-443f-a771-c2ac559155bd tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:06:29.153441 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-5d7cd695-f338-443f-a771-c2ac559155bd tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:06:29.154486 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-5d7cd695-f338-443f-a771-c2ac559155bd tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:06:29.155012 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-5d7cd695-f338-443f-a771-c2ac559155bd tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:06:29.315308 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-5d7cd695-f338-443f-a771-c2ac559155bd tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6be4749041442787482b6e06b6c40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73f3238988e4e1293ad782712a1da53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 16:06:29.324045 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-5d7cd695-f338-443f-a771-c2ac559155bd tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] 10.222.0.64 "GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54" status: 200 len: 1560 microversion: 2.1 time: 0.184827 Oct 27 16:06:29.324742 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 856/1644] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 16:06:29 2021] GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54 => generated 1560 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 16:06:30.343040 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-08275cac-a0bf-41f2-8b8f-de31fcd8ae80 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:06:30.343734 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-08275cac-a0bf-41f2-8b8f-de31fcd8ae80 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] [instance: 013da7c4-ac69-4554-827b-d68e9bac0e54] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:06:30.351439 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-08275cac-a0bf-41f2-8b8f-de31fcd8ae80 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:06:30.351923 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-08275cac-a0bf-41f2-8b8f-de31fcd8ae80 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:06:30.352743 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-08275cac-a0bf-41f2-8b8f-de31fcd8ae80 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:06:30.353213 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-08275cac-a0bf-41f2-8b8f-de31fcd8ae80 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:06:30.486873 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-08275cac-a0bf-41f2-8b8f-de31fcd8ae80 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6be4749041442787482b6e06b6c40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73f3238988e4e1293ad782712a1da53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 16:06:30.495301 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-08275cac-a0bf-41f2-8b8f-de31fcd8ae80 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] 10.222.0.64 "GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54" status: 200 len: 1560 microversion: 2.1 time: 0.156051 Oct 27 16:06:30.496138 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 789/1645] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 16:06:30 2021] GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54 => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 16:06:31.514537 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-5189798f-f498-4e45-aaeb-6939ddc102d4 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:06:31.515368 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-5189798f-f498-4e45-aaeb-6939ddc102d4 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] [instance: 013da7c4-ac69-4554-827b-d68e9bac0e54] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:06:31.522592 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-5189798f-f498-4e45-aaeb-6939ddc102d4 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:06:31.523039 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-5189798f-f498-4e45-aaeb-6939ddc102d4 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:06:31.523821 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-5189798f-f498-4e45-aaeb-6939ddc102d4 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:06:31.524334 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-5189798f-f498-4e45-aaeb-6939ddc102d4 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:06:31.666612 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-5189798f-f498-4e45-aaeb-6939ddc102d4 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6be4749041442787482b6e06b6c40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73f3238988e4e1293ad782712a1da53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 16:06:31.676274 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-5189798f-f498-4e45-aaeb-6939ddc102d4 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] 10.222.0.64 "GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54" status: 200 len: 1560 microversion: 2.1 time: 0.165336 Oct 27 16:06:31.677004 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 857/1646] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 16:06:31 2021] GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54 => generated 1560 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 16:06:32.705529 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-f89352b4-03a4-4665-a513-d2eba150d384 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:06:32.706167 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-f89352b4-03a4-4665-a513-d2eba150d384 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] [instance: 013da7c4-ac69-4554-827b-d68e9bac0e54] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:06:32.712760 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-f89352b4-03a4-4665-a513-d2eba150d384 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:06:32.713206 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-f89352b4-03a4-4665-a513-d2eba150d384 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:06:32.713987 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-f89352b4-03a4-4665-a513-d2eba150d384 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:06:32.714419 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-f89352b4-03a4-4665-a513-d2eba150d384 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:06:32.850037 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-f89352b4-03a4-4665-a513-d2eba150d384 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6be4749041442787482b6e06b6c40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73f3238988e4e1293ad782712a1da53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 16:06:32.861384 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-f89352b4-03a4-4665-a513-d2eba150d384 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] 10.222.0.64 "GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54" status: 200 len: 1560 microversion: 2.1 time: 0.160847 Oct 27 16:06:32.862092 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 790/1647] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 16:06:32 2021] GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54 => generated 1560 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 16:06:33.882988 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-4218fdc0-2327-4006-8045-ad09db36fa50 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:06:33.883639 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-4218fdc0-2327-4006-8045-ad09db36fa50 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] [instance: 013da7c4-ac69-4554-827b-d68e9bac0e54] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:06:33.893872 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-4218fdc0-2327-4006-8045-ad09db36fa50 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:06:33.894672 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-4218fdc0-2327-4006-8045-ad09db36fa50 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:06:33.895973 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-4218fdc0-2327-4006-8045-ad09db36fa50 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:06:33.896669 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-4218fdc0-2327-4006-8045-ad09db36fa50 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:06:34.066478 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-4218fdc0-2327-4006-8045-ad09db36fa50 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6be4749041442787482b6e06b6c40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73f3238988e4e1293ad782712a1da53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 16:06:34.080519 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-4218fdc0-2327-4006-8045-ad09db36fa50 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] 10.222.0.64 "GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54" status: 200 len: 1560 microversion: 2.1 time: 0.200880 Oct 27 16:06:34.081509 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 858/1648] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 16:06:33 2021] GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54 => generated 1560 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 16:06:35.103718 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-9597b524-de2e-42e4-8f0c-47d5cf639d58 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:06:35.104819 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-9597b524-de2e-42e4-8f0c-47d5cf639d58 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] [instance: 013da7c4-ac69-4554-827b-d68e9bac0e54] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:06:35.115014 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-9597b524-de2e-42e4-8f0c-47d5cf639d58 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:06:35.115660 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-9597b524-de2e-42e4-8f0c-47d5cf639d58 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:06:35.116868 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-9597b524-de2e-42e4-8f0c-47d5cf639d58 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:06:35.117516 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-9597b524-de2e-42e4-8f0c-47d5cf639d58 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:06:35.272294 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-9597b524-de2e-42e4-8f0c-47d5cf639d58 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6be4749041442787482b6e06b6c40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73f3238988e4e1293ad782712a1da53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 16:06:35.287917 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-9597b524-de2e-42e4-8f0c-47d5cf639d58 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] 10.222.0.64 "GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54" status: 200 len: 1560 microversion: 2.1 time: 0.190014 Oct 27 16:06:35.288972 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 791/1649] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 16:06:35 2021] GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54 => generated 1560 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 16:06:36.315415 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-562626b4-4361-44d0-bd7b-06e8170e6dbf tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:06:36.316078 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-562626b4-4361-44d0-bd7b-06e8170e6dbf tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] [instance: 013da7c4-ac69-4554-827b-d68e9bac0e54] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:06:36.325524 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-562626b4-4361-44d0-bd7b-06e8170e6dbf tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:06:36.326044 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-562626b4-4361-44d0-bd7b-06e8170e6dbf tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:06:36.327066 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-562626b4-4361-44d0-bd7b-06e8170e6dbf tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:06:36.327687 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-562626b4-4361-44d0-bd7b-06e8170e6dbf tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:06:36.473800 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-562626b4-4361-44d0-bd7b-06e8170e6dbf tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6be4749041442787482b6e06b6c40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73f3238988e4e1293ad782712a1da53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 16:06:36.483177 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-562626b4-4361-44d0-bd7b-06e8170e6dbf tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] 10.222.0.64 "GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54" status: 200 len: 1560 microversion: 2.1 time: 0.171360 Oct 27 16:06:36.483905 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 859/1650] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 16:06:36 2021] GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54 => generated 1560 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 16:06:37.503811 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-995d801f-a0e7-403f-b35a-97e95a3592cc tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:06:37.504715 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-995d801f-a0e7-403f-b35a-97e95a3592cc tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] [instance: 013da7c4-ac69-4554-827b-d68e9bac0e54] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:06:37.514994 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-995d801f-a0e7-403f-b35a-97e95a3592cc tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:06:37.515704 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-995d801f-a0e7-403f-b35a-97e95a3592cc tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:06:37.517695 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-995d801f-a0e7-403f-b35a-97e95a3592cc tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:06:37.518430 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-995d801f-a0e7-403f-b35a-97e95a3592cc tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:06:37.675647 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-995d801f-a0e7-403f-b35a-97e95a3592cc tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6be4749041442787482b6e06b6c40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73f3238988e4e1293ad782712a1da53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 16:06:37.684281 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-995d801f-a0e7-403f-b35a-97e95a3592cc tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] 10.222.0.64 "GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54" status: 200 len: 1560 microversion: 2.1 time: 0.185688 Oct 27 16:06:37.684882 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 792/1651] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 16:06:37 2021] GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54 => generated 1560 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 16:06:38.704775 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-7694da43-2fb4-4793-be46-7e45616e20e9 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:06:38.705674 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-7694da43-2fb4-4793-be46-7e45616e20e9 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] [instance: 013da7c4-ac69-4554-827b-d68e9bac0e54] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:06:38.717958 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-7694da43-2fb4-4793-be46-7e45616e20e9 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:06:38.718763 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-7694da43-2fb4-4793-be46-7e45616e20e9 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:06:38.720749 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-7694da43-2fb4-4793-be46-7e45616e20e9 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:06:38.721554 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-7694da43-2fb4-4793-be46-7e45616e20e9 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:06:38.941079 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-7694da43-2fb4-4793-be46-7e45616e20e9 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6be4749041442787482b6e06b6c40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73f3238988e4e1293ad782712a1da53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 16:06:38.957055 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-7694da43-2fb4-4793-be46-7e45616e20e9 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] 10.222.0.64 "GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54" status: 200 len: 1560 microversion: 2.1 time: 0.258235 Oct 27 16:06:38.957997 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 860/1652] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 16:06:38 2021] GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54 => generated 1560 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 16:06:39.980840 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-2bb107c7-1cb3-4ab7-8dab-7e56588759e4 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:06:39.981543 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-2bb107c7-1cb3-4ab7-8dab-7e56588759e4 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] [instance: 013da7c4-ac69-4554-827b-d68e9bac0e54] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:06:39.988588 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-2bb107c7-1cb3-4ab7-8dab-7e56588759e4 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:06:39.989030 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-2bb107c7-1cb3-4ab7-8dab-7e56588759e4 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:06:39.989802 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-2bb107c7-1cb3-4ab7-8dab-7e56588759e4 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:06:39.990262 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-2bb107c7-1cb3-4ab7-8dab-7e56588759e4 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:06:40.149446 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-2bb107c7-1cb3-4ab7-8dab-7e56588759e4 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6be4749041442787482b6e06b6c40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73f3238988e4e1293ad782712a1da53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 16:06:40.159155 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-2bb107c7-1cb3-4ab7-8dab-7e56588759e4 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] 10.222.0.64 "GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54" status: 200 len: 1560 microversion: 2.1 time: 0.182176 Oct 27 16:06:40.159789 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 793/1653] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 16:06:39 2021] GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54 => generated 1560 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 16:06:41.176207 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-9f5422a0-94c5-47f4-bfbf-0318675003c8 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:06:41.176894 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-9f5422a0-94c5-47f4-bfbf-0318675003c8 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] [instance: 013da7c4-ac69-4554-827b-d68e9bac0e54] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:06:41.183578 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-9f5422a0-94c5-47f4-bfbf-0318675003c8 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:06:41.184070 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-9f5422a0-94c5-47f4-bfbf-0318675003c8 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:06:41.184846 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-9f5422a0-94c5-47f4-bfbf-0318675003c8 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:06:41.185275 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-9f5422a0-94c5-47f4-bfbf-0318675003c8 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:06:41.337936 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-9f5422a0-94c5-47f4-bfbf-0318675003c8 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6be4749041442787482b6e06b6c40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73f3238988e4e1293ad782712a1da53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 16:06:41.346537 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-9f5422a0-94c5-47f4-bfbf-0318675003c8 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] 10.222.0.64 "GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54" status: 200 len: 1560 microversion: 2.1 time: 0.174520 Oct 27 16:06:41.347251 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 861/1654] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 16:06:41 2021] GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54 => generated 1560 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 16:06:42.364708 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-be6e0a91-69c9-49c3-907c-c082b5799c0a tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:06:42.365345 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-be6e0a91-69c9-49c3-907c-c082b5799c0a tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] [instance: 013da7c4-ac69-4554-827b-d68e9bac0e54] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:06:42.371766 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-be6e0a91-69c9-49c3-907c-c082b5799c0a tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:06:42.372237 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-be6e0a91-69c9-49c3-907c-c082b5799c0a tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:06:42.373025 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-be6e0a91-69c9-49c3-907c-c082b5799c0a tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:06:42.373456 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-be6e0a91-69c9-49c3-907c-c082b5799c0a tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:06:42.508706 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-be6e0a91-69c9-49c3-907c-c082b5799c0a tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6be4749041442787482b6e06b6c40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73f3238988e4e1293ad782712a1da53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 16:06:42.517585 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-be6e0a91-69c9-49c3-907c-c082b5799c0a tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] 10.222.0.64 "GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54" status: 200 len: 1560 microversion: 2.1 time: 0.156786 Oct 27 16:06:42.518341 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 794/1655] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 16:06:42 2021] GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54 => generated 1560 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 16:06:43.536932 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-115c258f-5bc1-426b-987c-931380f0c749 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:06:43.537649 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-115c258f-5bc1-426b-987c-931380f0c749 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] [instance: 013da7c4-ac69-4554-827b-d68e9bac0e54] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:06:43.544363 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-115c258f-5bc1-426b-987c-931380f0c749 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:06:43.544810 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-115c258f-5bc1-426b-987c-931380f0c749 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:06:43.545629 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-115c258f-5bc1-426b-987c-931380f0c749 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:06:43.546063 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-115c258f-5bc1-426b-987c-931380f0c749 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:06:43.956777 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-115c258f-5bc1-426b-987c-931380f0c749 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6be4749041442787482b6e06b6c40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73f3238988e4e1293ad782712a1da53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 16:06:43.965738 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-115c258f-5bc1-426b-987c-931380f0c749 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] 10.222.0.64 "GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54" status: 200 len: 1560 microversion: 2.1 time: 0.433625 Oct 27 16:06:43.966329 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 862/1656] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 16:06:43 2021] GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54 => generated 1560 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 16:06:44.987468 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-18f8ca55-feb3-47f9-98c2-25aacb771177 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:06:44.988201 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-18f8ca55-feb3-47f9-98c2-25aacb771177 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] [instance: 013da7c4-ac69-4554-827b-d68e9bac0e54] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:06:44.994909 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-18f8ca55-feb3-47f9-98c2-25aacb771177 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:06:44.995348 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-18f8ca55-feb3-47f9-98c2-25aacb771177 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:06:44.996200 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-18f8ca55-feb3-47f9-98c2-25aacb771177 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:06:44.996640 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-18f8ca55-feb3-47f9-98c2-25aacb771177 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:06:45.149555 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-18f8ca55-feb3-47f9-98c2-25aacb771177 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6be4749041442787482b6e06b6c40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73f3238988e4e1293ad782712a1da53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 16:06:45.158702 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-18f8ca55-feb3-47f9-98c2-25aacb771177 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] 10.222.0.64 "GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54" status: 200 len: 1560 microversion: 2.1 time: 0.176523 Oct 27 16:06:45.159314 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 795/1657] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 16:06:44 2021] GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54 => generated 1560 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 16:06:46.179739 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-6204c79b-43ff-4cd3-b577-22fec02135e7 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:06:46.180604 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-6204c79b-43ff-4cd3-b577-22fec02135e7 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] [instance: 013da7c4-ac69-4554-827b-d68e9bac0e54] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:06:46.187013 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-6204c79b-43ff-4cd3-b577-22fec02135e7 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:06:46.187460 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-6204c79b-43ff-4cd3-b577-22fec02135e7 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:06:46.188919 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-6204c79b-43ff-4cd3-b577-22fec02135e7 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:06:46.189247 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-6204c79b-43ff-4cd3-b577-22fec02135e7 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:06:46.322614 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-6204c79b-43ff-4cd3-b577-22fec02135e7 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6be4749041442787482b6e06b6c40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73f3238988e4e1293ad782712a1da53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 16:06:46.331170 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-6204c79b-43ff-4cd3-b577-22fec02135e7 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] 10.222.0.64 "GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54" status: 200 len: 1560 microversion: 2.1 time: 0.155289 Oct 27 16:06:46.331756 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 863/1658] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 16:06:46 2021] GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54 => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 16:06:47.350223 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-53af66d0-48ad-499c-adb8-84a252600e98 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:06:47.350952 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-53af66d0-48ad-499c-adb8-84a252600e98 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] [instance: 013da7c4-ac69-4554-827b-d68e9bac0e54] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:06:47.358944 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-53af66d0-48ad-499c-adb8-84a252600e98 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:06:47.359389 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-53af66d0-48ad-499c-adb8-84a252600e98 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:06:47.360740 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-53af66d0-48ad-499c-adb8-84a252600e98 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:06:47.361173 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-53af66d0-48ad-499c-adb8-84a252600e98 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:06:47.504257 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-53af66d0-48ad-499c-adb8-84a252600e98 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6be4749041442787482b6e06b6c40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73f3238988e4e1293ad782712a1da53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 16:06:47.513378 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-53af66d0-48ad-499c-adb8-84a252600e98 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] 10.222.0.64 "GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54" status: 200 len: 1560 microversion: 2.1 time: 0.167860 Oct 27 16:06:47.513990 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 796/1659] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 16:06:47 2021] GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54 => generated 1560 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 16:06:48.536262 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-b73b7250-a95b-4f59-8821-4a8c67194d31 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:06:48.537252 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-b73b7250-a95b-4f59-8821-4a8c67194d31 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] [instance: 013da7c4-ac69-4554-827b-d68e9bac0e54] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:06:48.548888 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-b73b7250-a95b-4f59-8821-4a8c67194d31 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:06:48.549683 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-b73b7250-a95b-4f59-8821-4a8c67194d31 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:06:48.551051 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-b73b7250-a95b-4f59-8821-4a8c67194d31 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:06:48.551813 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-b73b7250-a95b-4f59-8821-4a8c67194d31 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:06:48.752144 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-b73b7250-a95b-4f59-8821-4a8c67194d31 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6be4749041442787482b6e06b6c40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73f3238988e4e1293ad782712a1da53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 16:06:48.760925 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-b73b7250-a95b-4f59-8821-4a8c67194d31 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] 10.222.0.64 "GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54" status: 200 len: 1560 microversion: 2.1 time: 0.231923 Oct 27 16:06:48.761720 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 864/1660] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 16:06:48 2021] GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54 => generated 1560 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 16:06:49.780935 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-3950f833-cdd8-4a73-ab48-abf472918c23 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:06:49.781691 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-3950f833-cdd8-4a73-ab48-abf472918c23 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] [instance: 013da7c4-ac69-4554-827b-d68e9bac0e54] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:06:49.788489 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-3950f833-cdd8-4a73-ab48-abf472918c23 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:06:49.788947 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-3950f833-cdd8-4a73-ab48-abf472918c23 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:06:49.789758 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-3950f833-cdd8-4a73-ab48-abf472918c23 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:06:49.790207 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-3950f833-cdd8-4a73-ab48-abf472918c23 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:06:49.953606 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-3950f833-cdd8-4a73-ab48-abf472918c23 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6be4749041442787482b6e06b6c40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73f3238988e4e1293ad782712a1da53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 16:06:49.968269 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-3950f833-cdd8-4a73-ab48-abf472918c23 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] 10.222.0.64 "GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54" status: 200 len: 1560 microversion: 2.1 time: 0.190681 Oct 27 16:06:49.976093 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 797/1661] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 16:06:49 2021] GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54 => generated 1560 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 16:06:50.990081 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-fefc0193-2bca-4996-b3b6-a6778c9cf635 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:06:50.990748 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-fefc0193-2bca-4996-b3b6-a6778c9cf635 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] [instance: 013da7c4-ac69-4554-827b-d68e9bac0e54] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:06:50.998320 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-fefc0193-2bca-4996-b3b6-a6778c9cf635 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:06:50.998691 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-fefc0193-2bca-4996-b3b6-a6778c9cf635 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:06:50.999544 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-fefc0193-2bca-4996-b3b6-a6778c9cf635 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:06:51.000308 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-fefc0193-2bca-4996-b3b6-a6778c9cf635 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:06:51.147345 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-fefc0193-2bca-4996-b3b6-a6778c9cf635 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6be4749041442787482b6e06b6c40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73f3238988e4e1293ad782712a1da53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 16:06:51.162440 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-fefc0193-2bca-4996-b3b6-a6778c9cf635 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] 10.222.0.64 "GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54" status: 200 len: 1560 microversion: 2.1 time: 0.175951 Oct 27 16:06:51.163353 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 865/1662] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 16:06:50 2021] GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54 => generated 1560 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 16:06:52.187542 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-3ec6207d-bff2-48cd-a039-ca1526891535 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:06:52.188632 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-3ec6207d-bff2-48cd-a039-ca1526891535 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] [instance: 013da7c4-ac69-4554-827b-d68e9bac0e54] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:06:52.196108 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-3ec6207d-bff2-48cd-a039-ca1526891535 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:06:52.196621 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-3ec6207d-bff2-48cd-a039-ca1526891535 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:06:52.197453 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-3ec6207d-bff2-48cd-a039-ca1526891535 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:06:52.197985 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-3ec6207d-bff2-48cd-a039-ca1526891535 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:06:52.366140 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-3ec6207d-bff2-48cd-a039-ca1526891535 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6be4749041442787482b6e06b6c40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73f3238988e4e1293ad782712a1da53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 16:06:52.374643 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-3ec6207d-bff2-48cd-a039-ca1526891535 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] 10.222.0.64 "GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54" status: 200 len: 1560 microversion: 2.1 time: 0.191486 Oct 27 16:06:52.375947 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 798/1663] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 16:06:52 2021] GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54 => generated 1560 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 16:06:53.393670 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-004e2a61-604b-4afa-bb82-0848792747c7 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:06:53.394333 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-004e2a61-604b-4afa-bb82-0848792747c7 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] [instance: 013da7c4-ac69-4554-827b-d68e9bac0e54] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:06:53.400860 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-004e2a61-604b-4afa-bb82-0848792747c7 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:06:53.401307 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-004e2a61-604b-4afa-bb82-0848792747c7 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:06:53.402145 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-004e2a61-604b-4afa-bb82-0848792747c7 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:06:53.402516 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-004e2a61-604b-4afa-bb82-0848792747c7 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:06:53.554964 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-004e2a61-604b-4afa-bb82-0848792747c7 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6be4749041442787482b6e06b6c40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73f3238988e4e1293ad782712a1da53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 16:06:53.564339 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-004e2a61-604b-4afa-bb82-0848792747c7 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] 10.222.0.64 "GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54" status: 200 len: 1560 microversion: 2.1 time: 0.175187 Oct 27 16:06:53.565002 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 866/1664] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 16:06:53 2021] GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54 => generated 1560 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 16:06:54.583824 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-6bc4fc9b-9cdf-4c96-bf77-345e2fb39d28 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:06:54.585125 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-6bc4fc9b-9cdf-4c96-bf77-345e2fb39d28 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] [instance: 013da7c4-ac69-4554-827b-d68e9bac0e54] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:06:54.592696 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-6bc4fc9b-9cdf-4c96-bf77-345e2fb39d28 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:06:54.593147 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-6bc4fc9b-9cdf-4c96-bf77-345e2fb39d28 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:06:54.594148 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-6bc4fc9b-9cdf-4c96-bf77-345e2fb39d28 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:06:54.594598 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-6bc4fc9b-9cdf-4c96-bf77-345e2fb39d28 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:06:54.740375 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-6bc4fc9b-9cdf-4c96-bf77-345e2fb39d28 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6be4749041442787482b6e06b6c40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73f3238988e4e1293ad782712a1da53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 16:06:54.748402 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-6bc4fc9b-9cdf-4c96-bf77-345e2fb39d28 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] 10.222.0.64 "GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54" status: 200 len: 1560 microversion: 2.1 time: 0.168604 Oct 27 16:06:54.749008 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 799/1665] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 16:06:54 2021] GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54 => generated 1560 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 16:06:55.766741 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-04323155-9e5c-469e-8f99-9862d4dfccd4 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:06:55.767333 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-04323155-9e5c-469e-8f99-9862d4dfccd4 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] [instance: 013da7c4-ac69-4554-827b-d68e9bac0e54] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:06:55.773709 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-04323155-9e5c-469e-8f99-9862d4dfccd4 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:06:55.774155 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-04323155-9e5c-469e-8f99-9862d4dfccd4 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:06:55.774927 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-04323155-9e5c-469e-8f99-9862d4dfccd4 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:06:55.775361 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-04323155-9e5c-469e-8f99-9862d4dfccd4 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:06:55.919181 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-04323155-9e5c-469e-8f99-9862d4dfccd4 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6be4749041442787482b6e06b6c40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73f3238988e4e1293ad782712a1da53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 16:06:55.928104 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-04323155-9e5c-469e-8f99-9862d4dfccd4 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] 10.222.0.64 "GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54" status: 200 len: 1560 microversion: 2.1 time: 0.165092 Oct 27 16:06:55.928690 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 867/1666] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 16:06:55 2021] GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54 => generated 1560 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 16:06:56.945170 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-b14c67de-c768-4252-a470-3a71be444e2e tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:06:56.945862 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-b14c67de-c768-4252-a470-3a71be444e2e tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] [instance: 013da7c4-ac69-4554-827b-d68e9bac0e54] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:06:56.952193 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-b14c67de-c768-4252-a470-3a71be444e2e tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:06:56.952663 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-b14c67de-c768-4252-a470-3a71be444e2e tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:06:56.953512 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-b14c67de-c768-4252-a470-3a71be444e2e tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:06:56.954262 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-b14c67de-c768-4252-a470-3a71be444e2e tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:06:57.113732 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-b14c67de-c768-4252-a470-3a71be444e2e tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6be4749041442787482b6e06b6c40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73f3238988e4e1293ad782712a1da53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 16:06:57.119372 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-b14c67de-c768-4252-a470-3a71be444e2e tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] 10.222.0.64 "GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54" status: 200 len: 1560 microversion: 2.1 time: 0.177897 Oct 27 16:06:57.120001 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 800/1667] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 16:06:56 2021] GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54 => generated 1560 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 16:06:58.146515 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-f7ca293b-b8cb-4fa3-89fd-7fd143cacc51 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:06:58.147123 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-f7ca293b-b8cb-4fa3-89fd-7fd143cacc51 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] [instance: 013da7c4-ac69-4554-827b-d68e9bac0e54] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:06:58.154599 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-f7ca293b-b8cb-4fa3-89fd-7fd143cacc51 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:06:58.155056 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-f7ca293b-b8cb-4fa3-89fd-7fd143cacc51 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:06:58.156088 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-f7ca293b-b8cb-4fa3-89fd-7fd143cacc51 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:06:58.156357 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-f7ca293b-b8cb-4fa3-89fd-7fd143cacc51 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:06:58.323729 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-f7ca293b-b8cb-4fa3-89fd-7fd143cacc51 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6be4749041442787482b6e06b6c40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73f3238988e4e1293ad782712a1da53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 16:06:58.338389 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-f7ca293b-b8cb-4fa3-89fd-7fd143cacc51 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] 10.222.0.64 "GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54" status: 200 len: 1560 microversion: 2.1 time: 0.195987 Oct 27 16:06:58.339348 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 868/1668] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 16:06:58 2021] GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54 => generated 1560 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 16:06:59.360551 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-807468ad-1329-419f-818f-ec2fc93e2770 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:06:59.361556 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-807468ad-1329-419f-818f-ec2fc93e2770 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] [instance: 013da7c4-ac69-4554-827b-d68e9bac0e54] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:06:59.371351 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-807468ad-1329-419f-818f-ec2fc93e2770 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:06:59.372075 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-807468ad-1329-419f-818f-ec2fc93e2770 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:06:59.373109 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-807468ad-1329-419f-818f-ec2fc93e2770 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:06:59.373764 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-807468ad-1329-419f-818f-ec2fc93e2770 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:06:59.564806 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-807468ad-1329-419f-818f-ec2fc93e2770 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6be4749041442787482b6e06b6c40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73f3238988e4e1293ad782712a1da53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 16:06:59.579515 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-807468ad-1329-419f-818f-ec2fc93e2770 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] 10.222.0.64 "GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54" status: 200 len: 1560 microversion: 2.1 time: 0.224646 Oct 27 16:06:59.580579 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 801/1669] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 16:06:59 2021] GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54 => generated 1560 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 16:07:00.606885 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-7d2fd4a3-8ba2-4629-929d-2775bffc7c58 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:07:00.607879 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-7d2fd4a3-8ba2-4629-929d-2775bffc7c58 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] [instance: 013da7c4-ac69-4554-827b-d68e9bac0e54] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:07:00.618036 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-7d2fd4a3-8ba2-4629-929d-2775bffc7c58 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:07:00.618789 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-7d2fd4a3-8ba2-4629-929d-2775bffc7c58 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:07:00.620051 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-7d2fd4a3-8ba2-4629-929d-2775bffc7c58 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:07:00.620773 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-7d2fd4a3-8ba2-4629-929d-2775bffc7c58 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:07:00.763336 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-7d2fd4a3-8ba2-4629-929d-2775bffc7c58 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6be4749041442787482b6e06b6c40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73f3238988e4e1293ad782712a1da53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 16:07:00.772549 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-7d2fd4a3-8ba2-4629-929d-2775bffc7c58 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] 10.222.0.64 "GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54" status: 200 len: 1560 microversion: 2.1 time: 0.170186 Oct 27 16:07:00.773139 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 869/1670] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 16:07:00 2021] GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54 => generated 1560 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 16:07:01.795339 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-1d8a251c-1174-426c-9007-b5d9858c47a4 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:07:01.796067 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-1d8a251c-1174-426c-9007-b5d9858c47a4 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] [instance: 013da7c4-ac69-4554-827b-d68e9bac0e54] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:07:01.805161 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-1d8a251c-1174-426c-9007-b5d9858c47a4 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:07:01.805647 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-1d8a251c-1174-426c-9007-b5d9858c47a4 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:07:01.806469 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-1d8a251c-1174-426c-9007-b5d9858c47a4 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:07:01.806937 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-1d8a251c-1174-426c-9007-b5d9858c47a4 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:07:01.988132 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-1d8a251c-1174-426c-9007-b5d9858c47a4 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6be4749041442787482b6e06b6c40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73f3238988e4e1293ad782712a1da53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 16:07:02.000283 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-1d8a251c-1174-426c-9007-b5d9858c47a4 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] 10.222.0.64 "GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54" status: 200 len: 1560 microversion: 2.1 time: 0.209855 Oct 27 16:07:02.001082 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 802/1671] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 16:07:01 2021] GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54 => generated 1560 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 16:07:03.024319 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-9f28655e-eb8c-4a85-a027-566bf60f2839 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:07:03.025319 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-9f28655e-eb8c-4a85-a027-566bf60f2839 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] [instance: 013da7c4-ac69-4554-827b-d68e9bac0e54] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:07:03.037032 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-9f28655e-eb8c-4a85-a027-566bf60f2839 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:07:03.040354 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-9f28655e-eb8c-4a85-a027-566bf60f2839 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:07:03.040354 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-9f28655e-eb8c-4a85-a027-566bf60f2839 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:07:03.040354 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-9f28655e-eb8c-4a85-a027-566bf60f2839 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:07:03.215950 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-9f28655e-eb8c-4a85-a027-566bf60f2839 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6be4749041442787482b6e06b6c40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73f3238988e4e1293ad782712a1da53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 16:07:03.227568 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-9f28655e-eb8c-4a85-a027-566bf60f2839 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] 10.222.0.64 "GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54" status: 200 len: 1560 microversion: 2.1 time: 0.209564 Oct 27 16:07:03.228523 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 870/1672] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 16:07:03 2021] GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54 => generated 1560 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 16:07:04.247283 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-56c666af-f5f5-47b0-a247-a8e56a727c48 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:07:04.248301 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-56c666af-f5f5-47b0-a247-a8e56a727c48 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] [instance: 013da7c4-ac69-4554-827b-d68e9bac0e54] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:07:04.256752 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-56c666af-f5f5-47b0-a247-a8e56a727c48 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:07:04.257264 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-56c666af-f5f5-47b0-a247-a8e56a727c48 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:07:04.258280 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-56c666af-f5f5-47b0-a247-a8e56a727c48 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:07:04.258885 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-56c666af-f5f5-47b0-a247-a8e56a727c48 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:07:04.403287 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-56c666af-f5f5-47b0-a247-a8e56a727c48 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6be4749041442787482b6e06b6c40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73f3238988e4e1293ad782712a1da53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 16:07:04.414871 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-56c666af-f5f5-47b0-a247-a8e56a727c48 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] 10.222.0.64 "GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54" status: 200 len: 1560 microversion: 2.1 time: 0.171911 Oct 27 16:07:04.415594 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 803/1673] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 16:07:04 2021] GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54 => generated 1560 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 16:07:05.434085 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-fc5308c8-6f72-4863-8bd0-f76203be5130 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:07:05.434988 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-fc5308c8-6f72-4863-8bd0-f76203be5130 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] [instance: 013da7c4-ac69-4554-827b-d68e9bac0e54] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:07:05.447232 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-fc5308c8-6f72-4863-8bd0-f76203be5130 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:07:05.448036 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-fc5308c8-6f72-4863-8bd0-f76203be5130 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:07:05.449401 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-fc5308c8-6f72-4863-8bd0-f76203be5130 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:07:05.450165 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-fc5308c8-6f72-4863-8bd0-f76203be5130 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:07:05.605016 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-fc5308c8-6f72-4863-8bd0-f76203be5130 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6be4749041442787482b6e06b6c40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73f3238988e4e1293ad782712a1da53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 16:07:05.614321 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-fc5308c8-6f72-4863-8bd0-f76203be5130 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] 10.222.0.64 "GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54" status: 200 len: 1560 microversion: 2.1 time: 0.184678 Oct 27 16:07:05.614966 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 871/1674] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 16:07:05 2021] GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54 => generated 1560 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 16:07:06.632720 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-55e97a48-0eb0-491d-9166-6960e2ea827b tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:07:06.633493 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-55e97a48-0eb0-491d-9166-6960e2ea827b tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] [instance: 013da7c4-ac69-4554-827b-d68e9bac0e54] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:07:06.640228 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-55e97a48-0eb0-491d-9166-6960e2ea827b tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:07:06.641539 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-55e97a48-0eb0-491d-9166-6960e2ea827b tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:07:06.642406 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-55e97a48-0eb0-491d-9166-6960e2ea827b tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:07:06.642846 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-55e97a48-0eb0-491d-9166-6960e2ea827b tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:07:06.818598 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-55e97a48-0eb0-491d-9166-6960e2ea827b tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6be4749041442787482b6e06b6c40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73f3238988e4e1293ad782712a1da53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 16:07:06.831234 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-55e97a48-0eb0-491d-9166-6960e2ea827b tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] 10.222.0.64 "GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54" status: 200 len: 1560 microversion: 2.1 time: 0.202002 Oct 27 16:07:06.832017 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 804/1675] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 16:07:06 2021] GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54 => generated 1560 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 16:07:07.851152 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-7ceb2116-a548-4e4f-96c3-5dc3e9df1b3b tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:07:07.851753 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-7ceb2116-a548-4e4f-96c3-5dc3e9df1b3b tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] [instance: 013da7c4-ac69-4554-827b-d68e9bac0e54] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:07:07.858426 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-7ceb2116-a548-4e4f-96c3-5dc3e9df1b3b tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:07:07.858865 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-7ceb2116-a548-4e4f-96c3-5dc3e9df1b3b tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:07:07.860255 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-7ceb2116-a548-4e4f-96c3-5dc3e9df1b3b tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:07:07.860688 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-7ceb2116-a548-4e4f-96c3-5dc3e9df1b3b tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:07:08.054461 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-7ceb2116-a548-4e4f-96c3-5dc3e9df1b3b tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6be4749041442787482b6e06b6c40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73f3238988e4e1293ad782712a1da53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 16:07:08.064523 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-7ceb2116-a548-4e4f-96c3-5dc3e9df1b3b tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] 10.222.0.64 "GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54" status: 200 len: 1560 microversion: 2.1 time: 0.217228 Oct 27 16:07:08.065128 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 872/1676] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 16:07:07 2021] GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54 => generated 1560 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 16:07:09.090517 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-bbdcd43e-6246-4eac-ad44-153f4210ca87 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:07:09.091089 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-bbdcd43e-6246-4eac-ad44-153f4210ca87 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] [instance: 013da7c4-ac69-4554-827b-d68e9bac0e54] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:07:09.097937 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-bbdcd43e-6246-4eac-ad44-153f4210ca87 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:07:09.098436 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-bbdcd43e-6246-4eac-ad44-153f4210ca87 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:07:09.099256 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-bbdcd43e-6246-4eac-ad44-153f4210ca87 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:07:09.099765 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-bbdcd43e-6246-4eac-ad44-153f4210ca87 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:07:09.268992 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-bbdcd43e-6246-4eac-ad44-153f4210ca87 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6be4749041442787482b6e06b6c40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73f3238988e4e1293ad782712a1da53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 16:07:09.277241 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-bbdcd43e-6246-4eac-ad44-153f4210ca87 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] 10.222.0.64 "GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54" status: 200 len: 1560 microversion: 2.1 time: 0.190439 Oct 27 16:07:09.277834 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 805/1677] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 16:07:09 2021] GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54 => generated 1560 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 16:07:10.298254 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-04230ec7-5370-4025-b0fb-c43b0b4f0e96 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:07:10.299336 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-04230ec7-5370-4025-b0fb-c43b0b4f0e96 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] [instance: 013da7c4-ac69-4554-827b-d68e9bac0e54] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:07:10.310534 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-04230ec7-5370-4025-b0fb-c43b0b4f0e96 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:07:10.311326 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-04230ec7-5370-4025-b0fb-c43b0b4f0e96 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:07:10.312788 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-04230ec7-5370-4025-b0fb-c43b0b4f0e96 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:07:10.313630 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-04230ec7-5370-4025-b0fb-c43b0b4f0e96 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:07:10.472525 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-04230ec7-5370-4025-b0fb-c43b0b4f0e96 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6be4749041442787482b6e06b6c40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73f3238988e4e1293ad782712a1da53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 16:07:10.480773 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-04230ec7-5370-4025-b0fb-c43b0b4f0e96 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] 10.222.0.64 "GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54" status: 200 len: 1560 microversion: 2.1 time: 0.189615 Oct 27 16:07:10.481394 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 873/1678] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 16:07:10 2021] GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54 => generated 1560 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 16:07:11.506617 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-79e9ce24-21fe-41d6-b249-844cbe1d5563 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:07:11.507841 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-79e9ce24-21fe-41d6-b249-844cbe1d5563 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] [instance: 013da7c4-ac69-4554-827b-d68e9bac0e54] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:07:11.515943 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-79e9ce24-21fe-41d6-b249-844cbe1d5563 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:07:11.516397 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-79e9ce24-21fe-41d6-b249-844cbe1d5563 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:07:11.517194 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-79e9ce24-21fe-41d6-b249-844cbe1d5563 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:07:11.517639 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-79e9ce24-21fe-41d6-b249-844cbe1d5563 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:07:11.668216 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-79e9ce24-21fe-41d6-b249-844cbe1d5563 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6be4749041442787482b6e06b6c40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73f3238988e4e1293ad782712a1da53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 16:07:11.677476 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-79e9ce24-21fe-41d6-b249-844cbe1d5563 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] 10.222.0.64 "GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54" status: 200 len: 1560 microversion: 2.1 time: 0.178364 Oct 27 16:07:11.678076 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 806/1679] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 16:07:11 2021] GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54 => generated 1560 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 16:07:12.697880 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-a5f8bd2e-a15b-430d-aebb-546e4af6dd76 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:07:12.698642 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-a5f8bd2e-a15b-430d-aebb-546e4af6dd76 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] [instance: 013da7c4-ac69-4554-827b-d68e9bac0e54] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:07:12.705605 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-a5f8bd2e-a15b-430d-aebb-546e4af6dd76 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:07:12.706043 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-a5f8bd2e-a15b-430d-aebb-546e4af6dd76 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:07:12.706808 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-a5f8bd2e-a15b-430d-aebb-546e4af6dd76 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:07:12.707276 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-a5f8bd2e-a15b-430d-aebb-546e4af6dd76 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:07:12.862571 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-a5f8bd2e-a15b-430d-aebb-546e4af6dd76 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6be4749041442787482b6e06b6c40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73f3238988e4e1293ad782712a1da53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 16:07:12.870811 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-a5f8bd2e-a15b-430d-aebb-546e4af6dd76 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] 10.222.0.64 "GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54" status: 200 len: 1560 microversion: 2.1 time: 0.177409 Oct 27 16:07:12.871396 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 874/1680] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 16:07:12 2021] GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54 => generated 1560 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 16:07:13.889950 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-7c3eec1f-8147-4215-8cda-f3ebea07998e tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:07:13.892295 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-7c3eec1f-8147-4215-8cda-f3ebea07998e tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] [instance: 013da7c4-ac69-4554-827b-d68e9bac0e54] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:07:13.898390 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-7c3eec1f-8147-4215-8cda-f3ebea07998e tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:07:13.898979 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-7c3eec1f-8147-4215-8cda-f3ebea07998e tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:07:13.899944 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-7c3eec1f-8147-4215-8cda-f3ebea07998e tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:07:13.900430 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-7c3eec1f-8147-4215-8cda-f3ebea07998e tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:07:14.052530 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-7c3eec1f-8147-4215-8cda-f3ebea07998e tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6be4749041442787482b6e06b6c40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73f3238988e4e1293ad782712a1da53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 16:07:14.067464 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-7c3eec1f-8147-4215-8cda-f3ebea07998e tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] 10.222.0.64 "GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54" status: 200 len: 1560 microversion: 2.1 time: 0.181956 Oct 27 16:07:14.068824 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 807/1681] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 16:07:13 2021] GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54 => generated 1560 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 16:07:15.091002 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-5f627be2-a407-4bc4-89e9-e8a87ee5cc6d tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:07:15.092133 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-5f627be2-a407-4bc4-89e9-e8a87ee5cc6d tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] [instance: 013da7c4-ac69-4554-827b-d68e9bac0e54] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:07:15.104654 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-5f627be2-a407-4bc4-89e9-e8a87ee5cc6d tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:07:15.105423 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-5f627be2-a407-4bc4-89e9-e8a87ee5cc6d tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:07:15.106834 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-5f627be2-a407-4bc4-89e9-e8a87ee5cc6d tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:07:15.107608 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-5f627be2-a407-4bc4-89e9-e8a87ee5cc6d tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:07:15.284342 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-5f627be2-a407-4bc4-89e9-e8a87ee5cc6d tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6be4749041442787482b6e06b6c40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73f3238988e4e1293ad782712a1da53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 16:07:15.292895 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-5f627be2-a407-4bc4-89e9-e8a87ee5cc6d tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] 10.222.0.64 "GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54" status: 200 len: 1560 microversion: 2.1 time: 0.209360 Oct 27 16:07:15.293629 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 875/1682] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 16:07:15 2021] GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54 => generated 1560 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 16:07:16.311332 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-23a0cd71-60a0-448b-ac2c-eb8b153be4fc tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:07:16.312049 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-23a0cd71-60a0-448b-ac2c-eb8b153be4fc tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] [instance: 013da7c4-ac69-4554-827b-d68e9bac0e54] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:07:16.318513 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-23a0cd71-60a0-448b-ac2c-eb8b153be4fc tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:07:16.318953 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-23a0cd71-60a0-448b-ac2c-eb8b153be4fc tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:07:16.319759 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-23a0cd71-60a0-448b-ac2c-eb8b153be4fc tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:07:16.320216 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-23a0cd71-60a0-448b-ac2c-eb8b153be4fc tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:07:16.461491 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-23a0cd71-60a0-448b-ac2c-eb8b153be4fc tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6be4749041442787482b6e06b6c40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73f3238988e4e1293ad782712a1da53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 16:07:16.470739 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-23a0cd71-60a0-448b-ac2c-eb8b153be4fc tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] 10.222.0.64 "GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54" status: 200 len: 1560 microversion: 2.1 time: 0.163298 Oct 27 16:07:16.471702 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 808/1683] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 16:07:16 2021] GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54 => generated 1560 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 16:07:17.496986 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-985a4400-9822-49dc-a22c-0168f854c7f6 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:07:17.497842 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-985a4400-9822-49dc-a22c-0168f854c7f6 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] [instance: 013da7c4-ac69-4554-827b-d68e9bac0e54] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:07:17.505784 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-985a4400-9822-49dc-a22c-0168f854c7f6 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:07:17.506328 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-985a4400-9822-49dc-a22c-0168f854c7f6 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:07:17.507285 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-985a4400-9822-49dc-a22c-0168f854c7f6 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:07:17.507792 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-985a4400-9822-49dc-a22c-0168f854c7f6 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:07:17.648563 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-985a4400-9822-49dc-a22c-0168f854c7f6 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6be4749041442787482b6e06b6c40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73f3238988e4e1293ad782712a1da53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 16:07:17.657922 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-985a4400-9822-49dc-a22c-0168f854c7f6 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] 10.222.0.64 "GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54" status: 200 len: 1560 microversion: 2.1 time: 0.164660 Oct 27 16:07:17.658706 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 876/1684] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 16:07:17 2021] GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54 => generated 1560 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 16:07:18.675904 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-1e63b101-657c-4925-9250-da25c62d6d70 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:07:18.676582 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-1e63b101-657c-4925-9250-da25c62d6d70 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] [instance: 013da7c4-ac69-4554-827b-d68e9bac0e54] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:07:18.682903 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-1e63b101-657c-4925-9250-da25c62d6d70 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:07:18.683349 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-1e63b101-657c-4925-9250-da25c62d6d70 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:07:18.684165 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-1e63b101-657c-4925-9250-da25c62d6d70 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:07:18.684608 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-1e63b101-657c-4925-9250-da25c62d6d70 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:07:18.852093 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-1e63b101-657c-4925-9250-da25c62d6d70 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6be4749041442787482b6e06b6c40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73f3238988e4e1293ad782712a1da53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 16:07:18.863422 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-1e63b101-657c-4925-9250-da25c62d6d70 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] 10.222.0.64 "GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54" status: 200 len: 1560 microversion: 2.1 time: 0.191582 Oct 27 16:07:18.864293 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 809/1685] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 16:07:18 2021] GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54 => generated 1560 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 16:07:19.891342 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-0603e937-595e-4e5f-aa09-becf6d87fbc3 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:07:19.892576 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-0603e937-595e-4e5f-aa09-becf6d87fbc3 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] [instance: 013da7c4-ac69-4554-827b-d68e9bac0e54] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:07:19.903136 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-0603e937-595e-4e5f-aa09-becf6d87fbc3 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:07:19.903960 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-0603e937-595e-4e5f-aa09-becf6d87fbc3 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:07:19.905365 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-0603e937-595e-4e5f-aa09-becf6d87fbc3 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:07:19.906654 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-0603e937-595e-4e5f-aa09-becf6d87fbc3 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:07:20.130677 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-0603e937-595e-4e5f-aa09-becf6d87fbc3 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6be4749041442787482b6e06b6c40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73f3238988e4e1293ad782712a1da53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 16:07:20.143098 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-0603e937-595e-4e5f-aa09-becf6d87fbc3 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] 10.222.0.64 "GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54" status: 200 len: 1560 microversion: 2.1 time: 0.258343 Oct 27 16:07:20.144010 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 877/1686] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 16:07:19 2021] GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54 => generated 1560 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 16:07:21.170302 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-8cca6f72-29d4-4f2b-aadf-fe794640998a tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:07:21.171979 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-8cca6f72-29d4-4f2b-aadf-fe794640998a tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] [instance: 013da7c4-ac69-4554-827b-d68e9bac0e54] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:07:21.181491 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-8cca6f72-29d4-4f2b-aadf-fe794640998a tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:07:21.182261 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-8cca6f72-29d4-4f2b-aadf-fe794640998a tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:07:21.183547 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-8cca6f72-29d4-4f2b-aadf-fe794640998a tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:07:21.184322 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-8cca6f72-29d4-4f2b-aadf-fe794640998a tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:07:21.384449 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-8cca6f72-29d4-4f2b-aadf-fe794640998a tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6be4749041442787482b6e06b6c40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73f3238988e4e1293ad782712a1da53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 16:07:21.398777 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-8cca6f72-29d4-4f2b-aadf-fe794640998a tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] 10.222.0.64 "GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54" status: 200 len: 1560 microversion: 2.1 time: 0.234772 Oct 27 16:07:21.399796 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 810/1687] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 16:07:21 2021] GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54 => generated 1560 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 16:07:22.430071 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-d7c18bd0-47b4-41f4-bcba-d74f9389555b tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:07:22.431289 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-d7c18bd0-47b4-41f4-bcba-d74f9389555b tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] [instance: 013da7c4-ac69-4554-827b-d68e9bac0e54] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:07:22.442440 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-d7c18bd0-47b4-41f4-bcba-d74f9389555b tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:07:22.443039 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-d7c18bd0-47b4-41f4-bcba-d74f9389555b tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:07:22.443833 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-d7c18bd0-47b4-41f4-bcba-d74f9389555b tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:07:22.444297 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-d7c18bd0-47b4-41f4-bcba-d74f9389555b tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:07:22.642967 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-d7c18bd0-47b4-41f4-bcba-d74f9389555b tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6be4749041442787482b6e06b6c40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73f3238988e4e1293ad782712a1da53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 16:07:22.657997 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-d7c18bd0-47b4-41f4-bcba-d74f9389555b tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] 10.222.0.64 "GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54" status: 200 len: 1560 microversion: 2.1 time: 0.234344 Oct 27 16:07:22.659044 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 878/1688] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 16:07:22 2021] GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54 => generated 1560 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 16:07:23.695358 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-47088686-2b38-4f6a-8135-2e21b3ce4405 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:07:23.696421 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-47088686-2b38-4f6a-8135-2e21b3ce4405 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] [instance: 013da7c4-ac69-4554-827b-d68e9bac0e54] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:07:23.704357 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-47088686-2b38-4f6a-8135-2e21b3ce4405 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:07:23.705026 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-47088686-2b38-4f6a-8135-2e21b3ce4405 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:07:23.705852 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-47088686-2b38-4f6a-8135-2e21b3ce4405 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:07:23.706323 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-47088686-2b38-4f6a-8135-2e21b3ce4405 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:07:23.893323 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-47088686-2b38-4f6a-8135-2e21b3ce4405 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6be4749041442787482b6e06b6c40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73f3238988e4e1293ad782712a1da53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 16:07:23.901817 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-47088686-2b38-4f6a-8135-2e21b3ce4405 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] 10.222.0.64 "GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54" status: 200 len: 1560 microversion: 2.1 time: 0.213080 Oct 27 16:07:23.902528 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 811/1689] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 16:07:23 2021] GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54 => generated 1560 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 16:07:24.932956 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-52b0ba1b-37d6-4c92-8a05-690797917902 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:07:24.934088 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-52b0ba1b-37d6-4c92-8a05-690797917902 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] [instance: 013da7c4-ac69-4554-827b-d68e9bac0e54] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:07:24.945932 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-52b0ba1b-37d6-4c92-8a05-690797917902 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:07:24.946695 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-52b0ba1b-37d6-4c92-8a05-690797917902 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:07:24.948126 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-52b0ba1b-37d6-4c92-8a05-690797917902 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:07:24.948909 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-52b0ba1b-37d6-4c92-8a05-690797917902 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:07:25.164480 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-52b0ba1b-37d6-4c92-8a05-690797917902 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6be4749041442787482b6e06b6c40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73f3238988e4e1293ad782712a1da53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 16:07:25.179226 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-52b0ba1b-37d6-4c92-8a05-690797917902 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] 10.222.0.64 "GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54" status: 200 len: 1560 microversion: 2.1 time: 0.253277 Oct 27 16:07:25.180342 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 879/1690] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 16:07:24 2021] GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54 => generated 1560 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 16:07:26.210201 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-644a3911-38e9-475e-a867-ccd0e8d03357 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:07:26.211317 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-644a3911-38e9-475e-a867-ccd0e8d03357 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] [instance: 013da7c4-ac69-4554-827b-d68e9bac0e54] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:07:26.223418 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-644a3911-38e9-475e-a867-ccd0e8d03357 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:07:26.224243 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-644a3911-38e9-475e-a867-ccd0e8d03357 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:07:26.225742 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-644a3911-38e9-475e-a867-ccd0e8d03357 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:07:26.226531 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-644a3911-38e9-475e-a867-ccd0e8d03357 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:07:26.461052 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-644a3911-38e9-475e-a867-ccd0e8d03357 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6be4749041442787482b6e06b6c40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73f3238988e4e1293ad782712a1da53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 16:07:26.476822 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-644a3911-38e9-475e-a867-ccd0e8d03357 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] 10.222.0.64 "GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54" status: 200 len: 1560 microversion: 2.1 time: 0.273191 Oct 27 16:07:26.477867 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 812/1691] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 16:07:26 2021] GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54 => generated 1560 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 16:07:27.512073 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-b5bdf377-e7c7-401b-b07d-c28bc69de16f tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:07:27.513213 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-b5bdf377-e7c7-401b-b07d-c28bc69de16f tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] [instance: 013da7c4-ac69-4554-827b-d68e9bac0e54] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:07:27.525108 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-b5bdf377-e7c7-401b-b07d-c28bc69de16f tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:07:27.525919 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-b5bdf377-e7c7-401b-b07d-c28bc69de16f tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:07:27.527325 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-b5bdf377-e7c7-401b-b07d-c28bc69de16f tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:07:27.528125 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-b5bdf377-e7c7-401b-b07d-c28bc69de16f tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:07:27.755003 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-b5bdf377-e7c7-401b-b07d-c28bc69de16f tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6be4749041442787482b6e06b6c40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73f3238988e4e1293ad782712a1da53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 16:07:27.767991 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-b5bdf377-e7c7-401b-b07d-c28bc69de16f tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] 10.222.0.64 "GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54" status: 200 len: 1560 microversion: 2.1 time: 0.266693 Oct 27 16:07:27.768955 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 880/1692] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 16:07:27 2021] GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54 => generated 1560 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 16:07:28.794929 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-f34e0b5b-4799-4bb8-aa80-d38be5f6cace tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:07:28.796598 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-f34e0b5b-4799-4bb8-aa80-d38be5f6cace tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] [instance: 013da7c4-ac69-4554-827b-d68e9bac0e54] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:07:28.807658 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-f34e0b5b-4799-4bb8-aa80-d38be5f6cace tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:07:28.808522 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-f34e0b5b-4799-4bb8-aa80-d38be5f6cace tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:07:28.810902 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-f34e0b5b-4799-4bb8-aa80-d38be5f6cace tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:07:28.810902 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-f34e0b5b-4799-4bb8-aa80-d38be5f6cace tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:07:29.033003 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-f34e0b5b-4799-4bb8-aa80-d38be5f6cace tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6be4749041442787482b6e06b6c40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73f3238988e4e1293ad782712a1da53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 16:07:29.048149 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-f34e0b5b-4799-4bb8-aa80-d38be5f6cace tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] 10.222.0.64 "GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54" status: 200 len: 1560 microversion: 2.1 time: 0.259810 Oct 27 16:07:29.049203 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 813/1693] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 16:07:28 2021] GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54 => generated 1560 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 16:07:30.080343 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-bb7ee9d9-465f-4c70-8a89-c5053f7687b0 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:07:30.081531 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-bb7ee9d9-465f-4c70-8a89-c5053f7687b0 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] [instance: 013da7c4-ac69-4554-827b-d68e9bac0e54] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:07:30.093291 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-bb7ee9d9-465f-4c70-8a89-c5053f7687b0 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:07:30.094124 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-bb7ee9d9-465f-4c70-8a89-c5053f7687b0 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:07:30.095181 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-bb7ee9d9-465f-4c70-8a89-c5053f7687b0 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:07:30.096008 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-bb7ee9d9-465f-4c70-8a89-c5053f7687b0 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:07:30.318164 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-bb7ee9d9-465f-4c70-8a89-c5053f7687b0 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6be4749041442787482b6e06b6c40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73f3238988e4e1293ad782712a1da53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 16:07:30.332657 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-bb7ee9d9-465f-4c70-8a89-c5053f7687b0 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] 10.222.0.64 "GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54" status: 200 len: 1560 microversion: 2.1 time: 0.259582 Oct 27 16:07:30.333943 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 881/1694] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 16:07:30 2021] GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54 => generated 1560 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 16:07:31.364089 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-958ddcff-2bd9-4c7a-be6f-e7e20d2b8ea3 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:07:31.365321 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-958ddcff-2bd9-4c7a-be6f-e7e20d2b8ea3 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] [instance: 013da7c4-ac69-4554-827b-d68e9bac0e54] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:07:31.377375 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-958ddcff-2bd9-4c7a-be6f-e7e20d2b8ea3 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:07:31.378265 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-958ddcff-2bd9-4c7a-be6f-e7e20d2b8ea3 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:07:31.379814 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-958ddcff-2bd9-4c7a-be6f-e7e20d2b8ea3 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:07:31.380674 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-958ddcff-2bd9-4c7a-be6f-e7e20d2b8ea3 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:07:31.597877 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-958ddcff-2bd9-4c7a-be6f-e7e20d2b8ea3 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6be4749041442787482b6e06b6c40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73f3238988e4e1293ad782712a1da53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 16:07:31.607488 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-958ddcff-2bd9-4c7a-be6f-e7e20d2b8ea3 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] 10.222.0.64 "GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54" status: 200 len: 1560 microversion: 2.1 time: 0.251088 Oct 27 16:07:31.608346 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 814/1695] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 16:07:31 2021] GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54 => generated 1560 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 16:07:32.627134 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-db2fcadd-3bf4-4fe7-9d3c-108f84c50ac8 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:07:32.627820 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-db2fcadd-3bf4-4fe7-9d3c-108f84c50ac8 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] [instance: 013da7c4-ac69-4554-827b-d68e9bac0e54] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:07:32.634916 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-db2fcadd-3bf4-4fe7-9d3c-108f84c50ac8 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:07:32.635431 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-db2fcadd-3bf4-4fe7-9d3c-108f84c50ac8 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:07:32.636405 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-db2fcadd-3bf4-4fe7-9d3c-108f84c50ac8 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:07:32.636885 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-db2fcadd-3bf4-4fe7-9d3c-108f84c50ac8 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:07:32.797799 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-db2fcadd-3bf4-4fe7-9d3c-108f84c50ac8 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6be4749041442787482b6e06b6c40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73f3238988e4e1293ad782712a1da53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 16:07:32.805917 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-db2fcadd-3bf4-4fe7-9d3c-108f84c50ac8 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] 10.222.0.64 "GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54" status: 200 len: 1560 microversion: 2.1 time: 0.183031 Oct 27 16:07:32.806509 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 882/1696] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 16:07:32 2021] GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54 => generated 1560 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 16:07:33.822607 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-23bf957a-648b-44b4-85dd-712a41cf6b77 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:07:33.823210 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-23bf957a-648b-44b4-85dd-712a41cf6b77 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] [instance: 013da7c4-ac69-4554-827b-d68e9bac0e54] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:07:33.833046 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-23bf957a-648b-44b4-85dd-712a41cf6b77 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:07:33.833485 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-23bf957a-648b-44b4-85dd-712a41cf6b77 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:07:33.834516 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-23bf957a-648b-44b4-85dd-712a41cf6b77 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:07:33.834946 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-23bf957a-648b-44b4-85dd-712a41cf6b77 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:07:33.984120 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-23bf957a-648b-44b4-85dd-712a41cf6b77 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6be4749041442787482b6e06b6c40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73f3238988e4e1293ad782712a1da53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 16:07:33.993719 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-23bf957a-648b-44b4-85dd-712a41cf6b77 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] 10.222.0.64 "GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54" status: 200 len: 1560 microversion: 2.1 time: 0.174852 Oct 27 16:07:33.994373 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 815/1697] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 16:07:33 2021] GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54 => generated 1560 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 16:07:35.020665 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-19682b1e-9dc0-4964-9314-3a3f23b6d263 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:07:35.021379 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-19682b1e-9dc0-4964-9314-3a3f23b6d263 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] [instance: 013da7c4-ac69-4554-827b-d68e9bac0e54] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:07:35.028010 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-19682b1e-9dc0-4964-9314-3a3f23b6d263 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:07:35.028525 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-19682b1e-9dc0-4964-9314-3a3f23b6d263 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:07:35.029304 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-19682b1e-9dc0-4964-9314-3a3f23b6d263 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:07:35.029735 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-19682b1e-9dc0-4964-9314-3a3f23b6d263 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:07:35.179183 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-19682b1e-9dc0-4964-9314-3a3f23b6d263 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6be4749041442787482b6e06b6c40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73f3238988e4e1293ad782712a1da53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 16:07:35.187221 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-19682b1e-9dc0-4964-9314-3a3f23b6d263 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] 10.222.0.64 "GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54" status: 200 len: 1560 microversion: 2.1 time: 0.170171 Oct 27 16:07:35.187808 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 883/1698] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 16:07:35 2021] GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54 => generated 1560 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 16:07:36.214173 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-11e9c094-8fef-4d69-8ca6-ad484f3ce55b tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:07:36.214843 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-11e9c094-8fef-4d69-8ca6-ad484f3ce55b tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] [instance: 013da7c4-ac69-4554-827b-d68e9bac0e54] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:07:36.223696 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-11e9c094-8fef-4d69-8ca6-ad484f3ce55b tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:07:36.224319 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-11e9c094-8fef-4d69-8ca6-ad484f3ce55b tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:07:36.225290 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-11e9c094-8fef-4d69-8ca6-ad484f3ce55b tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:07:36.225814 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-11e9c094-8fef-4d69-8ca6-ad484f3ce55b tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:07:36.364398 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-11e9c094-8fef-4d69-8ca6-ad484f3ce55b tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6be4749041442787482b6e06b6c40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73f3238988e4e1293ad782712a1da53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 16:07:36.372717 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-11e9c094-8fef-4d69-8ca6-ad484f3ce55b tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] 10.222.0.64 "GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54" status: 200 len: 1560 microversion: 2.1 time: 0.162740 Oct 27 16:07:36.373332 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 816/1699] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 16:07:36 2021] GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54 => generated 1560 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 16:07:37.237502 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 27 16:07:37.238503 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: Wed Oct 27 16:07:37 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Oct 27 16:07:37.390241 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-e42d7b6a-57b7-458e-8178-6e377c1d76b3 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:07:37.391544 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-e42d7b6a-57b7-458e-8178-6e377c1d76b3 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] [instance: 013da7c4-ac69-4554-827b-d68e9bac0e54] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:07:37.398057 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-e42d7b6a-57b7-458e-8178-6e377c1d76b3 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:07:37.398499 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-e42d7b6a-57b7-458e-8178-6e377c1d76b3 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:07:37.399275 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-e42d7b6a-57b7-458e-8178-6e377c1d76b3 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:07:37.399714 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-e42d7b6a-57b7-458e-8178-6e377c1d76b3 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:07:37.540486 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-e42d7b6a-57b7-458e-8178-6e377c1d76b3 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6be4749041442787482b6e06b6c40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73f3238988e4e1293ad782712a1da53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 16:07:37.550512 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-e42d7b6a-57b7-458e-8178-6e377c1d76b3 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] 10.222.0.64 "GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54" status: 200 len: 1560 microversion: 2.1 time: 0.164510 Oct 27 16:07:37.551200 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 884/1700] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 16:07:37 2021] GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54 => generated 1560 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 16:07:38.568677 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-c3005d27-e3c9-4d7c-8cb9-df3b40f496fe tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:07:38.569474 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-c3005d27-e3c9-4d7c-8cb9-df3b40f496fe tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] [instance: 013da7c4-ac69-4554-827b-d68e9bac0e54] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:07:38.575976 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-c3005d27-e3c9-4d7c-8cb9-df3b40f496fe tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:07:38.576413 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-c3005d27-e3c9-4d7c-8cb9-df3b40f496fe tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:07:38.577203 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-c3005d27-e3c9-4d7c-8cb9-df3b40f496fe tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:07:38.577692 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-c3005d27-e3c9-4d7c-8cb9-df3b40f496fe tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:07:38.711302 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-c3005d27-e3c9-4d7c-8cb9-df3b40f496fe tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6be4749041442787482b6e06b6c40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73f3238988e4e1293ad782712a1da53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 16:07:38.719827 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-c3005d27-e3c9-4d7c-8cb9-df3b40f496fe tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] 10.222.0.64 "GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54" status: 200 len: 1560 microversion: 2.1 time: 0.155022 Oct 27 16:07:38.720421 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 817/1701] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 16:07:38 2021] GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54 => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 16:07:39.742352 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-31458abd-53d4-4863-a468-3d40a28d18a8 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:07:39.743519 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-31458abd-53d4-4863-a468-3d40a28d18a8 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] [instance: 013da7c4-ac69-4554-827b-d68e9bac0e54] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:07:39.755221 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-31458abd-53d4-4863-a468-3d40a28d18a8 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:07:39.756043 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-31458abd-53d4-4863-a468-3d40a28d18a8 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:07:39.757415 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-31458abd-53d4-4863-a468-3d40a28d18a8 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:07:39.758186 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-31458abd-53d4-4863-a468-3d40a28d18a8 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:07:39.943835 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-31458abd-53d4-4863-a468-3d40a28d18a8 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6be4749041442787482b6e06b6c40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73f3238988e4e1293ad782712a1da53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 16:07:39.955329 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-31458abd-53d4-4863-a468-3d40a28d18a8 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] 10.222.0.64 "GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54" status: 200 len: 1560 microversion: 2.1 time: 0.220094 Oct 27 16:07:39.956185 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 885/1702] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 16:07:39 2021] GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54 => generated 1560 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 16:07:40.981153 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-718ed4c6-cce3-4bae-a44c-5d44936dd58c tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:07:40.982318 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-718ed4c6-cce3-4bae-a44c-5d44936dd58c tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] [instance: 013da7c4-ac69-4554-827b-d68e9bac0e54] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:07:40.994456 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-718ed4c6-cce3-4bae-a44c-5d44936dd58c tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:07:40.995228 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-718ed4c6-cce3-4bae-a44c-5d44936dd58c tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:07:40.996701 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-718ed4c6-cce3-4bae-a44c-5d44936dd58c tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:07:40.997495 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-718ed4c6-cce3-4bae-a44c-5d44936dd58c tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:07:41.140766 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-718ed4c6-cce3-4bae-a44c-5d44936dd58c tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6be4749041442787482b6e06b6c40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73f3238988e4e1293ad782712a1da53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 16:07:41.149473 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-718ed4c6-cce3-4bae-a44c-5d44936dd58c tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] 10.222.0.64 "GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54" status: 200 len: 1560 microversion: 2.1 time: 0.175351 Oct 27 16:07:41.150072 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 818/1703] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 16:07:40 2021] GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54 => generated 1560 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 16:07:42.167033 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-beb2ea86-b907-492d-8837-f7fe9e400766 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:07:42.167694 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-beb2ea86-b907-492d-8837-f7fe9e400766 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] [instance: 013da7c4-ac69-4554-827b-d68e9bac0e54] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:07:42.174848 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-beb2ea86-b907-492d-8837-f7fe9e400766 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:07:42.175301 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-beb2ea86-b907-492d-8837-f7fe9e400766 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:07:42.176164 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-beb2ea86-b907-492d-8837-f7fe9e400766 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:07:42.176606 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-beb2ea86-b907-492d-8837-f7fe9e400766 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:07:42.309518 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-beb2ea86-b907-492d-8837-f7fe9e400766 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6be4749041442787482b6e06b6c40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73f3238988e4e1293ad782712a1da53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 16:07:42.320631 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-beb2ea86-b907-492d-8837-f7fe9e400766 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] 10.222.0.64 "GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54" status: 200 len: 1560 microversion: 2.1 time: 0.156767 Oct 27 16:07:42.328677 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 886/1704] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 16:07:42 2021] GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54 => generated 1560 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 16:07:43.347625 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-b47b0448-82b6-44ae-b73e-62e5426a9b21 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:07:43.348744 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-b47b0448-82b6-44ae-b73e-62e5426a9b21 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] [instance: 013da7c4-ac69-4554-827b-d68e9bac0e54] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:07:43.360244 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-b47b0448-82b6-44ae-b73e-62e5426a9b21 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:07:43.361148 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-b47b0448-82b6-44ae-b73e-62e5426a9b21 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:07:43.362522 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-b47b0448-82b6-44ae-b73e-62e5426a9b21 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:07:43.363304 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-b47b0448-82b6-44ae-b73e-62e5426a9b21 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:07:43.502137 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-b47b0448-82b6-44ae-b73e-62e5426a9b21 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6be4749041442787482b6e06b6c40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73f3238988e4e1293ad782712a1da53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 16:07:43.513969 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-b47b0448-82b6-44ae-b73e-62e5426a9b21 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] 10.222.0.64 "GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54" status: 200 len: 1560 microversion: 2.1 time: 0.173256 Oct 27 16:07:43.515093 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 819/1705] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 16:07:43 2021] GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54 => generated 1560 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 16:07:44.535206 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-b54ae2d2-9f84-475f-bf01-a644910bda07 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:07:44.535873 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-b54ae2d2-9f84-475f-bf01-a644910bda07 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] [instance: 013da7c4-ac69-4554-827b-d68e9bac0e54] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:07:44.543449 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-b54ae2d2-9f84-475f-bf01-a644910bda07 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:07:44.544116 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-b54ae2d2-9f84-475f-bf01-a644910bda07 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:07:44.545041 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-b54ae2d2-9f84-475f-bf01-a644910bda07 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:07:44.546194 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-b54ae2d2-9f84-475f-bf01-a644910bda07 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:07:44.674457 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-b54ae2d2-9f84-475f-bf01-a644910bda07 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6be4749041442787482b6e06b6c40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73f3238988e4e1293ad782712a1da53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 16:07:44.682484 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-b54ae2d2-9f84-475f-bf01-a644910bda07 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] 10.222.0.64 "GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54" status: 200 len: 1560 microversion: 2.1 time: 0.150834 Oct 27 16:07:44.682966 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 887/1706] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 16:07:44 2021] GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 16:07:45.618094 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 27 16:07:45.619141 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: Wed Oct 27 16:07:45 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Oct 27 16:07:45.701246 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-62e68361-7c11-4031-b21c-6212786cfe74 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:07:45.702842 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-62e68361-7c11-4031-b21c-6212786cfe74 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] [instance: 013da7c4-ac69-4554-827b-d68e9bac0e54] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:07:45.709592 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-62e68361-7c11-4031-b21c-6212786cfe74 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:07:45.710044 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-62e68361-7c11-4031-b21c-6212786cfe74 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:07:45.710851 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-62e68361-7c11-4031-b21c-6212786cfe74 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:07:45.711290 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-62e68361-7c11-4031-b21c-6212786cfe74 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:07:45.849111 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-62e68361-7c11-4031-b21c-6212786cfe74 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6be4749041442787482b6e06b6c40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73f3238988e4e1293ad782712a1da53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 16:07:45.857322 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-62e68361-7c11-4031-b21c-6212786cfe74 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] 10.222.0.64 "GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54" status: 200 len: 1560 microversion: 2.1 time: 0.161175 Oct 27 16:07:45.857908 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 820/1707] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 16:07:45 2021] GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54 => generated 1560 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 16:07:46.876540 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-3f028d1c-9898-4fc9-b389-84416cd61537 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:07:46.877184 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-3f028d1c-9898-4fc9-b389-84416cd61537 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] [instance: 013da7c4-ac69-4554-827b-d68e9bac0e54] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:07:46.883967 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-3f028d1c-9898-4fc9-b389-84416cd61537 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:07:46.884442 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-3f028d1c-9898-4fc9-b389-84416cd61537 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:07:46.885220 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-3f028d1c-9898-4fc9-b389-84416cd61537 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:07:46.885659 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-3f028d1c-9898-4fc9-b389-84416cd61537 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:07:47.019231 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-3f028d1c-9898-4fc9-b389-84416cd61537 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6be4749041442787482b6e06b6c40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73f3238988e4e1293ad782712a1da53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 16:07:47.027109 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-3f028d1c-9898-4fc9-b389-84416cd61537 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] 10.222.0.64 "GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54" status: 200 len: 1560 microversion: 2.1 time: 0.154892 Oct 27 16:07:47.027683 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 888/1708] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 16:07:46 2021] GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54 => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 16:07:48.049041 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-2b3f38a3-2826-47f3-bfe5-29acb3c8f8b2 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:07:48.049739 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-2b3f38a3-2826-47f3-bfe5-29acb3c8f8b2 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] [instance: 013da7c4-ac69-4554-827b-d68e9bac0e54] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:07:48.056322 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-2b3f38a3-2826-47f3-bfe5-29acb3c8f8b2 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:07:48.056756 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-2b3f38a3-2826-47f3-bfe5-29acb3c8f8b2 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:07:48.057537 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-2b3f38a3-2826-47f3-bfe5-29acb3c8f8b2 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:07:48.057962 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-2b3f38a3-2826-47f3-bfe5-29acb3c8f8b2 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:07:48.201316 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-2b3f38a3-2826-47f3-bfe5-29acb3c8f8b2 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6be4749041442787482b6e06b6c40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73f3238988e4e1293ad782712a1da53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 16:07:48.209647 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-2b3f38a3-2826-47f3-bfe5-29acb3c8f8b2 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] 10.222.0.64 "GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54" status: 200 len: 1560 microversion: 2.1 time: 0.167843 Oct 27 16:07:48.210221 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 821/1709] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 16:07:48 2021] GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54 => generated 1560 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 16:07:49.227342 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-8e23838a-accc-456f-a0fa-30ad77f8263e tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:07:49.228015 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-8e23838a-accc-456f-a0fa-30ad77f8263e tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] [instance: 013da7c4-ac69-4554-827b-d68e9bac0e54] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:07:49.234511 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-8e23838a-accc-456f-a0fa-30ad77f8263e tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:07:49.234948 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-8e23838a-accc-456f-a0fa-30ad77f8263e tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:07:49.235714 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-8e23838a-accc-456f-a0fa-30ad77f8263e tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:07:49.236172 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-8e23838a-accc-456f-a0fa-30ad77f8263e tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:07:49.363649 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-8e23838a-accc-456f-a0fa-30ad77f8263e tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6be4749041442787482b6e06b6c40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73f3238988e4e1293ad782712a1da53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 16:07:49.375610 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-8e23838a-accc-456f-a0fa-30ad77f8263e tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] 10.222.0.64 "GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54" status: 200 len: 1560 microversion: 2.1 time: 0.152457 Oct 27 16:07:49.376771 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 889/1710] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 16:07:49 2021] GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54 => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 16:07:50.402256 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-e9a6a99b-dd75-496a-a894-b9a84a5e2372 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:07:50.402865 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-e9a6a99b-dd75-496a-a894-b9a84a5e2372 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] [instance: 013da7c4-ac69-4554-827b-d68e9bac0e54] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:07:50.410083 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-e9a6a99b-dd75-496a-a894-b9a84a5e2372 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:07:50.410539 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-e9a6a99b-dd75-496a-a894-b9a84a5e2372 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:07:50.411382 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-e9a6a99b-dd75-496a-a894-b9a84a5e2372 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:07:50.411821 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-e9a6a99b-dd75-496a-a894-b9a84a5e2372 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:07:50.560235 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-e9a6a99b-dd75-496a-a894-b9a84a5e2372 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6be4749041442787482b6e06b6c40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73f3238988e4e1293ad782712a1da53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 16:07:50.569586 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-e9a6a99b-dd75-496a-a894-b9a84a5e2372 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] 10.222.0.64 "GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54" status: 200 len: 1560 microversion: 2.1 time: 0.171256 Oct 27 16:07:50.570176 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 822/1711] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 16:07:50 2021] GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54 => generated 1560 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 16:07:51.589378 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-990b2a9c-932a-46f6-9ec4-486bbd994629 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:07:51.590020 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-990b2a9c-932a-46f6-9ec4-486bbd994629 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] [instance: 013da7c4-ac69-4554-827b-d68e9bac0e54] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:07:51.598141 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-990b2a9c-932a-46f6-9ec4-486bbd994629 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:07:51.598581 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-990b2a9c-932a-46f6-9ec4-486bbd994629 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:07:51.599357 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-990b2a9c-932a-46f6-9ec4-486bbd994629 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:07:51.599782 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-990b2a9c-932a-46f6-9ec4-486bbd994629 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:07:51.734065 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-990b2a9c-932a-46f6-9ec4-486bbd994629 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6be4749041442787482b6e06b6c40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73f3238988e4e1293ad782712a1da53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 16:07:51.742367 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-990b2a9c-932a-46f6-9ec4-486bbd994629 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] 10.222.0.64 "GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54" status: 200 len: 1560 microversion: 2.1 time: 0.156606 Oct 27 16:07:51.742858 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 890/1712] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 16:07:51 2021] GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54 => generated 1560 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 16:07:52.760494 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-24042c70-d0fd-4f72-8623-b2705b6e7100 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:07:52.761139 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-24042c70-d0fd-4f72-8623-b2705b6e7100 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] [instance: 013da7c4-ac69-4554-827b-d68e9bac0e54] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:07:52.768488 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-24042c70-d0fd-4f72-8623-b2705b6e7100 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:07:52.768935 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-24042c70-d0fd-4f72-8623-b2705b6e7100 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:07:52.769718 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-24042c70-d0fd-4f72-8623-b2705b6e7100 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:07:52.770160 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-24042c70-d0fd-4f72-8623-b2705b6e7100 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:07:52.892676 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-24042c70-d0fd-4f72-8623-b2705b6e7100 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6be4749041442787482b6e06b6c40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73f3238988e4e1293ad782712a1da53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 16:07:52.905851 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-24042c70-d0fd-4f72-8623-b2705b6e7100 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] 10.222.0.64 "GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54" status: 200 len: 1560 microversion: 2.1 time: 0.149065 Oct 27 16:07:52.906440 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 823/1713] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 16:07:52 2021] GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54 => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 16:07:53.923596 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-b76d2434-f735-4f73-968b-84072d190813 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:07:53.924231 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-b76d2434-f735-4f73-968b-84072d190813 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] [instance: 013da7c4-ac69-4554-827b-d68e9bac0e54] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:07:53.930602 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-b76d2434-f735-4f73-968b-84072d190813 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:07:53.931039 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-b76d2434-f735-4f73-968b-84072d190813 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:07:53.931814 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-b76d2434-f735-4f73-968b-84072d190813 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:07:53.932271 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-b76d2434-f735-4f73-968b-84072d190813 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:07:54.062145 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-b76d2434-f735-4f73-968b-84072d190813 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6be4749041442787482b6e06b6c40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73f3238988e4e1293ad782712a1da53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 16:07:54.070215 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-b76d2434-f735-4f73-968b-84072d190813 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] 10.222.0.64 "GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54" status: 200 len: 1560 microversion: 2.1 time: 0.150999 Oct 27 16:07:54.070792 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 891/1714] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 16:07:53 2021] GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 16:07:55.087908 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-4dfbbae2-cfdb-4b71-a892-045f4a67f871 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:07:55.088538 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-4dfbbae2-cfdb-4b71-a892-045f4a67f871 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] [instance: 013da7c4-ac69-4554-827b-d68e9bac0e54] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:07:55.095753 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-4dfbbae2-cfdb-4b71-a892-045f4a67f871 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:07:55.096221 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-4dfbbae2-cfdb-4b71-a892-045f4a67f871 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:07:55.097007 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-4dfbbae2-cfdb-4b71-a892-045f4a67f871 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:07:55.097439 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-4dfbbae2-cfdb-4b71-a892-045f4a67f871 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:07:55.231906 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-4dfbbae2-cfdb-4b71-a892-045f4a67f871 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6be4749041442787482b6e06b6c40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73f3238988e4e1293ad782712a1da53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 16:07:55.245399 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-4dfbbae2-cfdb-4b71-a892-045f4a67f871 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] 10.222.0.64 "GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54" status: 200 len: 1560 microversion: 2.1 time: 0.160628 Oct 27 16:07:55.245399 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 824/1715] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 16:07:55 2021] GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54 => generated 1560 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 16:07:56.262584 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-f53d4a9e-0be3-4b06-8546-76320567b920 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:07:56.263195 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-f53d4a9e-0be3-4b06-8546-76320567b920 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] [instance: 013da7c4-ac69-4554-827b-d68e9bac0e54] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:07:56.269489 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-f53d4a9e-0be3-4b06-8546-76320567b920 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:07:56.269928 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-f53d4a9e-0be3-4b06-8546-76320567b920 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:07:56.270687 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-f53d4a9e-0be3-4b06-8546-76320567b920 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:07:56.271118 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-f53d4a9e-0be3-4b06-8546-76320567b920 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:07:56.395724 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-f53d4a9e-0be3-4b06-8546-76320567b920 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6be4749041442787482b6e06b6c40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73f3238988e4e1293ad782712a1da53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 16:07:56.403426 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-f53d4a9e-0be3-4b06-8546-76320567b920 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] 10.222.0.64 "GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54" status: 200 len: 1560 microversion: 2.1 time: 0.144622 Oct 27 16:07:56.404020 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 892/1716] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 16:07:56 2021] GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54 => generated 1560 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 16:07:57.421269 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-fc908ba2-57f0-4c1c-9c64-d96038b11cb3 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:07:57.421884 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-fc908ba2-57f0-4c1c-9c64-d96038b11cb3 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] [instance: 013da7c4-ac69-4554-827b-d68e9bac0e54] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:07:57.429134 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-fc908ba2-57f0-4c1c-9c64-d96038b11cb3 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:07:57.429573 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-fc908ba2-57f0-4c1c-9c64-d96038b11cb3 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:07:57.430358 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-fc908ba2-57f0-4c1c-9c64-d96038b11cb3 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:07:57.430786 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-fc908ba2-57f0-4c1c-9c64-d96038b11cb3 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:07:57.568348 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-fc908ba2-57f0-4c1c-9c64-d96038b11cb3 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6be4749041442787482b6e06b6c40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73f3238988e4e1293ad782712a1da53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 16:07:57.577314 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-fc908ba2-57f0-4c1c-9c64-d96038b11cb3 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] 10.222.0.64 "GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54" status: 200 len: 1560 microversion: 2.1 time: 0.159358 Oct 27 16:07:57.577911 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 825/1717] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 16:07:57 2021] GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54 => generated 1560 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 16:07:58.594363 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-5d67d03b-1291-4c18-9c68-5ca8253a4244 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:07:58.594973 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-5d67d03b-1291-4c18-9c68-5ca8253a4244 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] [instance: 013da7c4-ac69-4554-827b-d68e9bac0e54] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:07:58.601160 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-5d67d03b-1291-4c18-9c68-5ca8253a4244 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:07:58.601596 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-5d67d03b-1291-4c18-9c68-5ca8253a4244 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:07:58.602346 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-5d67d03b-1291-4c18-9c68-5ca8253a4244 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:07:58.602771 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-5d67d03b-1291-4c18-9c68-5ca8253a4244 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:07:58.725078 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-5d67d03b-1291-4c18-9c68-5ca8253a4244 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6be4749041442787482b6e06b6c40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73f3238988e4e1293ad782712a1da53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 16:07:58.733811 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-5d67d03b-1291-4c18-9c68-5ca8253a4244 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] 10.222.0.64 "GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54" status: 200 len: 1560 microversion: 2.1 time: 0.142463 Oct 27 16:07:58.734083 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 893/1718] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 16:07:58 2021] GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54 => generated 1560 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 16:07:59.751313 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-64141eca-4787-40a6-8fda-a7595b304953 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:07:59.751932 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-64141eca-4787-40a6-8fda-a7595b304953 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] [instance: 013da7c4-ac69-4554-827b-d68e9bac0e54] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:07:59.758067 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-64141eca-4787-40a6-8fda-a7595b304953 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:07:59.758510 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-64141eca-4787-40a6-8fda-a7595b304953 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:07:59.759266 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-64141eca-4787-40a6-8fda-a7595b304953 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:07:59.759701 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-64141eca-4787-40a6-8fda-a7595b304953 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:07:59.881384 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-64141eca-4787-40a6-8fda-a7595b304953 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6be4749041442787482b6e06b6c40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73f3238988e4e1293ad782712a1da53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 16:07:59.889514 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-64141eca-4787-40a6-8fda-a7595b304953 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] 10.222.0.64 "GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54" status: 200 len: 1560 microversion: 2.1 time: 0.142296 Oct 27 16:07:59.890078 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 826/1719] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 16:07:59 2021] GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54 => generated 1560 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 16:08:00.906763 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-3809618b-6050-46fe-8ad5-14f37e3b28dc tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:08:00.907371 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-3809618b-6050-46fe-8ad5-14f37e3b28dc tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] [instance: 013da7c4-ac69-4554-827b-d68e9bac0e54] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:08:00.916597 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-3809618b-6050-46fe-8ad5-14f37e3b28dc tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:08:00.916597 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-3809618b-6050-46fe-8ad5-14f37e3b28dc tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:08:00.916597 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-3809618b-6050-46fe-8ad5-14f37e3b28dc tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:08:00.916597 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-3809618b-6050-46fe-8ad5-14f37e3b28dc tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:08:01.045079 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-3809618b-6050-46fe-8ad5-14f37e3b28dc tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6be4749041442787482b6e06b6c40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73f3238988e4e1293ad782712a1da53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 16:08:01.052793 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-3809618b-6050-46fe-8ad5-14f37e3b28dc tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] 10.222.0.64 "GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54" status: 200 len: 1560 microversion: 2.1 time: 0.149902 Oct 27 16:08:01.053356 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 894/1720] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 16:08:00 2021] GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 16:08:02.070569 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-605f27ef-f512-405c-9df2-75d1d6b92ea6 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:08:02.071192 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-605f27ef-f512-405c-9df2-75d1d6b92ea6 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] [instance: 013da7c4-ac69-4554-827b-d68e9bac0e54] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:08:02.078200 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-605f27ef-f512-405c-9df2-75d1d6b92ea6 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:08:02.078646 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-605f27ef-f512-405c-9df2-75d1d6b92ea6 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:08:02.079414 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-605f27ef-f512-405c-9df2-75d1d6b92ea6 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:08:02.079869 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-605f27ef-f512-405c-9df2-75d1d6b92ea6 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:08:02.226060 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-605f27ef-f512-405c-9df2-75d1d6b92ea6 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6be4749041442787482b6e06b6c40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73f3238988e4e1293ad782712a1da53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 16:08:02.233976 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-605f27ef-f512-405c-9df2-75d1d6b92ea6 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] 10.222.0.64 "GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54" status: 200 len: 1560 microversion: 2.1 time: 0.167162 Oct 27 16:08:02.234551 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 827/1721] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 16:08:02 2021] GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54 => generated 1560 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 16:08:03.251648 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-6fb1a79a-a1ec-4366-bca4-6c255fd806c3 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:08:03.252308 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-6fb1a79a-a1ec-4366-bca4-6c255fd806c3 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] [instance: 013da7c4-ac69-4554-827b-d68e9bac0e54] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:08:03.258947 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-6fb1a79a-a1ec-4366-bca4-6c255fd806c3 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:08:03.259385 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-6fb1a79a-a1ec-4366-bca4-6c255fd806c3 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:08:03.260194 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-6fb1a79a-a1ec-4366-bca4-6c255fd806c3 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:08:03.260624 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-6fb1a79a-a1ec-4366-bca4-6c255fd806c3 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:08:03.409202 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-6fb1a79a-a1ec-4366-bca4-6c255fd806c3 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6be4749041442787482b6e06b6c40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73f3238988e4e1293ad782712a1da53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 16:08:03.417369 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-6fb1a79a-a1ec-4366-bca4-6c255fd806c3 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] 10.222.0.64 "GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54" status: 200 len: 1560 microversion: 2.1 time: 0.169997 Oct 27 16:08:03.417956 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 895/1722] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 16:08:03 2021] GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54 => generated 1560 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 16:08:04.435179 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-11a8ea8a-f313-47c8-8dfc-78b5adf88689 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:08:04.436552 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-11a8ea8a-f313-47c8-8dfc-78b5adf88689 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] [instance: 013da7c4-ac69-4554-827b-d68e9bac0e54] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:08:04.442790 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-11a8ea8a-f313-47c8-8dfc-78b5adf88689 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:08:04.443230 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-11a8ea8a-f313-47c8-8dfc-78b5adf88689 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:08:04.444039 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-11a8ea8a-f313-47c8-8dfc-78b5adf88689 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:08:04.444470 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-11a8ea8a-f313-47c8-8dfc-78b5adf88689 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:08:04.573722 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-11a8ea8a-f313-47c8-8dfc-78b5adf88689 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6be4749041442787482b6e06b6c40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73f3238988e4e1293ad782712a1da53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 16:08:04.581514 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-11a8ea8a-f313-47c8-8dfc-78b5adf88689 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] 10.222.0.64 "GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54" status: 200 len: 1560 microversion: 2.1 time: 0.150168 Oct 27 16:08:04.582088 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 828/1723] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 16:08:04 2021] GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 16:08:05.599240 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-fb624a03-2397-4004-89bf-08d5ca12fa7d tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:08:05.599878 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-fb624a03-2397-4004-89bf-08d5ca12fa7d tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] [instance: 013da7c4-ac69-4554-827b-d68e9bac0e54] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:08:05.606055 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-fb624a03-2397-4004-89bf-08d5ca12fa7d tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:08:05.606494 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-fb624a03-2397-4004-89bf-08d5ca12fa7d tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:08:05.607256 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-fb624a03-2397-4004-89bf-08d5ca12fa7d tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:08:05.608281 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-fb624a03-2397-4004-89bf-08d5ca12fa7d tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:08:05.749446 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-fb624a03-2397-4004-89bf-08d5ca12fa7d tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6be4749041442787482b6e06b6c40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73f3238988e4e1293ad782712a1da53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 16:08:05.758394 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-fb624a03-2397-4004-89bf-08d5ca12fa7d tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] 10.222.0.64 "GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54" status: 200 len: 1560 microversion: 2.1 time: 0.162730 Oct 27 16:08:05.758987 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 896/1724] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 16:08:05 2021] GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54 => generated 1560 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 16:08:06.776573 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-3e3f13c9-d4d5-4531-9a8e-bf492d136197 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:08:06.777164 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-3e3f13c9-d4d5-4531-9a8e-bf492d136197 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] [instance: 013da7c4-ac69-4554-827b-d68e9bac0e54] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:08:06.785161 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-3e3f13c9-d4d5-4531-9a8e-bf492d136197 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:08:06.785608 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-3e3f13c9-d4d5-4531-9a8e-bf492d136197 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:08:06.786387 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-3e3f13c9-d4d5-4531-9a8e-bf492d136197 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:08:06.786822 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-3e3f13c9-d4d5-4531-9a8e-bf492d136197 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:08:06.917143 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-3e3f13c9-d4d5-4531-9a8e-bf492d136197 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6be4749041442787482b6e06b6c40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73f3238988e4e1293ad782712a1da53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 16:08:06.927279 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-3e3f13c9-d4d5-4531-9a8e-bf492d136197 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] 10.222.0.64 "GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54" status: 200 len: 1560 microversion: 2.1 time: 0.154058 Oct 27 16:08:06.928230 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 829/1725] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 16:08:06 2021] GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54 => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 16:08:07.947480 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-32df11bd-9bcb-4129-8f7c-30be5a0ddc6b tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:08:07.948537 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-32df11bd-9bcb-4129-8f7c-30be5a0ddc6b tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] [instance: 013da7c4-ac69-4554-827b-d68e9bac0e54] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:08:07.956081 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-32df11bd-9bcb-4129-8f7c-30be5a0ddc6b tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:08:07.956230 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-32df11bd-9bcb-4129-8f7c-30be5a0ddc6b tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:08:07.957003 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-32df11bd-9bcb-4129-8f7c-30be5a0ddc6b tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:08:07.957468 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-32df11bd-9bcb-4129-8f7c-30be5a0ddc6b tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:08:08.216983 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-32df11bd-9bcb-4129-8f7c-30be5a0ddc6b tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6be4749041442787482b6e06b6c40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73f3238988e4e1293ad782712a1da53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 16:08:08.227130 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-32df11bd-9bcb-4129-8f7c-30be5a0ddc6b tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] 10.222.0.64 "GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54" status: 200 len: 1560 microversion: 2.1 time: 0.284521 Oct 27 16:08:08.227889 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 897/1726] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 16:08:07 2021] GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54 => generated 1560 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 16:08:09.246239 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-0d7d452f-a3e9-48aa-8d5f-aba7388ae4b7 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:08:09.246859 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-0d7d452f-a3e9-48aa-8d5f-aba7388ae4b7 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] [instance: 013da7c4-ac69-4554-827b-d68e9bac0e54] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:08:09.253192 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-0d7d452f-a3e9-48aa-8d5f-aba7388ae4b7 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:08:09.253627 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-0d7d452f-a3e9-48aa-8d5f-aba7388ae4b7 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:08:09.254385 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-0d7d452f-a3e9-48aa-8d5f-aba7388ae4b7 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:08:09.254807 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-0d7d452f-a3e9-48aa-8d5f-aba7388ae4b7 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:08:09.379649 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-0d7d452f-a3e9-48aa-8d5f-aba7388ae4b7 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6be4749041442787482b6e06b6c40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73f3238988e4e1293ad782712a1da53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 16:08:09.387674 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-0d7d452f-a3e9-48aa-8d5f-aba7388ae4b7 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] 10.222.0.64 "GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54" status: 200 len: 1560 microversion: 2.1 time: 0.145096 Oct 27 16:08:09.388366 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 830/1727] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 16:08:09 2021] GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54 => generated 1560 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 16:08:10.404663 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-2d2f31f1-ecc3-4bd5-92d8-ebdd8b74a618 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:08:10.405262 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-2d2f31f1-ecc3-4bd5-92d8-ebdd8b74a618 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] [instance: 013da7c4-ac69-4554-827b-d68e9bac0e54] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:08:10.411389 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-2d2f31f1-ecc3-4bd5-92d8-ebdd8b74a618 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:08:10.411826 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-2d2f31f1-ecc3-4bd5-92d8-ebdd8b74a618 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:08:10.412621 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-2d2f31f1-ecc3-4bd5-92d8-ebdd8b74a618 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:08:10.413047 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-2d2f31f1-ecc3-4bd5-92d8-ebdd8b74a618 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:08:10.547229 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-2d2f31f1-ecc3-4bd5-92d8-ebdd8b74a618 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6be4749041442787482b6e06b6c40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73f3238988e4e1293ad782712a1da53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 16:08:10.554963 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-2d2f31f1-ecc3-4bd5-92d8-ebdd8b74a618 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] 10.222.0.64 "GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54" status: 200 len: 1560 microversion: 2.1 time: 0.154018 Oct 27 16:08:10.556003 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 898/1728] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 16:08:10 2021] GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54 => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 16:08:11.572838 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-0ba93a04-8303-40ed-82c1-aaff2a02cac6 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:08:11.573441 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-0ba93a04-8303-40ed-82c1-aaff2a02cac6 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] [instance: 013da7c4-ac69-4554-827b-d68e9bac0e54] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:08:11.580557 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-0ba93a04-8303-40ed-82c1-aaff2a02cac6 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:08:11.581011 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-0ba93a04-8303-40ed-82c1-aaff2a02cac6 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:08:11.581774 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-0ba93a04-8303-40ed-82c1-aaff2a02cac6 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:08:11.582205 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-0ba93a04-8303-40ed-82c1-aaff2a02cac6 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:08:11.703150 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-0ba93a04-8303-40ed-82c1-aaff2a02cac6 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6be4749041442787482b6e06b6c40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73f3238988e4e1293ad782712a1da53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 16:08:11.711181 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-0ba93a04-8303-40ed-82c1-aaff2a02cac6 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] 10.222.0.64 "GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54" status: 200 len: 1560 microversion: 2.1 time: 0.141996 Oct 27 16:08:11.711745 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 831/1729] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 16:08:11 2021] GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54 => generated 1560 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 16:08:12.729551 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-de8b47af-1826-400c-a9ca-e2b6ca7879b3 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:08:12.730109 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-de8b47af-1826-400c-a9ca-e2b6ca7879b3 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] [instance: 013da7c4-ac69-4554-827b-d68e9bac0e54] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:08:12.737643 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-de8b47af-1826-400c-a9ca-e2b6ca7879b3 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:08:12.738140 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-de8b47af-1826-400c-a9ca-e2b6ca7879b3 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:08:12.739080 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-de8b47af-1826-400c-a9ca-e2b6ca7879b3 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:08:12.739548 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-de8b47af-1826-400c-a9ca-e2b6ca7879b3 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:08:12.868528 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-de8b47af-1826-400c-a9ca-e2b6ca7879b3 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6be4749041442787482b6e06b6c40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73f3238988e4e1293ad782712a1da53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 16:08:12.877430 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-de8b47af-1826-400c-a9ca-e2b6ca7879b3 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] 10.222.0.64 "GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54" status: 200 len: 1560 microversion: 2.1 time: 0.151849 Oct 27 16:08:12.878010 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 899/1730] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 16:08:12 2021] GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 16:08:13.895913 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-e50d33df-ae8e-41d1-b05a-3128abc86739 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:08:13.896530 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-e50d33df-ae8e-41d1-b05a-3128abc86739 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] [instance: 013da7c4-ac69-4554-827b-d68e9bac0e54] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:08:13.905669 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-e50d33df-ae8e-41d1-b05a-3128abc86739 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:08:13.906516 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-e50d33df-ae8e-41d1-b05a-3128abc86739 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:08:13.907621 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-e50d33df-ae8e-41d1-b05a-3128abc86739 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:08:13.908089 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-e50d33df-ae8e-41d1-b05a-3128abc86739 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:08:14.040361 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-e50d33df-ae8e-41d1-b05a-3128abc86739 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6be4749041442787482b6e06b6c40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73f3238988e4e1293ad782712a1da53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 16:08:14.049203 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-e50d33df-ae8e-41d1-b05a-3128abc86739 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] 10.222.0.64 "GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54" status: 200 len: 1560 microversion: 2.1 time: 0.158196 Oct 27 16:08:14.049781 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 832/1731] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 16:08:13 2021] GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54 => generated 1560 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 16:08:15.066585 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-71133271-1d94-491d-beb2-807bc57dfb77 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:08:15.067218 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-71133271-1d94-491d-beb2-807bc57dfb77 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] [instance: 013da7c4-ac69-4554-827b-d68e9bac0e54] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:08:15.073510 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-71133271-1d94-491d-beb2-807bc57dfb77 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:08:15.073984 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-71133271-1d94-491d-beb2-807bc57dfb77 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:08:15.074737 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-71133271-1d94-491d-beb2-807bc57dfb77 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:08:15.075163 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-71133271-1d94-491d-beb2-807bc57dfb77 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:08:15.276856 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-71133271-1d94-491d-beb2-807bc57dfb77 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6be4749041442787482b6e06b6c40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73f3238988e4e1293ad782712a1da53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 16:08:15.286108 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-71133271-1d94-491d-beb2-807bc57dfb77 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] 10.222.0.64 "GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54" status: 200 len: 1560 microversion: 2.1 time: 0.223180 Oct 27 16:08:15.287188 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 900/1732] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 16:08:15 2021] GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54 => generated 1560 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 16:08:15.443543 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [req-273d6717-6f19-4d56-af0d-0c6fa7dc63be req-e2638793-4e7d-4453-a8ca-06c886069e89 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "013da7c4-ac69-4554-827b-d68e9bac0e54", "name": "network-vif-deleted", "tag": "5acb6d4d-bbe8-4d7d-b997-03494dc5e0d3"}]} {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 16:08:15.445676 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 27 16:08:15.445676 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: warnings.warn(msg) Oct 27 16:08:15.455432 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [req-273d6717-6f19-4d56-af0d-0c6fa7dc63be req-e2638793-4e7d-4453-a8ca-06c886069e89 service nova] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:08:15.456065 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [req-273d6717-6f19-4d56-af0d-0c6fa7dc63be req-e2638793-4e7d-4453-a8ca-06c886069e89 service nova] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:08:15.467317 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.compute.server_external_events [req-273d6717-6f19-4d56-af0d-0c6fa7dc63be req-e2638793-4e7d-4453-a8ca-06c886069e89 service nova] Creating event network-vif-deleted:5acb6d4d-bbe8-4d7d-b997-03494dc5e0d3 for instance 013da7c4-ac69-4554-827b-d68e9bac0e54 on hv-cinder-80070 Oct 27 16:08:15.473817 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [req-273d6717-6f19-4d56-af0d-0c6fa7dc63be req-e2638793-4e7d-4453-a8ca-06c886069e89 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034932 Oct 27 16:08:15.474479 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 833/1733] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Oct 27 16:08:15 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 16:08:16.305421 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-3f7726c8-14e8-4207-90a3-85540d630569 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:08:16.306030 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-3f7726c8-14e8-4207-90a3-85540d630569 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] [instance: 013da7c4-ac69-4554-827b-d68e9bac0e54] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:08:16.312921 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-3f7726c8-14e8-4207-90a3-85540d630569 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:08:16.313365 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-3f7726c8-14e8-4207-90a3-85540d630569 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:08:16.314130 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-3f7726c8-14e8-4207-90a3-85540d630569 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:08:16.314555 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-3f7726c8-14e8-4207-90a3-85540d630569 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:08:16.390229 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-3f7726c8-14e8-4207-90a3-85540d630569 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6be4749041442787482b6e06b6c40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73f3238988e4e1293ad782712a1da53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 16:08:16.397961 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-3f7726c8-14e8-4207-90a3-85540d630569 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] 10.222.0.64 "GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54" status: 200 len: 1350 microversion: 2.1 time: 0.096994 Oct 27 16:08:16.398522 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 901/1734] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 16:08:16 2021] GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54 => generated 1350 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 16:08:17.417595 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-83314716-0ae4-469b-b10d-fdc86f103660 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:08:17.418287 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-83314716-0ae4-469b-b10d-fdc86f103660 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] [instance: 013da7c4-ac69-4554-827b-d68e9bac0e54] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:08:17.424921 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-83314716-0ae4-469b-b10d-fdc86f103660 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:08:17.425624 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-83314716-0ae4-469b-b10d-fdc86f103660 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:08:17.426126 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-83314716-0ae4-469b-b10d-fdc86f103660 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:08:17.426550 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-83314716-0ae4-469b-b10d-fdc86f103660 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:08:17.487422 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-83314716-0ae4-469b-b10d-fdc86f103660 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6be4749041442787482b6e06b6c40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73f3238988e4e1293ad782712a1da53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 16:08:17.496569 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-83314716-0ae4-469b-b10d-fdc86f103660 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] 10.222.0.64 "GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54" status: 200 len: 1350 microversion: 2.1 time: 0.083202 Oct 27 16:08:17.497241 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 834/1735] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 16:08:17 2021] GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54 => generated 1350 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 16:08:18.513853 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-f133a4c6-3f97-4e95-8a42-57131b691338 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:08:18.514460 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-f133a4c6-3f97-4e95-8a42-57131b691338 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] [instance: 013da7c4-ac69-4554-827b-d68e9bac0e54] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:08:18.520798 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-f133a4c6-3f97-4e95-8a42-57131b691338 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:08:18.521237 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-f133a4c6-3f97-4e95-8a42-57131b691338 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:08:18.522013 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-f133a4c6-3f97-4e95-8a42-57131b691338 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:08:18.522442 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-f133a4c6-3f97-4e95-8a42-57131b691338 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:08:18.583920 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-f133a4c6-3f97-4e95-8a42-57131b691338 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6be4749041442787482b6e06b6c40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73f3238988e4e1293ad782712a1da53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 16:08:18.592897 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-f133a4c6-3f97-4e95-8a42-57131b691338 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] 10.222.0.64 "GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54" status: 200 len: 1350 microversion: 2.1 time: 0.082929 Oct 27 16:08:18.593491 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 902/1736] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 16:08:18 2021] GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54 => generated 1350 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 16:08:19.610127 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-c9997fb8-7485-4e12-aec9-4a495757bae4 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:08:19.610725 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-c9997fb8-7485-4e12-aec9-4a495757bae4 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] [instance: 013da7c4-ac69-4554-827b-d68e9bac0e54] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:08:19.616776 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-c9997fb8-7485-4e12-aec9-4a495757bae4 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:08:19.617240 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-c9997fb8-7485-4e12-aec9-4a495757bae4 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:08:19.618060 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-c9997fb8-7485-4e12-aec9-4a495757bae4 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:08:19.618552 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-c9997fb8-7485-4e12-aec9-4a495757bae4 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:08:19.683021 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-c9997fb8-7485-4e12-aec9-4a495757bae4 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6be4749041442787482b6e06b6c40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73f3238988e4e1293ad782712a1da53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 16:08:19.691315 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-c9997fb8-7485-4e12-aec9-4a495757bae4 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] 10.222.0.64 "GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54" status: 200 len: 1350 microversion: 2.1 time: 0.085136 Oct 27 16:08:19.691898 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 835/1737] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 16:08:19 2021] GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54 => generated 1350 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 16:08:20.707563 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-1d36095d-87c5-4d5f-b0d5-fccae72adb10 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:08:20.708672 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-1d36095d-87c5-4d5f-b0d5-fccae72adb10 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] [instance: 013da7c4-ac69-4554-827b-d68e9bac0e54] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:08:20.715019 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-1d36095d-87c5-4d5f-b0d5-fccae72adb10 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:08:20.715462 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-1d36095d-87c5-4d5f-b0d5-fccae72adb10 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:08:20.716261 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-1d36095d-87c5-4d5f-b0d5-fccae72adb10 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:08:20.717400 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-1d36095d-87c5-4d5f-b0d5-fccae72adb10 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:08:20.782181 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-1d36095d-87c5-4d5f-b0d5-fccae72adb10 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6be4749041442787482b6e06b6c40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73f3238988e4e1293ad782712a1da53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 16:08:20.790047 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-1d36095d-87c5-4d5f-b0d5-fccae72adb10 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] 10.222.0.64 "GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54" status: 200 len: 1350 microversion: 2.1 time: 0.086258 Oct 27 16:08:20.790625 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 903/1738] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 16:08:20 2021] GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54 => generated 1350 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 16:08:21.807943 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-93ca31af-f4b4-4f2f-a6e8-dabdb03d06c0 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:08:21.808559 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-93ca31af-f4b4-4f2f-a6e8-dabdb03d06c0 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] [instance: 013da7c4-ac69-4554-827b-d68e9bac0e54] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:08:21.815654 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-93ca31af-f4b4-4f2f-a6e8-dabdb03d06c0 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:08:21.816130 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-93ca31af-f4b4-4f2f-a6e8-dabdb03d06c0 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:08:21.816899 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-93ca31af-f4b4-4f2f-a6e8-dabdb03d06c0 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:08:21.817344 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-93ca31af-f4b4-4f2f-a6e8-dabdb03d06c0 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:08:21.879211 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-93ca31af-f4b4-4f2f-a6e8-dabdb03d06c0 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6be4749041442787482b6e06b6c40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73f3238988e4e1293ad782712a1da53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 16:08:21.887166 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-93ca31af-f4b4-4f2f-a6e8-dabdb03d06c0 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] 10.222.0.64 "GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54" status: 200 len: 1350 microversion: 2.1 time: 0.083022 Oct 27 16:08:21.888026 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 836/1739] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 16:08:21 2021] GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54 => generated 1350 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 16:08:22.904569 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-c4338569-f396-4020-95aa-f9e3f8acc063 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:08:22.905162 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-c4338569-f396-4020-95aa-f9e3f8acc063 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] [instance: 013da7c4-ac69-4554-827b-d68e9bac0e54] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:08:22.911216 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-c4338569-f396-4020-95aa-f9e3f8acc063 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:08:22.911655 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-c4338569-f396-4020-95aa-f9e3f8acc063 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:08:22.912473 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-c4338569-f396-4020-95aa-f9e3f8acc063 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:08:22.912901 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-c4338569-f396-4020-95aa-f9e3f8acc063 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:08:22.974144 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-c4338569-f396-4020-95aa-f9e3f8acc063 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6be4749041442787482b6e06b6c40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73f3238988e4e1293ad782712a1da53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 16:08:22.982757 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-c4338569-f396-4020-95aa-f9e3f8acc063 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] 10.222.0.64 "GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54" status: 200 len: 1350 microversion: 2.1 time: 0.081408 Oct 27 16:08:22.983512 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 904/1740] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 16:08:22 2021] GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54 => generated 1350 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 16:08:23.999296 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-2b4a975d-cd27-4121-b7bd-fb69b305021b tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:08:23.999934 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-2b4a975d-cd27-4121-b7bd-fb69b305021b tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] [instance: 013da7c4-ac69-4554-827b-d68e9bac0e54] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:08:24.006357 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-2b4a975d-cd27-4121-b7bd-fb69b305021b tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:08:24.006805 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-2b4a975d-cd27-4121-b7bd-fb69b305021b tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:08:24.007752 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-2b4a975d-cd27-4121-b7bd-fb69b305021b tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:08:24.008673 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-2b4a975d-cd27-4121-b7bd-fb69b305021b tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:08:24.069879 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-2b4a975d-cd27-4121-b7bd-fb69b305021b tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6be4749041442787482b6e06b6c40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73f3238988e4e1293ad782712a1da53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 16:08:24.078443 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-2b4a975d-cd27-4121-b7bd-fb69b305021b tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] 10.222.0.64 "GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54" status: 200 len: 1350 microversion: 2.1 time: 0.082792 Oct 27 16:08:24.079006 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 837/1741] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 16:08:23 2021] GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54 => generated 1350 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 16:08:25.095699 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-aa32e386-0fcc-4a32-8b4b-5f5611ec8727 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:08:25.096330 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-aa32e386-0fcc-4a32-8b4b-5f5611ec8727 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] [instance: 013da7c4-ac69-4554-827b-d68e9bac0e54] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:08:25.102461 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-aa32e386-0fcc-4a32-8b4b-5f5611ec8727 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:08:25.102908 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-aa32e386-0fcc-4a32-8b4b-5f5611ec8727 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:08:25.103666 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-aa32e386-0fcc-4a32-8b4b-5f5611ec8727 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:08:25.104118 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-aa32e386-0fcc-4a32-8b4b-5f5611ec8727 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:08:25.163932 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-aa32e386-0fcc-4a32-8b4b-5f5611ec8727 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6be4749041442787482b6e06b6c40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73f3238988e4e1293ad782712a1da53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 16:08:25.171783 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-aa32e386-0fcc-4a32-8b4b-5f5611ec8727 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] 10.222.0.64 "GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54" status: 200 len: 1350 microversion: 2.1 time: 0.080171 Oct 27 16:08:25.172325 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 905/1742] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 16:08:25 2021] GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54 => generated 1350 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 16:08:26.188755 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-24c9015a-5b96-42aa-8176-6a78bbb8e1e7 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:08:26.189405 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-24c9015a-5b96-42aa-8176-6a78bbb8e1e7 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] [instance: 013da7c4-ac69-4554-827b-d68e9bac0e54] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:08:26.195915 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-24c9015a-5b96-42aa-8176-6a78bbb8e1e7 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:08:26.196364 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-24c9015a-5b96-42aa-8176-6a78bbb8e1e7 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:08:26.197147 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-24c9015a-5b96-42aa-8176-6a78bbb8e1e7 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:08:26.197581 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-24c9015a-5b96-42aa-8176-6a78bbb8e1e7 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:08:26.259301 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-24c9015a-5b96-42aa-8176-6a78bbb8e1e7 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6be4749041442787482b6e06b6c40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73f3238988e4e1293ad782712a1da53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 16:08:26.268205 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-24c9015a-5b96-42aa-8176-6a78bbb8e1e7 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] 10.222.0.64 "GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54" status: 200 len: 1350 microversion: 2.1 time: 0.083105 Oct 27 16:08:26.268776 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 838/1743] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 16:08:26 2021] GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54 => generated 1350 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 16:08:27.285085 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-55624e5d-a362-421f-bcef-162e9254ebad tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:08:27.285702 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-55624e5d-a362-421f-bcef-162e9254ebad tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] [instance: 013da7c4-ac69-4554-827b-d68e9bac0e54] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:08:27.291970 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-55624e5d-a362-421f-bcef-162e9254ebad tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:08:27.292413 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-55624e5d-a362-421f-bcef-162e9254ebad tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:08:27.293171 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-55624e5d-a362-421f-bcef-162e9254ebad tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:08:27.293603 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-55624e5d-a362-421f-bcef-162e9254ebad tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:08:27.357388 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-55624e5d-a362-421f-bcef-162e9254ebad tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6be4749041442787482b6e06b6c40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73f3238988e4e1293ad782712a1da53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 16:08:27.365288 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-55624e5d-a362-421f-bcef-162e9254ebad tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] 10.222.0.64 "GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54" status: 200 len: 1350 microversion: 2.1 time: 0.083961 Oct 27 16:08:27.365862 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 906/1744] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 16:08:27 2021] GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54 => generated 1350 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 16:08:28.383251 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-513befd9-0b45-4e04-98ae-bfb616323b6c tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:08:28.384032 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-513befd9-0b45-4e04-98ae-bfb616323b6c tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] [instance: 013da7c4-ac69-4554-827b-d68e9bac0e54] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:08:28.390883 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-513befd9-0b45-4e04-98ae-bfb616323b6c tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:08:28.391318 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-513befd9-0b45-4e04-98ae-bfb616323b6c tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:08:28.392118 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-513befd9-0b45-4e04-98ae-bfb616323b6c tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:08:28.392542 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-513befd9-0b45-4e04-98ae-bfb616323b6c tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:08:28.456763 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-513befd9-0b45-4e04-98ae-bfb616323b6c tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6be4749041442787482b6e06b6c40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73f3238988e4e1293ad782712a1da53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 16:08:28.466434 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-513befd9-0b45-4e04-98ae-bfb616323b6c tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] 10.222.0.64 "GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54" status: 200 len: 1350 microversion: 2.1 time: 0.086828 Oct 27 16:08:28.467018 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 839/1745] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 16:08:28 2021] GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54 => generated 1350 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 16:08:29.482336 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-5dabd2f4-55fa-44ac-82d9-10c02c3fc2bf tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:08:29.482937 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-5dabd2f4-55fa-44ac-82d9-10c02c3fc2bf tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] [instance: 013da7c4-ac69-4554-827b-d68e9bac0e54] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:08:29.489835 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-5dabd2f4-55fa-44ac-82d9-10c02c3fc2bf tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:08:29.490200 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-5dabd2f4-55fa-44ac-82d9-10c02c3fc2bf tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:08:29.490971 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-5dabd2f4-55fa-44ac-82d9-10c02c3fc2bf tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:08:29.491898 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-5dabd2f4-55fa-44ac-82d9-10c02c3fc2bf tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:08:29.551763 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-5dabd2f4-55fa-44ac-82d9-10c02c3fc2bf tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6be4749041442787482b6e06b6c40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73f3238988e4e1293ad782712a1da53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 16:08:29.559569 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-5dabd2f4-55fa-44ac-82d9-10c02c3fc2bf tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] 10.222.0.64 "GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54" status: 200 len: 1350 microversion: 2.1 time: 0.080915 Oct 27 16:08:29.560693 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 907/1746] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 16:08:29 2021] GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54 => generated 1350 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 16:08:30.577271 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-9d87d87c-3ef7-4bf4-9126-0d442e73f9a7 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:08:30.577833 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-9d87d87c-3ef7-4bf4-9126-0d442e73f9a7 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] [instance: 013da7c4-ac69-4554-827b-d68e9bac0e54] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:08:30.584491 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-9d87d87c-3ef7-4bf4-9126-0d442e73f9a7 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:08:30.584937 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-9d87d87c-3ef7-4bf4-9126-0d442e73f9a7 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:08:30.585707 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-9d87d87c-3ef7-4bf4-9126-0d442e73f9a7 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:08:30.586137 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-9d87d87c-3ef7-4bf4-9126-0d442e73f9a7 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:08:30.646989 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-9d87d87c-3ef7-4bf4-9126-0d442e73f9a7 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6be4749041442787482b6e06b6c40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73f3238988e4e1293ad782712a1da53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 16:08:30.656026 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-9d87d87c-3ef7-4bf4-9126-0d442e73f9a7 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] 10.222.0.64 "GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54" status: 200 len: 1350 microversion: 2.1 time: 0.082452 Oct 27 16:08:30.656645 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 840/1747] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 16:08:30 2021] GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54 => generated 1350 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 16:08:31.674599 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-8738a876-7e9a-4c7c-be85-00e38e6836f7 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:08:31.675184 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-8738a876-7e9a-4c7c-be85-00e38e6836f7 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] [instance: 013da7c4-ac69-4554-827b-d68e9bac0e54] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:08:31.681341 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-8738a876-7e9a-4c7c-be85-00e38e6836f7 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:08:31.681812 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-8738a876-7e9a-4c7c-be85-00e38e6836f7 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:08:31.682541 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-8738a876-7e9a-4c7c-be85-00e38e6836f7 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:08:31.682966 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-8738a876-7e9a-4c7c-be85-00e38e6836f7 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:08:31.744866 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-8738a876-7e9a-4c7c-be85-00e38e6836f7 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6be4749041442787482b6e06b6c40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73f3238988e4e1293ad782712a1da53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 16:08:31.753454 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-8738a876-7e9a-4c7c-be85-00e38e6836f7 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] 10.222.0.64 "GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54" status: 200 len: 1350 microversion: 2.1 time: 0.082674 Oct 27 16:08:31.754019 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 908/1748] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 16:08:31 2021] GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54 => generated 1350 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 16:08:32.770581 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-85d756e2-b7a7-4144-98d7-c2e32190de03 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:08:32.771185 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-85d756e2-b7a7-4144-98d7-c2e32190de03 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] [instance: 013da7c4-ac69-4554-827b-d68e9bac0e54] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:08:32.777623 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-85d756e2-b7a7-4144-98d7-c2e32190de03 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:08:32.778075 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-85d756e2-b7a7-4144-98d7-c2e32190de03 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:08:32.779506 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-85d756e2-b7a7-4144-98d7-c2e32190de03 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:08:32.779969 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-85d756e2-b7a7-4144-98d7-c2e32190de03 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:08:32.843620 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-85d756e2-b7a7-4144-98d7-c2e32190de03 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6be4749041442787482b6e06b6c40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73f3238988e4e1293ad782712a1da53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 16:08:32.851686 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-85d756e2-b7a7-4144-98d7-c2e32190de03 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] 10.222.0.64 "GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54" status: 200 len: 1350 microversion: 2.1 time: 0.084934 Oct 27 16:08:32.852297 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 841/1749] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 16:08:32 2021] GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54 => generated 1350 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 16:08:33.868594 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-ca415e5b-d16f-4b78-8466-d0846cf244cd tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:08:33.869245 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-ca415e5b-d16f-4b78-8466-d0846cf244cd tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] [instance: 013da7c4-ac69-4554-827b-d68e9bac0e54] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:08:33.876619 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-ca415e5b-d16f-4b78-8466-d0846cf244cd tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:08:33.877063 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-ca415e5b-d16f-4b78-8466-d0846cf244cd tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:08:33.877932 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-ca415e5b-d16f-4b78-8466-d0846cf244cd tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:08:33.878512 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-ca415e5b-d16f-4b78-8466-d0846cf244cd tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:08:33.946514 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-ca415e5b-d16f-4b78-8466-d0846cf244cd tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6be4749041442787482b6e06b6c40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73f3238988e4e1293ad782712a1da53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 16:08:33.954860 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-ca415e5b-d16f-4b78-8466-d0846cf244cd tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] 10.222.0.64 "GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54" status: 200 len: 1350 microversion: 2.1 time: 0.089854 Oct 27 16:08:33.955455 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 909/1750] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 16:08:33 2021] GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54 => generated 1350 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 16:08:34.972819 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-e27fd012-7878-42e0-9d53-510a590a2017 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:08:34.973542 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-e27fd012-7878-42e0-9d53-510a590a2017 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] [instance: 013da7c4-ac69-4554-827b-d68e9bac0e54] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:08:34.980620 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-e27fd012-7878-42e0-9d53-510a590a2017 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:08:34.981066 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-e27fd012-7878-42e0-9d53-510a590a2017 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:08:34.982388 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-e27fd012-7878-42e0-9d53-510a590a2017 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:08:34.982982 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-e27fd012-7878-42e0-9d53-510a590a2017 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:08:35.043151 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-e27fd012-7878-42e0-9d53-510a590a2017 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6be4749041442787482b6e06b6c40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73f3238988e4e1293ad782712a1da53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 16:08:35.051611 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-e27fd012-7878-42e0-9d53-510a590a2017 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] 10.222.0.64 "GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54" status: 200 len: 1350 microversion: 2.1 time: 0.082723 Oct 27 16:08:35.052255 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 842/1751] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 16:08:34 2021] GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54 => generated 1350 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 16:08:36.069223 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-144a11b1-acc5-4e4f-bc49-43336438433a tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:08:36.069851 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-144a11b1-acc5-4e4f-bc49-43336438433a tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] [instance: 013da7c4-ac69-4554-827b-d68e9bac0e54] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:08:36.077370 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-144a11b1-acc5-4e4f-bc49-43336438433a tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:08:36.077811 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-144a11b1-acc5-4e4f-bc49-43336438433a tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:08:36.078580 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-144a11b1-acc5-4e4f-bc49-43336438433a tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:08:36.079001 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-144a11b1-acc5-4e4f-bc49-43336438433a tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:08:36.141302 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-144a11b1-acc5-4e4f-bc49-43336438433a tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6be4749041442787482b6e06b6c40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73f3238988e4e1293ad782712a1da53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 16:08:36.149153 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-144a11b1-acc5-4e4f-bc49-43336438433a tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] 10.222.0.64 "GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54" status: 200 len: 1350 microversion: 2.1 time: 0.083653 Oct 27 16:08:36.149711 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 910/1752] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 16:08:36 2021] GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54 => generated 1350 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 16:08:37.166120 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-23fe1dac-a3b0-4fba-89e1-fb6abb21f8ac tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:08:37.166734 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-23fe1dac-a3b0-4fba-89e1-fb6abb21f8ac tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] [instance: 013da7c4-ac69-4554-827b-d68e9bac0e54] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:08:37.174301 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-23fe1dac-a3b0-4fba-89e1-fb6abb21f8ac tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:08:37.174301 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-23fe1dac-a3b0-4fba-89e1-fb6abb21f8ac tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:08:37.174726 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-23fe1dac-a3b0-4fba-89e1-fb6abb21f8ac tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:08:37.175147 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-23fe1dac-a3b0-4fba-89e1-fb6abb21f8ac tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:08:37.235873 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-23fe1dac-a3b0-4fba-89e1-fb6abb21f8ac tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6be4749041442787482b6e06b6c40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73f3238988e4e1293ad782712a1da53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 16:08:37.243623 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-23fe1dac-a3b0-4fba-89e1-fb6abb21f8ac tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] 10.222.0.64 "GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54" status: 200 len: 1350 microversion: 2.1 time: 0.081284 Oct 27 16:08:37.244221 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 843/1753] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 16:08:37 2021] GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54 => generated 1350 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 16:08:38.260782 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-4b0cad0b-483f-4b5c-989e-69500e8a7d73 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:08:38.261414 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-4b0cad0b-483f-4b5c-989e-69500e8a7d73 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] [instance: 013da7c4-ac69-4554-827b-d68e9bac0e54] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:08:38.268259 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-4b0cad0b-483f-4b5c-989e-69500e8a7d73 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:08:38.268762 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-4b0cad0b-483f-4b5c-989e-69500e8a7d73 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:08:38.269573 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-4b0cad0b-483f-4b5c-989e-69500e8a7d73 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:08:38.270007 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-4b0cad0b-483f-4b5c-989e-69500e8a7d73 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:08:38.330925 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-4b0cad0b-483f-4b5c-989e-69500e8a7d73 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6be4749041442787482b6e06b6c40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73f3238988e4e1293ad782712a1da53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 16:08:38.339012 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-4b0cad0b-483f-4b5c-989e-69500e8a7d73 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] 10.222.0.64 "GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54" status: 200 len: 1350 microversion: 2.1 time: 0.082191 Oct 27 16:08:38.344072 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 911/1754] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 16:08:38 2021] GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54 => generated 1350 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 16:08:39.357422 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-afee831c-a4bb-44d2-826c-672bdc43149e tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:08:39.358405 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-afee831c-a4bb-44d2-826c-672bdc43149e tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] [instance: 013da7c4-ac69-4554-827b-d68e9bac0e54] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:08:39.364804 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-afee831c-a4bb-44d2-826c-672bdc43149e tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:08:39.365245 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-afee831c-a4bb-44d2-826c-672bdc43149e tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:08:39.366023 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-afee831c-a4bb-44d2-826c-672bdc43149e tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:08:39.366450 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-afee831c-a4bb-44d2-826c-672bdc43149e tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:08:39.430817 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-afee831c-a4bb-44d2-826c-672bdc43149e tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6be4749041442787482b6e06b6c40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73f3238988e4e1293ad782712a1da53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 16:08:39.440228 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-afee831c-a4bb-44d2-826c-672bdc43149e tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] 10.222.0.64 "GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54" status: 200 len: 1350 microversion: 2.1 time: 0.087835 Oct 27 16:08:39.440801 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 844/1755] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 16:08:39 2021] GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54 => generated 1350 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 16:08:40.458761 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-dd23cb79-d0ba-42b6-a347-ac0d68d79289 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:08:40.459763 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-dd23cb79-d0ba-42b6-a347-ac0d68d79289 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] [instance: 013da7c4-ac69-4554-827b-d68e9bac0e54] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:08:40.467263 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-dd23cb79-d0ba-42b6-a347-ac0d68d79289 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:08:40.467710 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-dd23cb79-d0ba-42b6-a347-ac0d68d79289 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:08:40.468512 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-dd23cb79-d0ba-42b6-a347-ac0d68d79289 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:08:40.468941 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-dd23cb79-d0ba-42b6-a347-ac0d68d79289 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:08:40.532572 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-dd23cb79-d0ba-42b6-a347-ac0d68d79289 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6be4749041442787482b6e06b6c40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73f3238988e4e1293ad782712a1da53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 16:08:40.541391 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-dd23cb79-d0ba-42b6-a347-ac0d68d79289 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] 10.222.0.64 "GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54" status: 200 len: 1350 microversion: 2.1 time: 0.087543 Oct 27 16:08:40.541967 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 912/1756] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 16:08:40 2021] GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54 => generated 1350 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 16:08:41.559714 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-928f0dc2-028c-407f-acd2-6600d3ced6a9 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:08:41.560360 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-928f0dc2-028c-407f-acd2-6600d3ced6a9 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] [instance: 013da7c4-ac69-4554-827b-d68e9bac0e54] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:08:41.566797 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-928f0dc2-028c-407f-acd2-6600d3ced6a9 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:08:41.567232 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-928f0dc2-028c-407f-acd2-6600d3ced6a9 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:08:41.568034 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-928f0dc2-028c-407f-acd2-6600d3ced6a9 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:08:41.568462 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-928f0dc2-028c-407f-acd2-6600d3ced6a9 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:08:41.631837 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-928f0dc2-028c-407f-acd2-6600d3ced6a9 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6be4749041442787482b6e06b6c40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73f3238988e4e1293ad782712a1da53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 16:08:41.639955 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-928f0dc2-028c-407f-acd2-6600d3ced6a9 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] 10.222.0.64 "GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54" status: 200 len: 1350 microversion: 2.1 time: 0.084042 Oct 27 16:08:41.640530 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 845/1757] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 16:08:41 2021] GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54 => generated 1350 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 16:08:42.659062 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-7571e45a-2f6f-4ce8-a246-a7abfe019eb7 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:08:42.660351 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-7571e45a-2f6f-4ce8-a246-a7abfe019eb7 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] [instance: 013da7c4-ac69-4554-827b-d68e9bac0e54] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:08:42.666759 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-7571e45a-2f6f-4ce8-a246-a7abfe019eb7 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:08:42.667221 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-7571e45a-2f6f-4ce8-a246-a7abfe019eb7 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:08:42.668026 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-7571e45a-2f6f-4ce8-a246-a7abfe019eb7 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:08:42.668456 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-7571e45a-2f6f-4ce8-a246-a7abfe019eb7 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:08:42.736198 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-7571e45a-2f6f-4ce8-a246-a7abfe019eb7 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6be4749041442787482b6e06b6c40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73f3238988e4e1293ad782712a1da53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 16:08:42.747768 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-7571e45a-2f6f-4ce8-a246-a7abfe019eb7 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] 10.222.0.64 "GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54" status: 200 len: 1350 microversion: 2.1 time: 0.093375 Oct 27 16:08:42.748461 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 913/1758] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 16:08:42 2021] GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54 => generated 1350 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 16:08:43.768255 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-83ce2b61-0f84-4641-8371-19e415428035 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:08:43.769116 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-83ce2b61-0f84-4641-8371-19e415428035 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] [instance: 013da7c4-ac69-4554-827b-d68e9bac0e54] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:08:43.777302 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-83ce2b61-0f84-4641-8371-19e415428035 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:08:43.777827 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-83ce2b61-0f84-4641-8371-19e415428035 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:08:43.779807 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-83ce2b61-0f84-4641-8371-19e415428035 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:08:43.780335 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-83ce2b61-0f84-4641-8371-19e415428035 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:08:43.848872 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-83ce2b61-0f84-4641-8371-19e415428035 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6be4749041442787482b6e06b6c40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73f3238988e4e1293ad782712a1da53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 16:08:43.859903 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-83ce2b61-0f84-4641-8371-19e415428035 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] 10.222.0.64 "GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54" status: 200 len: 1350 microversion: 2.1 time: 0.096598 Oct 27 16:08:43.860490 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 846/1759] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 16:08:43 2021] GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54 => generated 1350 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 16:08:44.876960 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-e63f7874-4b49-4401-b112-f17223c29946 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:08:44.877583 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-e63f7874-4b49-4401-b112-f17223c29946 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] [instance: 013da7c4-ac69-4554-827b-d68e9bac0e54] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:08:44.884605 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-e63f7874-4b49-4401-b112-f17223c29946 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:08:44.885052 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-e63f7874-4b49-4401-b112-f17223c29946 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:08:44.885846 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-e63f7874-4b49-4401-b112-f17223c29946 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:08:44.886281 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-e63f7874-4b49-4401-b112-f17223c29946 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:08:44.957532 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-e63f7874-4b49-4401-b112-f17223c29946 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6be4749041442787482b6e06b6c40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73f3238988e4e1293ad782712a1da53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 16:08:44.966768 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-e63f7874-4b49-4401-b112-f17223c29946 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] 10.222.0.64 "GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54" status: 200 len: 1350 microversion: 2.1 time: 0.093629 Oct 27 16:08:44.967344 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 914/1760] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 16:08:44 2021] GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54 => generated 1350 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 16:08:45.984309 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-22c24f8a-e238-4303-a39d-995920e613d7 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:08:45.984945 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-22c24f8a-e238-4303-a39d-995920e613d7 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] [instance: 013da7c4-ac69-4554-827b-d68e9bac0e54] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:08:45.992047 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-22c24f8a-e238-4303-a39d-995920e613d7 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:08:45.992496 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-22c24f8a-e238-4303-a39d-995920e613d7 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:08:45.993347 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-22c24f8a-e238-4303-a39d-995920e613d7 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:08:45.993789 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-22c24f8a-e238-4303-a39d-995920e613d7 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:08:46.057796 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-22c24f8a-e238-4303-a39d-995920e613d7 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6be4749041442787482b6e06b6c40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73f3238988e4e1293ad782712a1da53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 16:08:46.066562 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-22c24f8a-e238-4303-a39d-995920e613d7 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] 10.222.0.64 "GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54" status: 200 len: 1350 microversion: 2.1 time: 0.086451 Oct 27 16:08:46.067215 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 847/1761] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 16:08:45 2021] GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54 => generated 1350 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 16:08:47.084322 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-2924d284-47a7-4f47-bec5-a4b96c24c9a0 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:08:47.084956 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-2924d284-47a7-4f47-bec5-a4b96c24c9a0 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] [instance: 013da7c4-ac69-4554-827b-d68e9bac0e54] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:08:47.091983 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-2924d284-47a7-4f47-bec5-a4b96c24c9a0 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:08:47.092494 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-2924d284-47a7-4f47-bec5-a4b96c24c9a0 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:08:47.093271 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-2924d284-47a7-4f47-bec5-a4b96c24c9a0 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:08:47.093766 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-2924d284-47a7-4f47-bec5-a4b96c24c9a0 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:08:47.158964 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-2924d284-47a7-4f47-bec5-a4b96c24c9a0 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6be4749041442787482b6e06b6c40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73f3238988e4e1293ad782712a1da53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 16:08:47.167113 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-2924d284-47a7-4f47-bec5-a4b96c24c9a0 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] 10.222.0.64 "GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54" status: 200 len: 1350 microversion: 2.1 time: 0.086957 Oct 27 16:08:47.167769 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 915/1762] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 16:08:47 2021] GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54 => generated 1350 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 16:08:48.193448 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-c790c5e3-bccd-467e-9bde-187386cac5d1 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:08:48.194118 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-c790c5e3-bccd-467e-9bde-187386cac5d1 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] [instance: 013da7c4-ac69-4554-827b-d68e9bac0e54] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:08:48.201019 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-c790c5e3-bccd-467e-9bde-187386cac5d1 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:08:48.201461 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-c790c5e3-bccd-467e-9bde-187386cac5d1 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:08:48.202247 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-c790c5e3-bccd-467e-9bde-187386cac5d1 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:08:48.203496 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-c790c5e3-bccd-467e-9bde-187386cac5d1 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:08:48.269235 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-c790c5e3-bccd-467e-9bde-187386cac5d1 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6be4749041442787482b6e06b6c40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73f3238988e4e1293ad782712a1da53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 16:08:48.277827 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-c790c5e3-bccd-467e-9bde-187386cac5d1 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] 10.222.0.64 "GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54" status: 200 len: 1350 microversion: 2.1 time: 0.087970 Oct 27 16:08:48.279049 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 848/1763] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 16:08:48 2021] GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54 => generated 1350 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 16:08:49.296399 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-8aa6ca16-8b9a-408c-997f-d8dc0c077911 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:08:49.297014 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-8aa6ca16-8b9a-408c-997f-d8dc0c077911 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] [instance: 013da7c4-ac69-4554-827b-d68e9bac0e54] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:08:49.304472 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-8aa6ca16-8b9a-408c-997f-d8dc0c077911 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:08:49.304913 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-8aa6ca16-8b9a-408c-997f-d8dc0c077911 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:08:49.305695 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-8aa6ca16-8b9a-408c-997f-d8dc0c077911 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:08:49.306124 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-8aa6ca16-8b9a-408c-997f-d8dc0c077911 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:08:49.367765 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-8aa6ca16-8b9a-408c-997f-d8dc0c077911 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6be4749041442787482b6e06b6c40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73f3238988e4e1293ad782712a1da53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 16:08:49.376361 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-8aa6ca16-8b9a-408c-997f-d8dc0c077911 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] 10.222.0.64 "GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54" status: 200 len: 1350 microversion: 2.1 time: 0.083730 Oct 27 16:08:49.377515 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 916/1764] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 16:08:49 2021] GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54 => generated 1350 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 16:08:50.395705 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-452636fa-3aaf-4a03-abe4-89253fcf5608 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:08:50.396415 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-452636fa-3aaf-4a03-abe4-89253fcf5608 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] [instance: 013da7c4-ac69-4554-827b-d68e9bac0e54] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:08:50.402258 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-452636fa-3aaf-4a03-abe4-89253fcf5608 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:08:50.402694 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-452636fa-3aaf-4a03-abe4-89253fcf5608 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:08:50.404110 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-452636fa-3aaf-4a03-abe4-89253fcf5608 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:08:50.404544 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-452636fa-3aaf-4a03-abe4-89253fcf5608 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:08:50.463875 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-452636fa-3aaf-4a03-abe4-89253fcf5608 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6be4749041442787482b6e06b6c40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73f3238988e4e1293ad782712a1da53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 16:08:50.472161 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-452636fa-3aaf-4a03-abe4-89253fcf5608 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] 10.222.0.64 "GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54" status: 200 len: 1350 microversion: 2.1 time: 0.080382 Oct 27 16:08:50.472661 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 849/1765] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 16:08:50 2021] GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54 => generated 1350 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 16:08:51.490212 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-1f75ca43-ac01-44b3-8c7c-f2ddd22ab73b tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:08:51.490880 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-1f75ca43-ac01-44b3-8c7c-f2ddd22ab73b tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] [instance: 013da7c4-ac69-4554-827b-d68e9bac0e54] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:08:51.498601 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-1f75ca43-ac01-44b3-8c7c-f2ddd22ab73b tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:08:51.499106 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-1f75ca43-ac01-44b3-8c7c-f2ddd22ab73b tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:08:51.500107 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-1f75ca43-ac01-44b3-8c7c-f2ddd22ab73b tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:08:51.500555 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-1f75ca43-ac01-44b3-8c7c-f2ddd22ab73b tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:08:51.569479 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-1f75ca43-ac01-44b3-8c7c-f2ddd22ab73b tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6be4749041442787482b6e06b6c40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73f3238988e4e1293ad782712a1da53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 16:08:51.577842 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-1f75ca43-ac01-44b3-8c7c-f2ddd22ab73b tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] 10.222.0.64 "GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54" status: 200 len: 1350 microversion: 2.1 time: 0.091393 Oct 27 16:08:51.578415 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 917/1766] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 16:08:51 2021] GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54 => generated 1350 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 16:08:52.595658 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-318cf76d-1f26-478d-a08a-3da4f14045d2 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:08:52.596271 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-318cf76d-1f26-478d-a08a-3da4f14045d2 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] [instance: 013da7c4-ac69-4554-827b-d68e9bac0e54] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:08:52.602769 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-318cf76d-1f26-478d-a08a-3da4f14045d2 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:08:52.603218 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-318cf76d-1f26-478d-a08a-3da4f14045d2 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:08:52.604027 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-318cf76d-1f26-478d-a08a-3da4f14045d2 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:08:52.604489 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-318cf76d-1f26-478d-a08a-3da4f14045d2 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:08:52.665418 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-318cf76d-1f26-478d-a08a-3da4f14045d2 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6be4749041442787482b6e06b6c40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73f3238988e4e1293ad782712a1da53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 16:08:52.673764 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-318cf76d-1f26-478d-a08a-3da4f14045d2 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] 10.222.0.64 "GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54" status: 200 len: 1350 microversion: 2.1 time: 0.082034 Oct 27 16:08:52.674406 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 850/1767] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 16:08:52 2021] GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54 => generated 1350 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 16:08:53.690682 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-c803dda5-4651-4ae9-b6f7-1f850da643ca tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:08:53.691287 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-c803dda5-4651-4ae9-b6f7-1f850da643ca tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] [instance: 013da7c4-ac69-4554-827b-d68e9bac0e54] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:08:53.697748 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-c803dda5-4651-4ae9-b6f7-1f850da643ca tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:08:53.698227 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-c803dda5-4651-4ae9-b6f7-1f850da643ca tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:08:53.699038 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-c803dda5-4651-4ae9-b6f7-1f850da643ca tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:08:53.699475 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-c803dda5-4651-4ae9-b6f7-1f850da643ca tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:08:53.764962 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-c803dda5-4651-4ae9-b6f7-1f850da643ca tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6be4749041442787482b6e06b6c40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73f3238988e4e1293ad782712a1da53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 16:08:53.774220 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-c803dda5-4651-4ae9-b6f7-1f850da643ca tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] 10.222.0.64 "GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54" status: 200 len: 1350 microversion: 2.1 time: 0.087109 Oct 27 16:08:53.774895 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 918/1768] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 16:08:53 2021] GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54 => generated 1350 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 16:08:54.794035 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-7457bf6b-7480-44ee-a1b3-bf1a77e0814e tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:08:54.794789 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-7457bf6b-7480-44ee-a1b3-bf1a77e0814e tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] [instance: 013da7c4-ac69-4554-827b-d68e9bac0e54] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:08:54.801892 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-7457bf6b-7480-44ee-a1b3-bf1a77e0814e tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:08:54.802378 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-7457bf6b-7480-44ee-a1b3-bf1a77e0814e tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:08:54.803261 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-7457bf6b-7480-44ee-a1b3-bf1a77e0814e tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:08:54.803775 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-7457bf6b-7480-44ee-a1b3-bf1a77e0814e tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:08:54.865842 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-7457bf6b-7480-44ee-a1b3-bf1a77e0814e tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6be4749041442787482b6e06b6c40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73f3238988e4e1293ad782712a1da53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 16:08:54.874452 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-7457bf6b-7480-44ee-a1b3-bf1a77e0814e tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] 10.222.0.64 "GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54" status: 200 len: 1350 microversion: 2.1 time: 0.084483 Oct 27 16:08:54.874998 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 851/1769] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 16:08:54 2021] GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54 => generated 1350 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 16:08:55.891433 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-89b0bff3-4124-4142-b9fd-97b9b00b5b00 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:08:55.892033 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-89b0bff3-4124-4142-b9fd-97b9b00b5b00 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] [instance: 013da7c4-ac69-4554-827b-d68e9bac0e54] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:08:55.898314 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-89b0bff3-4124-4142-b9fd-97b9b00b5b00 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:08:55.898765 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-89b0bff3-4124-4142-b9fd-97b9b00b5b00 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:08:55.899539 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-89b0bff3-4124-4142-b9fd-97b9b00b5b00 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:08:55.900006 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-89b0bff3-4124-4142-b9fd-97b9b00b5b00 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:08:55.960035 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-89b0bff3-4124-4142-b9fd-97b9b00b5b00 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6be4749041442787482b6e06b6c40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73f3238988e4e1293ad782712a1da53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 16:08:55.968805 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-89b0bff3-4124-4142-b9fd-97b9b00b5b00 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] 10.222.0.64 "GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54" status: 200 len: 1350 microversion: 2.1 time: 0.081277 Oct 27 16:08:55.969385 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 919/1770] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 16:08:55 2021] GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54 => generated 1350 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 16:08:56.985684 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-a783b1ec-a9a3-40a0-96d8-62bf4a99d3d8 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:08:56.986274 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-a783b1ec-a9a3-40a0-96d8-62bf4a99d3d8 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] [instance: 013da7c4-ac69-4554-827b-d68e9bac0e54] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:08:56.992478 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-a783b1ec-a9a3-40a0-96d8-62bf4a99d3d8 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:08:56.992915 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-a783b1ec-a9a3-40a0-96d8-62bf4a99d3d8 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:08:56.993677 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-a783b1ec-a9a3-40a0-96d8-62bf4a99d3d8 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:08:56.994126 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-a783b1ec-a9a3-40a0-96d8-62bf4a99d3d8 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:08:57.060176 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-a783b1ec-a9a3-40a0-96d8-62bf4a99d3d8 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6be4749041442787482b6e06b6c40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73f3238988e4e1293ad782712a1da53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 16:08:57.068338 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-a783b1ec-a9a3-40a0-96d8-62bf4a99d3d8 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] 10.222.0.64 "GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54" status: 200 len: 1350 microversion: 2.1 time: 0.087308 Oct 27 16:08:57.068912 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 852/1771] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 16:08:56 2021] GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54 => generated 1350 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 16:08:58.085435 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-28da4aba-192b-47ac-871e-e65e687e914c tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:08:58.086046 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-28da4aba-192b-47ac-871e-e65e687e914c tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] [instance: 013da7c4-ac69-4554-827b-d68e9bac0e54] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:08:58.092397 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-28da4aba-192b-47ac-871e-e65e687e914c tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:08:58.092838 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-28da4aba-192b-47ac-871e-e65e687e914c tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:08:58.093595 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-28da4aba-192b-47ac-871e-e65e687e914c tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:08:58.094022 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-28da4aba-192b-47ac-871e-e65e687e914c tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:08:58.154121 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-28da4aba-192b-47ac-871e-e65e687e914c tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6be4749041442787482b6e06b6c40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73f3238988e4e1293ad782712a1da53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 16:08:58.161884 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-28da4aba-192b-47ac-871e-e65e687e914c tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] 10.222.0.64 "GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54" status: 200 len: 1350 microversion: 2.1 time: 0.080975 Oct 27 16:08:58.162453 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 920/1772] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 16:08:58 2021] GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54 => generated 1350 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 16:08:59.178736 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-6f19b891-0f9d-490f-8810-d547413a6f7b tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:08:59.179341 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-6f19b891-0f9d-490f-8810-d547413a6f7b tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] [instance: 013da7c4-ac69-4554-827b-d68e9bac0e54] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:08:59.185675 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-6f19b891-0f9d-490f-8810-d547413a6f7b tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:08:59.186105 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-6f19b891-0f9d-490f-8810-d547413a6f7b tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:08:59.186888 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-6f19b891-0f9d-490f-8810-d547413a6f7b tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:08:59.187313 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-6f19b891-0f9d-490f-8810-d547413a6f7b tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:08:59.254686 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-6f19b891-0f9d-490f-8810-d547413a6f7b tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6be4749041442787482b6e06b6c40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73f3238988e4e1293ad782712a1da53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 16:08:59.264314 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-6f19b891-0f9d-490f-8810-d547413a6f7b tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] 10.222.0.64 "GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54" status: 200 len: 1350 microversion: 2.1 time: 0.089182 Oct 27 16:08:59.264924 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 853/1773] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 16:08:59 2021] GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54 => generated 1350 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 16:09:00.283366 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-8df0b246-d642-4f7d-92ef-4c3028fed178 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:09:00.283990 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-8df0b246-d642-4f7d-92ef-4c3028fed178 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] [instance: 013da7c4-ac69-4554-827b-d68e9bac0e54] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:09:00.290838 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-8df0b246-d642-4f7d-92ef-4c3028fed178 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:09:00.291362 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-8df0b246-d642-4f7d-92ef-4c3028fed178 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:09:00.292258 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-8df0b246-d642-4f7d-92ef-4c3028fed178 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:09:00.292764 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-8df0b246-d642-4f7d-92ef-4c3028fed178 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:09:00.364483 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-8df0b246-d642-4f7d-92ef-4c3028fed178 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6be4749041442787482b6e06b6c40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73f3238988e4e1293ad782712a1da53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 16:09:00.372701 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-8df0b246-d642-4f7d-92ef-4c3028fed178 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] 10.222.0.64 "GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54" status: 200 len: 1350 microversion: 2.1 time: 0.093466 Oct 27 16:09:00.373281 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 921/1774] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 16:09:00 2021] GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54 => generated 1350 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 16:09:01.389719 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-01571d4f-8db9-43cb-8649-cccc362d5ed5 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:09:01.390316 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-01571d4f-8db9-43cb-8649-cccc362d5ed5 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] [instance: 013da7c4-ac69-4554-827b-d68e9bac0e54] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:09:01.396596 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-01571d4f-8db9-43cb-8649-cccc362d5ed5 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:09:01.397035 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-01571d4f-8db9-43cb-8649-cccc362d5ed5 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:09:01.397786 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-01571d4f-8db9-43cb-8649-cccc362d5ed5 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:09:01.398213 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-01571d4f-8db9-43cb-8649-cccc362d5ed5 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:09:01.457932 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-01571d4f-8db9-43cb-8649-cccc362d5ed5 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6be4749041442787482b6e06b6c40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73f3238988e4e1293ad782712a1da53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 16:09:01.466747 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-01571d4f-8db9-43cb-8649-cccc362d5ed5 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] 10.222.0.64 "GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54" status: 200 len: 1350 microversion: 2.1 time: 0.080680 Oct 27 16:09:01.467461 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 854/1775] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 16:09:01 2021] GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54 => generated 1350 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 16:09:02.485245 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-4af386dd-d594-4205-8534-cc9f5e034c8c tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:09:02.485874 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-4af386dd-d594-4205-8534-cc9f5e034c8c tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] [instance: 013da7c4-ac69-4554-827b-d68e9bac0e54] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:09:02.492832 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-4af386dd-d594-4205-8534-cc9f5e034c8c tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:09:02.493274 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-4af386dd-d594-4205-8534-cc9f5e034c8c tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:09:02.494061 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-4af386dd-d594-4205-8534-cc9f5e034c8c tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:09:02.494509 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-4af386dd-d594-4205-8534-cc9f5e034c8c tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:09:02.566947 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-4af386dd-d594-4205-8534-cc9f5e034c8c tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6be4749041442787482b6e06b6c40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73f3238988e4e1293ad782712a1da53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 16:09:02.576654 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-4af386dd-d594-4205-8534-cc9f5e034c8c tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] 10.222.0.64 "GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54" status: 200 len: 1350 microversion: 2.1 time: 0.095422 Oct 27 16:09:02.577254 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 922/1776] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 16:09:02 2021] GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54 => generated 1350 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 16:09:03.595337 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-33e73cd1-5df8-4fb9-ada6-075fd177d34e tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:09:03.596297 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-33e73cd1-5df8-4fb9-ada6-075fd177d34e tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] [instance: 013da7c4-ac69-4554-827b-d68e9bac0e54] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:09:03.602697 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-33e73cd1-5df8-4fb9-ada6-075fd177d34e tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:09:03.603141 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-33e73cd1-5df8-4fb9-ada6-075fd177d34e tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:09:03.603926 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-33e73cd1-5df8-4fb9-ada6-075fd177d34e tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:09:03.604368 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-33e73cd1-5df8-4fb9-ada6-075fd177d34e tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:09:03.666889 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-33e73cd1-5df8-4fb9-ada6-075fd177d34e tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6be4749041442787482b6e06b6c40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73f3238988e4e1293ad782712a1da53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 16:09:03.677222 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-33e73cd1-5df8-4fb9-ada6-075fd177d34e tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] 10.222.0.64 "GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54" status: 200 len: 1350 microversion: 2.1 time: 0.086378 Oct 27 16:09:03.677893 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 855/1777] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 16:09:03 2021] GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54 => generated 1350 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 16:09:04.696201 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-5813cab4-ece0-4a25-818b-74dbfffb091d tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:09:04.696838 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-5813cab4-ece0-4a25-818b-74dbfffb091d tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] [instance: 013da7c4-ac69-4554-827b-d68e9bac0e54] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:09:04.704110 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-5813cab4-ece0-4a25-818b-74dbfffb091d tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:09:04.704562 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-5813cab4-ece0-4a25-818b-74dbfffb091d tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:09:04.705341 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-5813cab4-ece0-4a25-818b-74dbfffb091d tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:09:04.706426 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-5813cab4-ece0-4a25-818b-74dbfffb091d tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:09:04.778668 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-5813cab4-ece0-4a25-818b-74dbfffb091d tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6be4749041442787482b6e06b6c40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73f3238988e4e1293ad782712a1da53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 16:09:04.787121 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-5813cab4-ece0-4a25-818b-74dbfffb091d tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] 10.222.0.64 "GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54" status: 200 len: 1350 microversion: 2.1 time: 0.094895 Oct 27 16:09:04.787835 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 923/1778] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 16:09:04 2021] GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54 => generated 1350 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 16:09:05.806103 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-1d76d989-1ad1-423d-9d7e-0b6105b6c447 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:09:05.806697 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-1d76d989-1ad1-423d-9d7e-0b6105b6c447 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] [instance: 013da7c4-ac69-4554-827b-d68e9bac0e54] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:09:05.814324 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-1d76d989-1ad1-423d-9d7e-0b6105b6c447 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:09:05.814809 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-1d76d989-1ad1-423d-9d7e-0b6105b6c447 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:09:05.815726 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-1d76d989-1ad1-423d-9d7e-0b6105b6c447 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:09:05.816270 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-1d76d989-1ad1-423d-9d7e-0b6105b6c447 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:09:05.879091 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-1d76d989-1ad1-423d-9d7e-0b6105b6c447 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6be4749041442787482b6e06b6c40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73f3238988e4e1293ad782712a1da53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 16:09:05.886841 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-1d76d989-1ad1-423d-9d7e-0b6105b6c447 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] 10.222.0.64 "GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54" status: 200 len: 1350 microversion: 2.1 time: 0.084764 Oct 27 16:09:05.888484 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 856/1779] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 16:09:05 2021] GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54 => generated 1350 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 16:09:06.905445 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-fb58ad47-a88a-444b-b38b-c1d14f4a28c5 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:09:06.906046 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-fb58ad47-a88a-444b-b38b-c1d14f4a28c5 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] [instance: 013da7c4-ac69-4554-827b-d68e9bac0e54] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:09:06.911989 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-fb58ad47-a88a-444b-b38b-c1d14f4a28c5 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:09:06.912439 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-fb58ad47-a88a-444b-b38b-c1d14f4a28c5 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:09:06.913261 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-fb58ad47-a88a-444b-b38b-c1d14f4a28c5 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:09:06.913668 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-fb58ad47-a88a-444b-b38b-c1d14f4a28c5 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:09:06.978619 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-fb58ad47-a88a-444b-b38b-c1d14f4a28c5 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6be4749041442787482b6e06b6c40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73f3238988e4e1293ad782712a1da53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 16:09:06.989791 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-fb58ad47-a88a-444b-b38b-c1d14f4a28c5 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] 10.222.0.64 "GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54" status: 200 len: 1350 microversion: 2.1 time: 0.089224 Oct 27 16:09:06.990389 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 924/1780] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 16:09:06 2021] GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54 => generated 1350 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 16:09:08.007021 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-79418696-55a2-4d63-ac8f-a1b9ac6a40d7 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:09:08.007796 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-79418696-55a2-4d63-ac8f-a1b9ac6a40d7 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] [instance: 013da7c4-ac69-4554-827b-d68e9bac0e54] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:09:08.014395 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-79418696-55a2-4d63-ac8f-a1b9ac6a40d7 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:09:08.014839 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-79418696-55a2-4d63-ac8f-a1b9ac6a40d7 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:09:08.015606 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-79418696-55a2-4d63-ac8f-a1b9ac6a40d7 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:09:08.016067 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-79418696-55a2-4d63-ac8f-a1b9ac6a40d7 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:09:08.082760 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-79418696-55a2-4d63-ac8f-a1b9ac6a40d7 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6be4749041442787482b6e06b6c40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73f3238988e4e1293ad782712a1da53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 16:09:08.093562 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-79418696-55a2-4d63-ac8f-a1b9ac6a40d7 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] 10.222.0.64 "GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54" status: 200 len: 1350 microversion: 2.1 time: 0.090084 Oct 27 16:09:08.102765 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 857/1781] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 16:09:08 2021] GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54 => generated 1350 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 16:09:09.111289 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-b08e5c6a-d16e-4557-9a65-54648881c94b tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:09:09.111940 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-b08e5c6a-d16e-4557-9a65-54648881c94b tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] [instance: 013da7c4-ac69-4554-827b-d68e9bac0e54] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:09:09.119218 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-b08e5c6a-d16e-4557-9a65-54648881c94b tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:09:09.119768 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-b08e5c6a-d16e-4557-9a65-54648881c94b tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:09:09.120666 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-b08e5c6a-d16e-4557-9a65-54648881c94b tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:09:09.121100 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-b08e5c6a-d16e-4557-9a65-54648881c94b tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:09:09.184715 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-b08e5c6a-d16e-4557-9a65-54648881c94b tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6be4749041442787482b6e06b6c40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73f3238988e4e1293ad782712a1da53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 16:09:09.192525 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-b08e5c6a-d16e-4557-9a65-54648881c94b tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] 10.222.0.64 "GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54" status: 200 len: 1350 microversion: 2.1 time: 0.084882 Oct 27 16:09:09.193100 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 925/1782] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 16:09:09 2021] GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54 => generated 1350 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 16:09:10.210616 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-5d35c208-50a6-4a5e-8c8f-208e80184df5 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:09:10.211405 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-5d35c208-50a6-4a5e-8c8f-208e80184df5 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] [instance: 013da7c4-ac69-4554-827b-d68e9bac0e54] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:09:10.220662 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-5d35c208-50a6-4a5e-8c8f-208e80184df5 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:09:10.221450 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-5d35c208-50a6-4a5e-8c8f-208e80184df5 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:09:10.222758 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-5d35c208-50a6-4a5e-8c8f-208e80184df5 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:09:10.223502 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-5d35c208-50a6-4a5e-8c8f-208e80184df5 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:09:10.303906 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-5d35c208-50a6-4a5e-8c8f-208e80184df5 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6be4749041442787482b6e06b6c40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73f3238988e4e1293ad782712a1da53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 16:09:10.314350 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-5d35c208-50a6-4a5e-8c8f-208e80184df5 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] 10.222.0.64 "GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54" status: 200 len: 1350 microversion: 2.1 time: 0.108163 Oct 27 16:09:10.314933 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 858/1783] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 16:09:10 2021] GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54 => generated 1350 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 16:09:11.332123 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-40fb1307-658b-446b-9461-4970540ffd32 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:09:11.333234 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-40fb1307-658b-446b-9461-4970540ffd32 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] [instance: 013da7c4-ac69-4554-827b-d68e9bac0e54] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:09:11.339582 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-40fb1307-658b-446b-9461-4970540ffd32 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:09:11.340652 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-40fb1307-658b-446b-9461-4970540ffd32 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:09:11.341414 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-40fb1307-658b-446b-9461-4970540ffd32 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:09:11.342021 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-40fb1307-658b-446b-9461-4970540ffd32 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:09:11.407211 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-40fb1307-658b-446b-9461-4970540ffd32 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6be4749041442787482b6e06b6c40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73f3238988e4e1293ad782712a1da53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 16:09:11.415599 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-40fb1307-658b-446b-9461-4970540ffd32 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] 10.222.0.64 "GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54" status: 200 len: 1350 microversion: 2.1 time: 0.087519 Oct 27 16:09:11.416213 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 926/1784] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 16:09:11 2021] GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54 => generated 1350 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 16:09:12.433005 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-b2c4c51f-9c96-48dc-b65a-4005f7d2bf8e tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:09:12.434753 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-b2c4c51f-9c96-48dc-b65a-4005f7d2bf8e tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] [instance: 013da7c4-ac69-4554-827b-d68e9bac0e54] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:09:12.441567 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-b2c4c51f-9c96-48dc-b65a-4005f7d2bf8e tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:09:12.442015 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-b2c4c51f-9c96-48dc-b65a-4005f7d2bf8e tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:09:12.442792 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-b2c4c51f-9c96-48dc-b65a-4005f7d2bf8e tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:09:12.443227 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-b2c4c51f-9c96-48dc-b65a-4005f7d2bf8e tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:09:12.517306 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-b2c4c51f-9c96-48dc-b65a-4005f7d2bf8e tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6be4749041442787482b6e06b6c40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73f3238988e4e1293ad782712a1da53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 16:09:12.526275 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-b2c4c51f-9c96-48dc-b65a-4005f7d2bf8e tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] 10.222.0.64 "GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54" status: 200 len: 1350 microversion: 2.1 time: 0.097266 Oct 27 16:09:12.526781 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 859/1785] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 16:09:12 2021] GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54 => generated 1350 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 16:09:13.544501 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-52401a1a-b6bc-47bf-8a32-87960705663a tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:09:13.545157 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-52401a1a-b6bc-47bf-8a32-87960705663a tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] [instance: 013da7c4-ac69-4554-827b-d68e9bac0e54] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:09:13.551797 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-52401a1a-b6bc-47bf-8a32-87960705663a tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:09:13.552274 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-52401a1a-b6bc-47bf-8a32-87960705663a tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:09:13.553087 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-52401a1a-b6bc-47bf-8a32-87960705663a tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:09:13.553522 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-52401a1a-b6bc-47bf-8a32-87960705663a tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:09:13.615577 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-52401a1a-b6bc-47bf-8a32-87960705663a tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6be4749041442787482b6e06b6c40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73f3238988e4e1293ad782712a1da53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 16:09:13.624691 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-52401a1a-b6bc-47bf-8a32-87960705663a tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] 10.222.0.64 "GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54" status: 200 len: 1350 microversion: 2.1 time: 0.084432 Oct 27 16:09:13.625345 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 927/1786] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 16:09:13 2021] GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54 => generated 1350 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 16:09:14.643078 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-e882cd1d-1ead-4595-b2a2-589b368ed675 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:09:14.643746 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-e882cd1d-1ead-4595-b2a2-589b368ed675 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] [instance: 013da7c4-ac69-4554-827b-d68e9bac0e54] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:09:14.650528 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-e882cd1d-1ead-4595-b2a2-589b368ed675 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:09:14.650977 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-e882cd1d-1ead-4595-b2a2-589b368ed675 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:09:14.651760 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-e882cd1d-1ead-4595-b2a2-589b368ed675 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:09:14.652220 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-e882cd1d-1ead-4595-b2a2-589b368ed675 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:09:14.972593 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-e882cd1d-1ead-4595-b2a2-589b368ed675 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6be4749041442787482b6e06b6c40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73f3238988e4e1293ad782712a1da53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 16:09:14.982562 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-e882cd1d-1ead-4595-b2a2-589b368ed675 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] 10.222.0.64 "GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54" status: 200 len: 1350 microversion: 2.1 time: 0.343271 Oct 27 16:09:14.983154 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 860/1787] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 16:09:14 2021] GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54 => generated 1350 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 16:09:16.000771 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-c66609ec-81dd-4ab6-8fbf-00e964a049a1 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:09:16.001539 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-c66609ec-81dd-4ab6-8fbf-00e964a049a1 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] [instance: 013da7c4-ac69-4554-827b-d68e9bac0e54] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:09:16.007958 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-c66609ec-81dd-4ab6-8fbf-00e964a049a1 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:09:16.008391 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-c66609ec-81dd-4ab6-8fbf-00e964a049a1 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:09:16.009163 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-c66609ec-81dd-4ab6-8fbf-00e964a049a1 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:09:16.009588 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-c66609ec-81dd-4ab6-8fbf-00e964a049a1 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:09:16.077737 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-c66609ec-81dd-4ab6-8fbf-00e964a049a1 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6be4749041442787482b6e06b6c40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73f3238988e4e1293ad782712a1da53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 16:09:16.087209 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-c66609ec-81dd-4ab6-8fbf-00e964a049a1 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] 10.222.0.64 "GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54" status: 200 len: 1350 microversion: 2.1 time: 0.090993 Oct 27 16:09:16.087799 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 928/1788] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 16:09:15 2021] GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54 => generated 1350 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 16:09:17.107537 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-3ca6bb48-537e-48ff-b2fd-70986ebf705c tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:09:17.108296 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-3ca6bb48-537e-48ff-b2fd-70986ebf705c tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] [instance: 013da7c4-ac69-4554-827b-d68e9bac0e54] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:09:17.115739 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-3ca6bb48-537e-48ff-b2fd-70986ebf705c tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:09:17.116280 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-3ca6bb48-537e-48ff-b2fd-70986ebf705c tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:09:17.117083 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-3ca6bb48-537e-48ff-b2fd-70986ebf705c tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:09:17.117517 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-3ca6bb48-537e-48ff-b2fd-70986ebf705c tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:09:17.154369 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 27 16:09:17.154369 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: Wed Oct 27 16:09:17 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Oct 27 16:09:17.186729 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-3ca6bb48-537e-48ff-b2fd-70986ebf705c tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6be4749041442787482b6e06b6c40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73f3238988e4e1293ad782712a1da53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 16:09:17.197665 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-3ca6bb48-537e-48ff-b2fd-70986ebf705c tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] 10.222.0.64 "GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54" status: 200 len: 1350 microversion: 2.1 time: 0.095428 Oct 27 16:09:17.198600 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 861/1789] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 16:09:17 2021] GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54 => generated 1350 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 16:09:18.220177 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-72e79a98-e3ee-4368-88c1-fea3b56e0af9 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:09:18.221238 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-72e79a98-e3ee-4368-88c1-fea3b56e0af9 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] [instance: 013da7c4-ac69-4554-827b-d68e9bac0e54] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:09:18.227755 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-72e79a98-e3ee-4368-88c1-fea3b56e0af9 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:09:18.228234 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-72e79a98-e3ee-4368-88c1-fea3b56e0af9 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:09:18.229036 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-72e79a98-e3ee-4368-88c1-fea3b56e0af9 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:09:18.229470 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-72e79a98-e3ee-4368-88c1-fea3b56e0af9 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:09:18.307790 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-72e79a98-e3ee-4368-88c1-fea3b56e0af9 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6be4749041442787482b6e06b6c40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73f3238988e4e1293ad782712a1da53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 16:09:18.319448 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-72e79a98-e3ee-4368-88c1-fea3b56e0af9 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] 10.222.0.64 "GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54" status: 200 len: 1350 microversion: 2.1 time: 0.104145 Oct 27 16:09:18.320581 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 929/1790] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 16:09:18 2021] GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54 => generated 1350 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 16:09:19.338292 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-015c74b2-6fbf-4699-a258-10a00257da7c tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:09:19.338992 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-015c74b2-6fbf-4699-a258-10a00257da7c tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] [instance: 013da7c4-ac69-4554-827b-d68e9bac0e54] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:09:19.347562 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-015c74b2-6fbf-4699-a258-10a00257da7c tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:09:19.348153 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-015c74b2-6fbf-4699-a258-10a00257da7c tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:09:19.349309 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-015c74b2-6fbf-4699-a258-10a00257da7c tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:09:19.349830 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-015c74b2-6fbf-4699-a258-10a00257da7c tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:09:19.421726 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-015c74b2-6fbf-4699-a258-10a00257da7c tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6be4749041442787482b6e06b6c40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73f3238988e4e1293ad782712a1da53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 16:09:19.431942 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-015c74b2-6fbf-4699-a258-10a00257da7c tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] 10.222.0.64 "GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54" status: 200 len: 1350 microversion: 2.1 time: 0.097322 Oct 27 16:09:19.432481 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 862/1791] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 16:09:19 2021] GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54 => generated 1350 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 16:09:20.457763 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-0aa7f0bc-8d45-4f10-8966-68bb142a5ca7 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:09:20.458437 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-0aa7f0bc-8d45-4f10-8966-68bb142a5ca7 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] [instance: 013da7c4-ac69-4554-827b-d68e9bac0e54] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:09:20.464342 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-0aa7f0bc-8d45-4f10-8966-68bb142a5ca7 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:09:20.464948 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-0aa7f0bc-8d45-4f10-8966-68bb142a5ca7 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:09:20.466349 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-0aa7f0bc-8d45-4f10-8966-68bb142a5ca7 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:09:20.466777 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-0aa7f0bc-8d45-4f10-8966-68bb142a5ca7 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:09:20.554831 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-0aa7f0bc-8d45-4f10-8966-68bb142a5ca7 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6be4749041442787482b6e06b6c40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73f3238988e4e1293ad782712a1da53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 16:09:20.567923 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-0aa7f0bc-8d45-4f10-8966-68bb142a5ca7 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] 10.222.0.64 "GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54" status: 200 len: 1350 microversion: 2.1 time: 0.114790 Oct 27 16:09:20.568801 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 930/1792] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 16:09:20 2021] GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54 => generated 1350 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 16:09:21.493742 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 27 16:09:21.494275 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: Wed Oct 27 16:09:21 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Oct 27 16:09:21.587528 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-55d13e8c-812d-4348-bf1a-010e31ad9266 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:09:21.588173 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-55d13e8c-812d-4348-bf1a-010e31ad9266 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] [instance: 013da7c4-ac69-4554-827b-d68e9bac0e54] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:09:21.595248 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-55d13e8c-812d-4348-bf1a-010e31ad9266 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:09:21.595728 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-55d13e8c-812d-4348-bf1a-010e31ad9266 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:09:21.596535 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-55d13e8c-812d-4348-bf1a-010e31ad9266 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:09:21.597104 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-55d13e8c-812d-4348-bf1a-010e31ad9266 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:09:21.672104 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-55d13e8c-812d-4348-bf1a-010e31ad9266 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6be4749041442787482b6e06b6c40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73f3238988e4e1293ad782712a1da53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 16:09:21.684567 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-55d13e8c-812d-4348-bf1a-010e31ad9266 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] 10.222.0.64 "GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54" status: 200 len: 1350 microversion: 2.1 time: 0.100499 Oct 27 16:09:21.685500 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 863/1793] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 16:09:21 2021] GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54 => generated 1350 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 16:09:22.713714 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-f67b7564-38eb-49e6-92c8-61bacf79b2b0 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:09:22.715950 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-f67b7564-38eb-49e6-92c8-61bacf79b2b0 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] [instance: 013da7c4-ac69-4554-827b-d68e9bac0e54] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:09:22.725853 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-f67b7564-38eb-49e6-92c8-61bacf79b2b0 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:09:22.726434 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-f67b7564-38eb-49e6-92c8-61bacf79b2b0 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:09:22.727322 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-f67b7564-38eb-49e6-92c8-61bacf79b2b0 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:09:22.727816 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-f67b7564-38eb-49e6-92c8-61bacf79b2b0 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:09:22.794736 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-f67b7564-38eb-49e6-92c8-61bacf79b2b0 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6be4749041442787482b6e06b6c40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73f3238988e4e1293ad782712a1da53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 16:09:22.803690 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-f67b7564-38eb-49e6-92c8-61bacf79b2b0 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] 10.222.0.64 "GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54" status: 200 len: 1350 microversion: 2.1 time: 0.097924 Oct 27 16:09:22.804477 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 931/1794] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 16:09:22 2021] GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54 => generated 1350 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 16:09:23.825642 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-f4c062c3-98b6-4a63-9329-b394f84cef5f tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:09:23.826846 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-f4c062c3-98b6-4a63-9329-b394f84cef5f tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] [instance: 013da7c4-ac69-4554-827b-d68e9bac0e54] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:09:23.835391 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-f4c062c3-98b6-4a63-9329-b394f84cef5f tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:09:23.835955 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-f4c062c3-98b6-4a63-9329-b394f84cef5f tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:09:23.836823 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-f4c062c3-98b6-4a63-9329-b394f84cef5f tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:09:23.837403 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-f4c062c3-98b6-4a63-9329-b394f84cef5f tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:09:23.926933 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-f4c062c3-98b6-4a63-9329-b394f84cef5f tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6be4749041442787482b6e06b6c40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73f3238988e4e1293ad782712a1da53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 16:09:23.947975 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-f4c062c3-98b6-4a63-9329-b394f84cef5f tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] 10.222.0.64 "GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54" status: 200 len: 1350 microversion: 2.1 time: 0.128578 Oct 27 16:09:23.949641 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 864/1795] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 16:09:23 2021] GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54 => generated 1350 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 16:09:24.969501 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-94859a5b-bce3-49c3-bba8-99736cde0f51 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:09:24.970231 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-94859a5b-bce3-49c3-bba8-99736cde0f51 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] [instance: 013da7c4-ac69-4554-827b-d68e9bac0e54] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:09:24.976463 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-94859a5b-bce3-49c3-bba8-99736cde0f51 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:09:24.977254 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-94859a5b-bce3-49c3-bba8-99736cde0f51 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:09:24.978270 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-94859a5b-bce3-49c3-bba8-99736cde0f51 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:09:24.979031 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-94859a5b-bce3-49c3-bba8-99736cde0f51 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:09:25.091571 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-94859a5b-bce3-49c3-bba8-99736cde0f51 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6be4749041442787482b6e06b6c40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73f3238988e4e1293ad782712a1da53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 16:09:25.108799 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-94859a5b-bce3-49c3-bba8-99736cde0f51 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] 10.222.0.64 "GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54" status: 200 len: 1350 microversion: 2.1 time: 0.142407 Oct 27 16:09:25.110663 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 932/1796] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 16:09:24 2021] GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54 => generated 1350 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 16:09:26.137475 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-1383c536-d1e4-4df1-a778-17d0d0185a75 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:09:26.138521 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-1383c536-d1e4-4df1-a778-17d0d0185a75 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] [instance: 013da7c4-ac69-4554-827b-d68e9bac0e54] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:09:26.159387 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-1383c536-d1e4-4df1-a778-17d0d0185a75 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:09:26.159835 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-1383c536-d1e4-4df1-a778-17d0d0185a75 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:09:26.160676 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-1383c536-d1e4-4df1-a778-17d0d0185a75 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:09:26.161109 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-1383c536-d1e4-4df1-a778-17d0d0185a75 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:09:26.260988 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-1383c536-d1e4-4df1-a778-17d0d0185a75 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6be4749041442787482b6e06b6c40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73f3238988e4e1293ad782712a1da53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 16:09:26.271090 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-1383c536-d1e4-4df1-a778-17d0d0185a75 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] 10.222.0.64 "GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54" status: 200 len: 1350 microversion: 2.1 time: 0.144567 Oct 27 16:09:26.271932 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 865/1797] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 16:09:26 2021] GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54 => generated 1350 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 16:09:27.292295 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-539210fd-2ff7-446f-bc58-ace54a2eb55f tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:09:27.293650 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-539210fd-2ff7-446f-bc58-ace54a2eb55f tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] [instance: 013da7c4-ac69-4554-827b-d68e9bac0e54] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:09:27.314758 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-539210fd-2ff7-446f-bc58-ace54a2eb55f tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:09:27.315615 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-539210fd-2ff7-446f-bc58-ace54a2eb55f tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:09:27.318591 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-539210fd-2ff7-446f-bc58-ace54a2eb55f tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:09:27.319404 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-539210fd-2ff7-446f-bc58-ace54a2eb55f tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:09:27.453666 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-539210fd-2ff7-446f-bc58-ace54a2eb55f tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6be4749041442787482b6e06b6c40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73f3238988e4e1293ad782712a1da53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 16:09:27.469742 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-539210fd-2ff7-446f-bc58-ace54a2eb55f tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] 10.222.0.64 "GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54" status: 200 len: 1350 microversion: 2.1 time: 0.183261 Oct 27 16:09:27.471313 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 933/1798] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 16:09:27 2021] GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54 => generated 1350 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 16:09:28.491943 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-832f30e2-0cab-437f-904a-6ef30f6a5da7 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:09:28.493859 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-832f30e2-0cab-437f-904a-6ef30f6a5da7 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] [instance: 013da7c4-ac69-4554-827b-d68e9bac0e54] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:09:28.514947 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-832f30e2-0cab-437f-904a-6ef30f6a5da7 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:09:28.521250 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-832f30e2-0cab-437f-904a-6ef30f6a5da7 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:09:28.522897 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-832f30e2-0cab-437f-904a-6ef30f6a5da7 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:09:28.527766 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-832f30e2-0cab-437f-904a-6ef30f6a5da7 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:09:28.633546 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-832f30e2-0cab-437f-904a-6ef30f6a5da7 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6be4749041442787482b6e06b6c40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73f3238988e4e1293ad782712a1da53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 16:09:28.642831 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-832f30e2-0cab-437f-904a-6ef30f6a5da7 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] 10.222.0.64 "GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54" status: 200 len: 1350 microversion: 2.1 time: 0.157178 Oct 27 16:09:28.643405 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 866/1799] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 16:09:28 2021] GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54 => generated 1350 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 16:09:29.661039 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-3379441d-6938-4b93-b59e-00c011163538 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:09:29.661967 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-3379441d-6938-4b93-b59e-00c011163538 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] [instance: 013da7c4-ac69-4554-827b-d68e9bac0e54] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:09:29.671037 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-3379441d-6938-4b93-b59e-00c011163538 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:09:29.671614 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-3379441d-6938-4b93-b59e-00c011163538 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:09:29.672957 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-3379441d-6938-4b93-b59e-00c011163538 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:09:29.673524 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-3379441d-6938-4b93-b59e-00c011163538 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:09:29.782204 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-3379441d-6938-4b93-b59e-00c011163538 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6be4749041442787482b6e06b6c40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73f3238988e4e1293ad782712a1da53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 16:09:29.791108 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-3379441d-6938-4b93-b59e-00c011163538 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] 10.222.0.64 "GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54" status: 200 len: 1350 microversion: 2.1 time: 0.133937 Oct 27 16:09:29.791692 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 934/1800] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 16:09:29 2021] GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54 => generated 1350 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 16:09:30.815394 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-d34c7a1f-cb37-4926-9781-95204e0127f9 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:09:30.817704 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-d34c7a1f-cb37-4926-9781-95204e0127f9 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] [instance: 013da7c4-ac69-4554-827b-d68e9bac0e54] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:09:30.831925 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-d34c7a1f-cb37-4926-9781-95204e0127f9 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:09:30.833080 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-d34c7a1f-cb37-4926-9781-95204e0127f9 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:09:30.835785 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-d34c7a1f-cb37-4926-9781-95204e0127f9 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:09:30.837483 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-d34c7a1f-cb37-4926-9781-95204e0127f9 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:09:30.953235 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-d34c7a1f-cb37-4926-9781-95204e0127f9 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6be4749041442787482b6e06b6c40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73f3238988e4e1293ad782712a1da53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 16:09:30.962342 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-d34c7a1f-cb37-4926-9781-95204e0127f9 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] 10.222.0.64 "GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54" status: 200 len: 1350 microversion: 2.1 time: 0.154877 Oct 27 16:09:30.968200 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 867/1801] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 16:09:30 2021] GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54 => generated 1350 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 16:09:31.989863 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-a18b66cd-65f1-4ea5-8169-6eadc2915bd3 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:09:31.990892 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-a18b66cd-65f1-4ea5-8169-6eadc2915bd3 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] [instance: 013da7c4-ac69-4554-827b-d68e9bac0e54] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:09:32.002410 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-a18b66cd-65f1-4ea5-8169-6eadc2915bd3 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:09:32.003704 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-a18b66cd-65f1-4ea5-8169-6eadc2915bd3 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:09:32.005522 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-a18b66cd-65f1-4ea5-8169-6eadc2915bd3 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:09:32.006511 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-a18b66cd-65f1-4ea5-8169-6eadc2915bd3 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:09:32.168781 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-a18b66cd-65f1-4ea5-8169-6eadc2915bd3 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6be4749041442787482b6e06b6c40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73f3238988e4e1293ad782712a1da53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 16:09:32.190122 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-a18b66cd-65f1-4ea5-8169-6eadc2915bd3 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] 10.222.0.64 "GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54" status: 200 len: 1350 microversion: 2.1 time: 0.208411 Oct 27 16:09:32.191801 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 935/1802] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 16:09:31 2021] GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54 => generated 1350 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 16:09:33.219289 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-98991d0f-91e7-4c16-9427-01c770af51ef tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:09:33.221525 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-98991d0f-91e7-4c16-9427-01c770af51ef tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] [instance: 013da7c4-ac69-4554-827b-d68e9bac0e54] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:09:33.244769 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-98991d0f-91e7-4c16-9427-01c770af51ef tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:09:33.250671 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-98991d0f-91e7-4c16-9427-01c770af51ef tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:09:33.252499 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-98991d0f-91e7-4c16-9427-01c770af51ef tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:09:33.256738 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-98991d0f-91e7-4c16-9427-01c770af51ef tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:09:33.431967 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-98991d0f-91e7-4c16-9427-01c770af51ef tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6be4749041442787482b6e06b6c40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73f3238988e4e1293ad782712a1da53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 16:09:33.451880 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-98991d0f-91e7-4c16-9427-01c770af51ef tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] 10.222.0.64 "GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54" status: 200 len: 1350 microversion: 2.1 time: 0.240610 Oct 27 16:09:33.453260 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 868/1803] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 16:09:33 2021] GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54 => generated 1350 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 16:09:34.481521 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-16e84062-c3ba-43f4-a70f-c4c4898a7c18 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:09:34.482352 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-16e84062-c3ba-43f4-a70f-c4c4898a7c18 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] [instance: 013da7c4-ac69-4554-827b-d68e9bac0e54] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:09:34.490220 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-16e84062-c3ba-43f4-a70f-c4c4898a7c18 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:09:34.491466 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-16e84062-c3ba-43f4-a70f-c4c4898a7c18 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:09:34.492587 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-16e84062-c3ba-43f4-a70f-c4c4898a7c18 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:09:34.493281 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-16e84062-c3ba-43f4-a70f-c4c4898a7c18 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:09:34.624839 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-16e84062-c3ba-43f4-a70f-c4c4898a7c18 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6be4749041442787482b6e06b6c40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73f3238988e4e1293ad782712a1da53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 16:09:34.636888 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-16e84062-c3ba-43f4-a70f-c4c4898a7c18 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] 10.222.0.64 "GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54" status: 200 len: 1350 microversion: 2.1 time: 0.157704 Oct 27 16:09:34.642262 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 936/1804] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 16:09:34 2021] GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54 => generated 1350 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 16:09:35.671777 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-815eebe4-f4cc-4e47-8248-1ae564e1ce55 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:09:35.673038 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-815eebe4-f4cc-4e47-8248-1ae564e1ce55 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] [instance: 013da7c4-ac69-4554-827b-d68e9bac0e54] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:09:35.684786 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-815eebe4-f4cc-4e47-8248-1ae564e1ce55 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:09:35.685685 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-815eebe4-f4cc-4e47-8248-1ae564e1ce55 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:09:35.687145 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-815eebe4-f4cc-4e47-8248-1ae564e1ce55 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:09:35.688311 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-815eebe4-f4cc-4e47-8248-1ae564e1ce55 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:09:35.821107 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-815eebe4-f4cc-4e47-8248-1ae564e1ce55 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6be4749041442787482b6e06b6c40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73f3238988e4e1293ad782712a1da53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 16:09:35.838549 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-815eebe4-f4cc-4e47-8248-1ae564e1ce55 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] 10.222.0.64 "GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54" status: 200 len: 1350 microversion: 2.1 time: 0.173904 Oct 27 16:09:35.841353 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 869/1805] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 16:09:35 2021] GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54 => generated 1350 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 16:09:36.617249 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-67797d22-92e0-4490-b026-bc244927ce14 tempest-TestShelveInstance-876090071 tempest-TestShelveInstance-876090071-project] Action: 'create', calling method: .version_select at 0x7fbc0ac02f70>, body: {"keypair": {"name": "tempest-TestShelveInstance-691977933"}} {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 16:09:36.643470 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.quota [None req-67797d22-92e0-4490-b026-bc244927ce14 tempest-TestShelveInstance-876090071 tempest-TestShelveInstance-876090071-project] Getting quotas for project 7d5dc935678d4c6fb40d8285b6e64d17. Resources: {'key_pairs'} {{(pid=122224) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 27 16:09:36.647840 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.quota [None req-67797d22-92e0-4490-b026-bc244927ce14 tempest-TestShelveInstance-876090071 tempest-TestShelveInstance-876090071-project] Getting quotas for user 50661dee1600409cbd94014d055fdced and project 7d5dc935678d4c6fb40d8285b6e64d17. Resources: {'key_pairs'} {{(pid=122224) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 27 16:09:36.741628 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.quota [None req-67797d22-92e0-4490-b026-bc244927ce14 tempest-TestShelveInstance-876090071 tempest-TestShelveInstance-876090071-project] Getting quotas for project 7d5dc935678d4c6fb40d8285b6e64d17. Resources: {'key_pairs'} {{(pid=122224) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 27 16:09:36.748218 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.quota [None req-67797d22-92e0-4490-b026-bc244927ce14 tempest-TestShelveInstance-876090071 tempest-TestShelveInstance-876090071-project] Getting quotas for user 50661dee1600409cbd94014d055fdced and project 7d5dc935678d4c6fb40d8285b6e64d17. Resources: {'key_pairs'} {{(pid=122224) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 27 16:09:36.768643 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-67797d22-92e0-4490-b026-bc244927ce14 tempest-TestShelveInstance-876090071 tempest-TestShelveInstance-876090071-project] 10.222.0.64 "POST /compute/v2.1/os-keypairs" status: 200 len: 2311 microversion: 2.1 time: 0.429867 Oct 27 16:09:36.769662 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 937/1806] 10.222.0.64 () {60 vars in 1157 bytes} [Wed Oct 27 16:09:36 2021] POST /compute/v2.1/os-keypairs => generated 2311 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 16:09:36.874575 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-6d830050-04a9-4408-b85c-3bfe4a2277ed tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:09:36.876161 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-6d830050-04a9-4408-b85c-3bfe4a2277ed tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] [instance: 013da7c4-ac69-4554-827b-d68e9bac0e54] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:09:36.884832 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-6d830050-04a9-4408-b85c-3bfe4a2277ed tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:09:36.885515 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-6d830050-04a9-4408-b85c-3bfe4a2277ed tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:09:36.887348 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-6d830050-04a9-4408-b85c-3bfe4a2277ed tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:09:36.888133 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-6d830050-04a9-4408-b85c-3bfe4a2277ed tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:09:36.966422 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-6d830050-04a9-4408-b85c-3bfe4a2277ed tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6be4749041442787482b6e06b6c40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73f3238988e4e1293ad782712a1da53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 16:09:36.981680 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-6d830050-04a9-4408-b85c-3bfe4a2277ed tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] 10.222.0.64 "GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54" status: 200 len: 1350 microversion: 2.1 time: 0.113828 Oct 27 16:09:36.983056 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 870/1807] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 16:09:36 2021] GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54 => generated 1350 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 16:09:38.011703 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-78a79586-9f31-49fc-a95e-cf6218508dd8 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:09:38.014169 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-78a79586-9f31-49fc-a95e-cf6218508dd8 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] [instance: 013da7c4-ac69-4554-827b-d68e9bac0e54] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:09:38.025969 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-78a79586-9f31-49fc-a95e-cf6218508dd8 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:09:38.027813 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-78a79586-9f31-49fc-a95e-cf6218508dd8 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:09:38.029720 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-78a79586-9f31-49fc-a95e-cf6218508dd8 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:09:38.030568 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-78a79586-9f31-49fc-a95e-cf6218508dd8 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:09:38.133524 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-78a79586-9f31-49fc-a95e-cf6218508dd8 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6be4749041442787482b6e06b6c40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73f3238988e4e1293ad782712a1da53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 16:09:38.154596 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-78a79586-9f31-49fc-a95e-cf6218508dd8 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] 10.222.0.64 "GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54" status: 200 len: 1350 microversion: 2.1 time: 0.150938 Oct 27 16:09:38.155444 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 938/1808] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 16:09:38 2021] GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54 => generated 1350 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 16:09:39.188009 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-c2fcd94c-d5d3-40b2-8e94-b829bfdca32e tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:09:39.190847 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-c2fcd94c-d5d3-40b2-8e94-b829bfdca32e tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] [instance: 013da7c4-ac69-4554-827b-d68e9bac0e54] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:09:39.202325 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-c2fcd94c-d5d3-40b2-8e94-b829bfdca32e tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:09:39.202882 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-c2fcd94c-d5d3-40b2-8e94-b829bfdca32e tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:09:39.204776 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-c2fcd94c-d5d3-40b2-8e94-b829bfdca32e tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:09:39.205265 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-c2fcd94c-d5d3-40b2-8e94-b829bfdca32e tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:09:39.301764 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-c2fcd94c-d5d3-40b2-8e94-b829bfdca32e tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6be4749041442787482b6e06b6c40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73f3238988e4e1293ad782712a1da53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 16:09:39.313013 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-c2fcd94c-d5d3-40b2-8e94-b829bfdca32e tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] 10.222.0.64 "GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54" status: 200 len: 1350 microversion: 2.1 time: 0.135685 Oct 27 16:09:39.313700 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 871/1809] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 16:09:39 2021] GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54 => generated 1350 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 16:09:40.339895 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-ebd1e230-87aa-470f-b489-63713755acc9 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:09:40.340804 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-ebd1e230-87aa-470f-b489-63713755acc9 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] [instance: 013da7c4-ac69-4554-827b-d68e9bac0e54] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:09:40.360547 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-ebd1e230-87aa-470f-b489-63713755acc9 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:09:40.361382 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-ebd1e230-87aa-470f-b489-63713755acc9 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:09:40.362776 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-ebd1e230-87aa-470f-b489-63713755acc9 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:09:40.363574 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-ebd1e230-87aa-470f-b489-63713755acc9 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:09:40.451992 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-ebd1e230-87aa-470f-b489-63713755acc9 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6be4749041442787482b6e06b6c40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73f3238988e4e1293ad782712a1da53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 16:09:40.469376 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-ebd1e230-87aa-470f-b489-63713755acc9 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] 10.222.0.64 "GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54" status: 200 len: 1350 microversion: 2.1 time: 0.133693 Oct 27 16:09:40.470394 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 939/1810] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 16:09:40 2021] GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54 => generated 1350 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 16:09:41.500926 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-4abf1ab3-367e-4920-8358-96a00b34f6c8 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:09:41.502037 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-4abf1ab3-367e-4920-8358-96a00b34f6c8 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] [instance: 013da7c4-ac69-4554-827b-d68e9bac0e54] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:09:41.513807 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-4abf1ab3-367e-4920-8358-96a00b34f6c8 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:09:41.514607 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-4abf1ab3-367e-4920-8358-96a00b34f6c8 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:09:41.516101 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-4abf1ab3-367e-4920-8358-96a00b34f6c8 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:09:41.516858 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-4abf1ab3-367e-4920-8358-96a00b34f6c8 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:09:41.620958 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-4abf1ab3-367e-4920-8358-96a00b34f6c8 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6be4749041442787482b6e06b6c40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73f3238988e4e1293ad782712a1da53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 16:09:41.630910 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-4abf1ab3-367e-4920-8358-96a00b34f6c8 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] 10.222.0.64 "GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54" status: 200 len: 1350 microversion: 2.1 time: 0.137018 Oct 27 16:09:41.631491 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 872/1811] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 16:09:41 2021] GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54 => generated 1350 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 16:09:42.653904 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-cc71e10f-a093-497b-93cc-cbc9243d108f tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:09:42.654683 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-cc71e10f-a093-497b-93cc-cbc9243d108f tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] [instance: 013da7c4-ac69-4554-827b-d68e9bac0e54] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:09:42.662035 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-cc71e10f-a093-497b-93cc-cbc9243d108f tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:09:42.662583 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-cc71e10f-a093-497b-93cc-cbc9243d108f tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:09:42.663702 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-cc71e10f-a093-497b-93cc-cbc9243d108f tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:09:42.664182 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-cc71e10f-a093-497b-93cc-cbc9243d108f tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:09:42.755323 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-cc71e10f-a093-497b-93cc-cbc9243d108f tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6be4749041442787482b6e06b6c40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73f3238988e4e1293ad782712a1da53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 16:09:42.768817 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-cc71e10f-a093-497b-93cc-cbc9243d108f tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] 10.222.0.64 "GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54" status: 200 len: 1350 microversion: 2.1 time: 0.121428 Oct 27 16:09:42.769559 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 940/1812] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 16:09:42 2021] GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54 => generated 1350 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 16:09:43.800272 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-bee65fb6-0275-4a47-9ee5-863afe5d268c tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:09:43.800892 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-bee65fb6-0275-4a47-9ee5-863afe5d268c tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] [instance: 013da7c4-ac69-4554-827b-d68e9bac0e54] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:09:43.812111 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-bee65fb6-0275-4a47-9ee5-863afe5d268c tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:09:43.812908 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-bee65fb6-0275-4a47-9ee5-863afe5d268c tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:09:43.814348 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-bee65fb6-0275-4a47-9ee5-863afe5d268c tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:09:43.815101 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-bee65fb6-0275-4a47-9ee5-863afe5d268c tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:09:43.930437 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-bee65fb6-0275-4a47-9ee5-863afe5d268c tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6be4749041442787482b6e06b6c40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73f3238988e4e1293ad782712a1da53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 16:09:43.944288 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-bee65fb6-0275-4a47-9ee5-863afe5d268c tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] 10.222.0.64 "GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54" status: 200 len: 1350 microversion: 2.1 time: 0.150230 Oct 27 16:09:43.945353 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 873/1813] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 16:09:43 2021] GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54 => generated 1350 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 16:09:44.969905 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-29af77c3-116f-4ae9-955c-81a2db73367c tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:09:44.970809 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-29af77c3-116f-4ae9-955c-81a2db73367c tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] [instance: 013da7c4-ac69-4554-827b-d68e9bac0e54] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:09:44.979695 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-29af77c3-116f-4ae9-955c-81a2db73367c tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:09:44.980473 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-29af77c3-116f-4ae9-955c-81a2db73367c tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:09:44.981742 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-29af77c3-116f-4ae9-955c-81a2db73367c tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:09:44.982471 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-29af77c3-116f-4ae9-955c-81a2db73367c tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:09:45.075170 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-29af77c3-116f-4ae9-955c-81a2db73367c tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6be4749041442787482b6e06b6c40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73f3238988e4e1293ad782712a1da53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 16:09:45.084774 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-29af77c3-116f-4ae9-955c-81a2db73367c tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] 10.222.0.64 "GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54" status: 200 len: 1350 microversion: 2.1 time: 0.119115 Oct 27 16:09:45.085359 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 941/1814] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 16:09:44 2021] GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54 => generated 1350 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 16:09:46.114220 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-bf6b6657-e023-431f-b7c0-7d97deb5f7de tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:09:46.115249 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-bf6b6657-e023-431f-b7c0-7d97deb5f7de tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] [instance: 013da7c4-ac69-4554-827b-d68e9bac0e54] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:09:46.126756 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-bf6b6657-e023-431f-b7c0-7d97deb5f7de tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:09:46.127436 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-bf6b6657-e023-431f-b7c0-7d97deb5f7de tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:09:46.128747 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-bf6b6657-e023-431f-b7c0-7d97deb5f7de tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:09:46.129434 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-bf6b6657-e023-431f-b7c0-7d97deb5f7de tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:09:46.234701 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-bf6b6657-e023-431f-b7c0-7d97deb5f7de tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6be4749041442787482b6e06b6c40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73f3238988e4e1293ad782712a1da53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 16:09:46.251457 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-bf6b6657-e023-431f-b7c0-7d97deb5f7de tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] 10.222.0.64 "GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54" status: 200 len: 1350 microversion: 2.1 time: 0.142841 Oct 27 16:09:46.252834 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 874/1815] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 16:09:46 2021] GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54 => generated 1350 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 16:09:47.278793 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-55bf4835-1250-42ad-9685-beae86885c1e tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:09:47.279782 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-55bf4835-1250-42ad-9685-beae86885c1e tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] [instance: 013da7c4-ac69-4554-827b-d68e9bac0e54] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:09:47.289384 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-55bf4835-1250-42ad-9685-beae86885c1e tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:09:47.290058 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-55bf4835-1250-42ad-9685-beae86885c1e tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:09:47.291258 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-55bf4835-1250-42ad-9685-beae86885c1e tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:09:47.292026 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-55bf4835-1250-42ad-9685-beae86885c1e tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:09:47.397949 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-55bf4835-1250-42ad-9685-beae86885c1e tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6be4749041442787482b6e06b6c40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73f3238988e4e1293ad782712a1da53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 16:09:47.412585 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-55bf4835-1250-42ad-9685-beae86885c1e tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] 10.222.0.64 "GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54" status: 200 len: 1350 microversion: 2.1 time: 0.140271 Oct 27 16:09:47.413635 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 942/1816] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 16:09:47 2021] GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54 => generated 1350 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 16:09:48.438010 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-34ae9ed6-6606-48c3-894d-19caa2808c15 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:09:48.438765 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-34ae9ed6-6606-48c3-894d-19caa2808c15 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] [instance: 013da7c4-ac69-4554-827b-d68e9bac0e54] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:09:48.447295 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-34ae9ed6-6606-48c3-894d-19caa2808c15 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:09:48.447786 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-34ae9ed6-6606-48c3-894d-19caa2808c15 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:09:48.449509 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-34ae9ed6-6606-48c3-894d-19caa2808c15 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:09:48.450086 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-34ae9ed6-6606-48c3-894d-19caa2808c15 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:09:48.529738 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-34ae9ed6-6606-48c3-894d-19caa2808c15 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6be4749041442787482b6e06b6c40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73f3238988e4e1293ad782712a1da53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 16:09:48.537924 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-34ae9ed6-6606-48c3-894d-19caa2808c15 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] 10.222.0.64 "GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54" status: 200 len: 1350 microversion: 2.1 time: 0.105211 Oct 27 16:09:48.538483 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 875/1817] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 16:09:48 2021] GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54 => generated 1350 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 16:09:49.555788 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-9e178e97-f918-484d-919f-f5f3ed23d61d tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:09:49.556813 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-9e178e97-f918-484d-919f-f5f3ed23d61d tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] [instance: 013da7c4-ac69-4554-827b-d68e9bac0e54] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:09:49.563827 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-9e178e97-f918-484d-919f-f5f3ed23d61d tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:09:49.564318 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-9e178e97-f918-484d-919f-f5f3ed23d61d tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:09:49.565106 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-9e178e97-f918-484d-919f-f5f3ed23d61d tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:09:49.565549 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-9e178e97-f918-484d-919f-f5f3ed23d61d tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:09:49.646681 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-9e178e97-f918-484d-919f-f5f3ed23d61d tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6be4749041442787482b6e06b6c40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73f3238988e4e1293ad782712a1da53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 16:09:49.658922 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-9e178e97-f918-484d-919f-f5f3ed23d61d tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] 10.222.0.64 "GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54" status: 200 len: 1350 microversion: 2.1 time: 0.106608 Oct 27 16:09:49.659893 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 943/1818] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 16:09:49 2021] GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54 => generated 1350 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 16:09:50.678829 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-7b1dafd7-8a13-4384-bb96-0f83d48179a6 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:09:50.679405 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-7b1dafd7-8a13-4384-bb96-0f83d48179a6 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] [instance: 013da7c4-ac69-4554-827b-d68e9bac0e54] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:09:50.687383 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-7b1dafd7-8a13-4384-bb96-0f83d48179a6 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:09:50.687831 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-7b1dafd7-8a13-4384-bb96-0f83d48179a6 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:09:50.688680 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-7b1dafd7-8a13-4384-bb96-0f83d48179a6 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:09:50.689116 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-7b1dafd7-8a13-4384-bb96-0f83d48179a6 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:09:50.764591 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-7b1dafd7-8a13-4384-bb96-0f83d48179a6 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6be4749041442787482b6e06b6c40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73f3238988e4e1293ad782712a1da53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 16:09:50.772600 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-7b1dafd7-8a13-4384-bb96-0f83d48179a6 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] 10.222.0.64 "GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54" status: 200 len: 1350 microversion: 2.1 time: 0.098376 Oct 27 16:09:50.773175 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 876/1819] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 16:09:50 2021] GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54 => generated 1350 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 16:09:51.790900 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-4fbdc893-40f5-4218-83a2-6b56fa5824ed tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:09:51.791519 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-4fbdc893-40f5-4218-83a2-6b56fa5824ed tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] [instance: 013da7c4-ac69-4554-827b-d68e9bac0e54] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:09:51.797592 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-4fbdc893-40f5-4218-83a2-6b56fa5824ed tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:09:51.798035 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-4fbdc893-40f5-4218-83a2-6b56fa5824ed tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:09:51.798797 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-4fbdc893-40f5-4218-83a2-6b56fa5824ed tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:09:51.799226 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-4fbdc893-40f5-4218-83a2-6b56fa5824ed tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:09:51.866593 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-4fbdc893-40f5-4218-83a2-6b56fa5824ed tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6be4749041442787482b6e06b6c40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73f3238988e4e1293ad782712a1da53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 16:09:51.875974 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-4fbdc893-40f5-4218-83a2-6b56fa5824ed tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] 10.222.0.64 "GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54" status: 200 len: 1350 microversion: 2.1 time: 0.088673 Oct 27 16:09:51.876548 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 944/1820] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 16:09:51 2021] GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54 => generated 1350 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 16:09:52.897277 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-9a4dab36-7572-4946-a456-6414bbe42e0d tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:09:52.897942 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-9a4dab36-7572-4946-a456-6414bbe42e0d tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] [instance: 013da7c4-ac69-4554-827b-d68e9bac0e54] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:09:52.905452 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-9a4dab36-7572-4946-a456-6414bbe42e0d tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:09:52.905900 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-9a4dab36-7572-4946-a456-6414bbe42e0d tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:09:52.906835 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-9a4dab36-7572-4946-a456-6414bbe42e0d tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:09:52.907410 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-9a4dab36-7572-4946-a456-6414bbe42e0d tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:09:52.983499 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-9a4dab36-7572-4946-a456-6414bbe42e0d tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6be4749041442787482b6e06b6c40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73f3238988e4e1293ad782712a1da53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 16:09:52.991422 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-9a4dab36-7572-4946-a456-6414bbe42e0d tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] 10.222.0.64 "GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54" status: 200 len: 1350 microversion: 2.1 time: 0.101030 Oct 27 16:09:52.992019 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 877/1821] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 16:09:52 2021] GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54 => generated 1350 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 16:09:54.013041 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-64f0690c-0f15-4ecb-91c6-01cf86f42a39 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:09:54.013677 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-64f0690c-0f15-4ecb-91c6-01cf86f42a39 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] [instance: 013da7c4-ac69-4554-827b-d68e9bac0e54] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:09:54.020807 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-64f0690c-0f15-4ecb-91c6-01cf86f42a39 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:09:54.021254 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-64f0690c-0f15-4ecb-91c6-01cf86f42a39 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:09:54.022026 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-64f0690c-0f15-4ecb-91c6-01cf86f42a39 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:09:54.022457 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-64f0690c-0f15-4ecb-91c6-01cf86f42a39 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:09:54.097676 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-64f0690c-0f15-4ecb-91c6-01cf86f42a39 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6be4749041442787482b6e06b6c40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73f3238988e4e1293ad782712a1da53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 16:09:54.109993 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-64f0690c-0f15-4ecb-91c6-01cf86f42a39 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] 10.222.0.64 "GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54" status: 200 len: 1350 microversion: 2.1 time: 0.100358 Oct 27 16:09:54.111040 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 945/1822] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 16:09:54 2021] GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54 => generated 1350 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 16:09:55.129099 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-147d238f-4e8f-44fc-99e8-1bb285a7e3d6 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:09:55.129681 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-147d238f-4e8f-44fc-99e8-1bb285a7e3d6 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] [instance: 013da7c4-ac69-4554-827b-d68e9bac0e54] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:09:55.136470 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-147d238f-4e8f-44fc-99e8-1bb285a7e3d6 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:09:55.136918 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-147d238f-4e8f-44fc-99e8-1bb285a7e3d6 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:09:55.137703 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-147d238f-4e8f-44fc-99e8-1bb285a7e3d6 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:09:55.138129 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-147d238f-4e8f-44fc-99e8-1bb285a7e3d6 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:09:55.200931 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-147d238f-4e8f-44fc-99e8-1bb285a7e3d6 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6be4749041442787482b6e06b6c40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73f3238988e4e1293ad782712a1da53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 16:09:55.209608 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-147d238f-4e8f-44fc-99e8-1bb285a7e3d6 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] 10.222.0.64 "GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54" status: 200 len: 1350 microversion: 2.1 time: 0.084162 Oct 27 16:09:55.210176 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 878/1823] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 16:09:55 2021] GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54 => generated 1350 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 16:09:56.226944 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-fe359632-668f-4ec6-9eee-b683ecd620db tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:09:56.227723 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-fe359632-668f-4ec6-9eee-b683ecd620db tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] [instance: 013da7c4-ac69-4554-827b-d68e9bac0e54] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:09:56.234823 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-fe359632-668f-4ec6-9eee-b683ecd620db tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:09:56.235350 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-fe359632-668f-4ec6-9eee-b683ecd620db tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:09:56.236244 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-fe359632-668f-4ec6-9eee-b683ecd620db tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:09:56.236818 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-fe359632-668f-4ec6-9eee-b683ecd620db tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:09:56.301211 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-fe359632-668f-4ec6-9eee-b683ecd620db tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6be4749041442787482b6e06b6c40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73f3238988e4e1293ad782712a1da53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 16:09:56.310864 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-fe359632-668f-4ec6-9eee-b683ecd620db tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] 10.222.0.64 "GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54" status: 200 len: 1350 microversion: 2.1 time: 0.087913 Oct 27 16:09:56.311445 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 946/1824] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 16:09:56 2021] GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54 => generated 1350 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 16:09:57.329014 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-38e0d35f-908a-4e3b-8db8-d491efb16d83 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:09:57.329679 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-38e0d35f-908a-4e3b-8db8-d491efb16d83 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] [instance: 013da7c4-ac69-4554-827b-d68e9bac0e54] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:09:57.336728 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-38e0d35f-908a-4e3b-8db8-d491efb16d83 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:09:57.337174 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-38e0d35f-908a-4e3b-8db8-d491efb16d83 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:09:57.337939 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-38e0d35f-908a-4e3b-8db8-d491efb16d83 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:09:57.338439 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-38e0d35f-908a-4e3b-8db8-d491efb16d83 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:09:57.414439 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-38e0d35f-908a-4e3b-8db8-d491efb16d83 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6be4749041442787482b6e06b6c40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73f3238988e4e1293ad782712a1da53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 16:09:57.423071 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-38e0d35f-908a-4e3b-8db8-d491efb16d83 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] 10.222.0.64 "GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54" status: 200 len: 1350 microversion: 2.1 time: 0.098046 Oct 27 16:09:57.423788 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 879/1825] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 16:09:57 2021] GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54 => generated 1350 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 16:09:58.444360 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-5e90269d-57c4-489b-a041-993858bd6f25 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:09:58.445182 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-5e90269d-57c4-489b-a041-993858bd6f25 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] [instance: 013da7c4-ac69-4554-827b-d68e9bac0e54] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:09:58.452535 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-5e90269d-57c4-489b-a041-993858bd6f25 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:09:58.452983 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-5e90269d-57c4-489b-a041-993858bd6f25 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:09:58.453798 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-5e90269d-57c4-489b-a041-993858bd6f25 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:09:58.454375 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-5e90269d-57c4-489b-a041-993858bd6f25 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:09:58.521415 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-5e90269d-57c4-489b-a041-993858bd6f25 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6be4749041442787482b6e06b6c40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73f3238988e4e1293ad782712a1da53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 16:09:58.530746 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-5e90269d-57c4-489b-a041-993858bd6f25 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] 10.222.0.64 "GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54" status: 200 len: 1350 microversion: 2.1 time: 0.090416 Oct 27 16:09:58.531325 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 947/1826] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 16:09:58 2021] GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54 => generated 1350 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 16:09:59.549641 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-fe023ad7-6a64-4835-9022-627a2009a06f tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:09:59.550279 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-fe023ad7-6a64-4835-9022-627a2009a06f tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] [instance: 013da7c4-ac69-4554-827b-d68e9bac0e54] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:09:59.556502 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-fe023ad7-6a64-4835-9022-627a2009a06f tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:09:59.557053 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-fe023ad7-6a64-4835-9022-627a2009a06f tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:09:59.558482 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-fe023ad7-6a64-4835-9022-627a2009a06f tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:09:59.558919 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-fe023ad7-6a64-4835-9022-627a2009a06f tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:09:59.628636 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-fe023ad7-6a64-4835-9022-627a2009a06f tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6be4749041442787482b6e06b6c40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73f3238988e4e1293ad782712a1da53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 16:09:59.639644 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-fe023ad7-6a64-4835-9022-627a2009a06f tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] 10.222.0.64 "GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54" status: 200 len: 1350 microversion: 2.1 time: 0.093301 Oct 27 16:09:59.640715 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 880/1827] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 16:09:59 2021] GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54 => generated 1350 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 16:10:00.663248 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-47439cb2-5e13-4a70-a310-6d3fa3334f1e tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:10:00.663973 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-47439cb2-5e13-4a70-a310-6d3fa3334f1e tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] [instance: 013da7c4-ac69-4554-827b-d68e9bac0e54] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:10:00.672182 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-47439cb2-5e13-4a70-a310-6d3fa3334f1e tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:10:00.672739 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-47439cb2-5e13-4a70-a310-6d3fa3334f1e tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:10:00.673592 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-47439cb2-5e13-4a70-a310-6d3fa3334f1e tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:10:00.674105 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-47439cb2-5e13-4a70-a310-6d3fa3334f1e tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:10:00.746021 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-47439cb2-5e13-4a70-a310-6d3fa3334f1e tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6be4749041442787482b6e06b6c40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73f3238988e4e1293ad782712a1da53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 16:10:00.755067 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-47439cb2-5e13-4a70-a310-6d3fa3334f1e tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] 10.222.0.64 "GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54" status: 200 len: 1350 microversion: 2.1 time: 0.100790 Oct 27 16:10:00.755645 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 948/1828] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 16:10:00 2021] GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54 => generated 1350 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 16:10:01.772349 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-67d5c5fc-de58-4fe1-81d0-1e0fec0f1a1a tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:10:01.772972 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-67d5c5fc-de58-4fe1-81d0-1e0fec0f1a1a tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] [instance: 013da7c4-ac69-4554-827b-d68e9bac0e54] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:10:01.780066 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-67d5c5fc-de58-4fe1-81d0-1e0fec0f1a1a tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:10:01.780509 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-67d5c5fc-de58-4fe1-81d0-1e0fec0f1a1a tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:10:01.781274 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-67d5c5fc-de58-4fe1-81d0-1e0fec0f1a1a tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:10:01.781700 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-67d5c5fc-de58-4fe1-81d0-1e0fec0f1a1a tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:10:01.847882 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-67d5c5fc-de58-4fe1-81d0-1e0fec0f1a1a tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6be4749041442787482b6e06b6c40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73f3238988e4e1293ad782712a1da53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 16:10:01.856732 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-67d5c5fc-de58-4fe1-81d0-1e0fec0f1a1a tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] 10.222.0.64 "GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54" status: 200 len: 1350 microversion: 2.1 time: 0.088086 Oct 27 16:10:01.857313 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 881/1829] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 16:10:01 2021] GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54 => generated 1350 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 16:10:02.874519 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-3502d109-17b1-4b7e-983d-717adda1123c tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:10:02.875160 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-3502d109-17b1-4b7e-983d-717adda1123c tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] [instance: 013da7c4-ac69-4554-827b-d68e9bac0e54] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:10:02.881920 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-3502d109-17b1-4b7e-983d-717adda1123c tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:10:02.882367 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-3502d109-17b1-4b7e-983d-717adda1123c tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:10:02.883196 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-3502d109-17b1-4b7e-983d-717adda1123c tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:10:02.883637 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-3502d109-17b1-4b7e-983d-717adda1123c tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:10:02.950062 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-3502d109-17b1-4b7e-983d-717adda1123c tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6be4749041442787482b6e06b6c40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73f3238988e4e1293ad782712a1da53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 16:10:02.958546 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-3502d109-17b1-4b7e-983d-717adda1123c tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] 10.222.0.64 "GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54" status: 200 len: 1350 microversion: 2.1 time: 0.088337 Oct 27 16:10:02.959033 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 949/1830] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 16:10:02 2021] GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54 => generated 1350 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 16:10:03.976363 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-523e9970-f2fb-4b96-b622-bb3f49bb8f7a tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:10:03.976981 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-523e9970-f2fb-4b96-b622-bb3f49bb8f7a tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] [instance: 013da7c4-ac69-4554-827b-d68e9bac0e54] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:10:03.983320 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-523e9970-f2fb-4b96-b622-bb3f49bb8f7a tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:10:03.983767 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-523e9970-f2fb-4b96-b622-bb3f49bb8f7a tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:10:03.984642 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-523e9970-f2fb-4b96-b622-bb3f49bb8f7a tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:10:03.985077 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-523e9970-f2fb-4b96-b622-bb3f49bb8f7a tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:10:04.049939 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-523e9970-f2fb-4b96-b622-bb3f49bb8f7a tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6be4749041442787482b6e06b6c40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73f3238988e4e1293ad782712a1da53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 16:10:04.058594 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-523e9970-f2fb-4b96-b622-bb3f49bb8f7a tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] 10.222.0.64 "GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54" status: 200 len: 1350 microversion: 2.1 time: 0.085992 Oct 27 16:10:04.059175 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 882/1831] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 16:10:03 2021] GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54 => generated 1350 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 16:10:05.075765 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-ea4913a4-7bc4-4315-9c16-5c17c0f5fa6c tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:10:05.076354 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-ea4913a4-7bc4-4315-9c16-5c17c0f5fa6c tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] [instance: 013da7c4-ac69-4554-827b-d68e9bac0e54] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:10:05.082839 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-ea4913a4-7bc4-4315-9c16-5c17c0f5fa6c tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:10:05.083276 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-ea4913a4-7bc4-4315-9c16-5c17c0f5fa6c tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:10:05.084081 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-ea4913a4-7bc4-4315-9c16-5c17c0f5fa6c tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:10:05.084508 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-ea4913a4-7bc4-4315-9c16-5c17c0f5fa6c tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:10:05.150855 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-ea4913a4-7bc4-4315-9c16-5c17c0f5fa6c tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6be4749041442787482b6e06b6c40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73f3238988e4e1293ad782712a1da53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 16:10:05.158923 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-ea4913a4-7bc4-4315-9c16-5c17c0f5fa6c tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] 10.222.0.64 "GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54" status: 200 len: 1350 microversion: 2.1 time: 0.087794 Oct 27 16:10:05.159459 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 950/1832] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 16:10:05 2021] GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54 => generated 1350 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 16:10:06.176512 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-35b4ba6f-3e4f-4be1-8c8f-6111514c92d8 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:10:06.177208 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-35b4ba6f-3e4f-4be1-8c8f-6111514c92d8 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] [instance: 013da7c4-ac69-4554-827b-d68e9bac0e54] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:10:06.184609 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-35b4ba6f-3e4f-4be1-8c8f-6111514c92d8 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:10:06.185045 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-35b4ba6f-3e4f-4be1-8c8f-6111514c92d8 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:10:06.185804 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-35b4ba6f-3e4f-4be1-8c8f-6111514c92d8 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:10:06.186236 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-35b4ba6f-3e4f-4be1-8c8f-6111514c92d8 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:10:06.248418 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-35b4ba6f-3e4f-4be1-8c8f-6111514c92d8 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6be4749041442787482b6e06b6c40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73f3238988e4e1293ad782712a1da53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 16:10:06.256168 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-35b4ba6f-3e4f-4be1-8c8f-6111514c92d8 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] 10.222.0.64 "GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54" status: 200 len: 1350 microversion: 2.1 time: 0.083276 Oct 27 16:10:06.256736 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 883/1833] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 16:10:06 2021] GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54 => generated 1350 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 16:10:07.272451 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-fed56f6f-aea4-4dbb-98c4-86564fbb8861 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:10:07.273058 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-fed56f6f-aea4-4dbb-98c4-86564fbb8861 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] [instance: 013da7c4-ac69-4554-827b-d68e9bac0e54] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:10:07.279985 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-fed56f6f-aea4-4dbb-98c4-86564fbb8861 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:10:07.280434 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-fed56f6f-aea4-4dbb-98c4-86564fbb8861 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:10:07.281486 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-fed56f6f-aea4-4dbb-98c4-86564fbb8861 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:10:07.281924 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-fed56f6f-aea4-4dbb-98c4-86564fbb8861 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:10:07.342560 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-fed56f6f-aea4-4dbb-98c4-86564fbb8861 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6be4749041442787482b6e06b6c40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73f3238988e4e1293ad782712a1da53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 16:10:07.350279 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-fed56f6f-aea4-4dbb-98c4-86564fbb8861 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] 10.222.0.64 "GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54" status: 200 len: 1350 microversion: 2.1 time: 0.081441 Oct 27 16:10:07.350847 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 951/1834] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 16:10:07 2021] GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54 => generated 1350 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 16:10:08.367379 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-80d5e370-b2ce-44b7-b228-2f6d72d37d6b tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:10:08.368039 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-80d5e370-b2ce-44b7-b228-2f6d72d37d6b tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] [instance: 013da7c4-ac69-4554-827b-d68e9bac0e54] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:10:08.374414 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-80d5e370-b2ce-44b7-b228-2f6d72d37d6b tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:10:08.374863 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-80d5e370-b2ce-44b7-b228-2f6d72d37d6b tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:10:08.375642 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-80d5e370-b2ce-44b7-b228-2f6d72d37d6b tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:10:08.376110 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-80d5e370-b2ce-44b7-b228-2f6d72d37d6b tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:10:08.435867 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-80d5e370-b2ce-44b7-b228-2f6d72d37d6b tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6be4749041442787482b6e06b6c40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73f3238988e4e1293ad782712a1da53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 16:10:08.443642 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-80d5e370-b2ce-44b7-b228-2f6d72d37d6b tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] 10.222.0.64 "GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54" status: 200 len: 1350 microversion: 2.1 time: 0.079908 Oct 27 16:10:08.444250 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 884/1835] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 16:10:08 2021] GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54 => generated 1350 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 16:10:09.461251 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-c3ff0798-64e0-43ac-a181-862eb10b6269 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:10:09.461834 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-c3ff0798-64e0-43ac-a181-862eb10b6269 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] [instance: 013da7c4-ac69-4554-827b-d68e9bac0e54] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:10:09.468208 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-c3ff0798-64e0-43ac-a181-862eb10b6269 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:10:09.468650 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-c3ff0798-64e0-43ac-a181-862eb10b6269 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:10:09.469403 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-c3ff0798-64e0-43ac-a181-862eb10b6269 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:10:09.469828 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-c3ff0798-64e0-43ac-a181-862eb10b6269 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:10:09.530088 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-c3ff0798-64e0-43ac-a181-862eb10b6269 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6be4749041442787482b6e06b6c40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73f3238988e4e1293ad782712a1da53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 16:10:09.537948 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-c3ff0798-64e0-43ac-a181-862eb10b6269 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] 10.222.0.64 "GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54" status: 200 len: 1350 microversion: 2.1 time: 0.080295 Oct 27 16:10:09.538452 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 952/1836] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 16:10:09 2021] GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54 => generated 1350 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 16:10:10.555236 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-99f81e5c-3f2e-4c01-9215-274c62152141 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:10:10.555880 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-99f81e5c-3f2e-4c01-9215-274c62152141 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] [instance: 013da7c4-ac69-4554-827b-d68e9bac0e54] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:10:10.563041 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-99f81e5c-3f2e-4c01-9215-274c62152141 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:10:10.563479 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-99f81e5c-3f2e-4c01-9215-274c62152141 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:10:10.564275 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-99f81e5c-3f2e-4c01-9215-274c62152141 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:10:10.564702 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-99f81e5c-3f2e-4c01-9215-274c62152141 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:10:10.627454 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-99f81e5c-3f2e-4c01-9215-274c62152141 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6be4749041442787482b6e06b6c40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73f3238988e4e1293ad782712a1da53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 16:10:10.635769 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-99f81e5c-3f2e-4c01-9215-274c62152141 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] 10.222.0.64 "GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54" status: 200 len: 1350 microversion: 2.1 time: 0.084754 Oct 27 16:10:10.636368 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 885/1837] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 16:10:10 2021] GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54 => generated 1350 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 16:10:11.653005 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-b4920c8f-a137-49e8-a2fa-3f8164c86b28 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:10:11.653644 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-b4920c8f-a137-49e8-a2fa-3f8164c86b28 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] [instance: 013da7c4-ac69-4554-827b-d68e9bac0e54] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:10:11.660140 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-b4920c8f-a137-49e8-a2fa-3f8164c86b28 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:10:11.660581 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-b4920c8f-a137-49e8-a2fa-3f8164c86b28 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:10:11.661333 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-b4920c8f-a137-49e8-a2fa-3f8164c86b28 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:10:11.661756 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-b4920c8f-a137-49e8-a2fa-3f8164c86b28 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:10:11.720994 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-b4920c8f-a137-49e8-a2fa-3f8164c86b28 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6be4749041442787482b6e06b6c40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73f3238988e4e1293ad782712a1da53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 16:10:11.728599 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-b4920c8f-a137-49e8-a2fa-3f8164c86b28 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] 10.222.0.64 "GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54" status: 200 len: 1350 microversion: 2.1 time: 0.079820 Oct 27 16:10:11.729821 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 953/1838] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 16:10:11 2021] GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54 => generated 1350 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 16:10:12.747099 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-4f42b85c-54a7-49b8-8e52-f16d907c0104 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:10:12.747689 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-4f42b85c-54a7-49b8-8e52-f16d907c0104 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] [instance: 013da7c4-ac69-4554-827b-d68e9bac0e54] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:10:12.754210 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-4f42b85c-54a7-49b8-8e52-f16d907c0104 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:10:12.754645 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-4f42b85c-54a7-49b8-8e52-f16d907c0104 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:10:12.755412 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-4f42b85c-54a7-49b8-8e52-f16d907c0104 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:10:12.755835 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-4f42b85c-54a7-49b8-8e52-f16d907c0104 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:10:12.827766 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-4f42b85c-54a7-49b8-8e52-f16d907c0104 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6be4749041442787482b6e06b6c40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73f3238988e4e1293ad782712a1da53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 16:10:12.836953 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-4f42b85c-54a7-49b8-8e52-f16d907c0104 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] 10.222.0.64 "GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54" status: 200 len: 1350 microversion: 2.1 time: 0.094369 Oct 27 16:10:12.837543 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 886/1839] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 16:10:12 2021] GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54 => generated 1350 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 16:10:13.854904 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-219033c3-3e2c-4d6c-81e4-5f62cebe5b81 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:10:13.855814 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-219033c3-3e2c-4d6c-81e4-5f62cebe5b81 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] [instance: 013da7c4-ac69-4554-827b-d68e9bac0e54] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:10:13.864830 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-219033c3-3e2c-4d6c-81e4-5f62cebe5b81 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:10:13.865527 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-219033c3-3e2c-4d6c-81e4-5f62cebe5b81 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:10:13.866586 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-219033c3-3e2c-4d6c-81e4-5f62cebe5b81 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:10:13.867289 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-219033c3-3e2c-4d6c-81e4-5f62cebe5b81 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:10:13.962762 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-219033c3-3e2c-4d6c-81e4-5f62cebe5b81 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6be4749041442787482b6e06b6c40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73f3238988e4e1293ad782712a1da53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 16:10:13.972603 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-219033c3-3e2c-4d6c-81e4-5f62cebe5b81 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] 10.222.0.64 "GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54" status: 200 len: 1350 microversion: 2.1 time: 0.121967 Oct 27 16:10:13.973232 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 954/1840] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 16:10:13 2021] GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54 => generated 1350 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 16:10:14.992765 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-643cfe90-36db-4f99-a98b-8ac712026621 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:10:14.993653 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-643cfe90-36db-4f99-a98b-8ac712026621 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] [instance: 013da7c4-ac69-4554-827b-d68e9bac0e54] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:10:15.000986 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-643cfe90-36db-4f99-a98b-8ac712026621 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:10:15.001482 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-643cfe90-36db-4f99-a98b-8ac712026621 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:10:15.002524 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-643cfe90-36db-4f99-a98b-8ac712026621 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:10:15.003021 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-643cfe90-36db-4f99-a98b-8ac712026621 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:10:15.082743 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-643cfe90-36db-4f99-a98b-8ac712026621 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6be4749041442787482b6e06b6c40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73f3238988e4e1293ad782712a1da53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 16:10:15.097757 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-643cfe90-36db-4f99-a98b-8ac712026621 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] 10.222.0.64 "GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54" status: 200 len: 1350 microversion: 2.1 time: 0.108846 Oct 27 16:10:15.098758 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 887/1841] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 16:10:14 2021] GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54 => generated 1350 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 16:10:16.261978 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-c32baa2e-2179-43f3-84f4-b9957fc36d78 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:10:16.262699 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-c32baa2e-2179-43f3-84f4-b9957fc36d78 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] [instance: 013da7c4-ac69-4554-827b-d68e9bac0e54] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:10:16.269230 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-c32baa2e-2179-43f3-84f4-b9957fc36d78 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:10:16.269754 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-c32baa2e-2179-43f3-84f4-b9957fc36d78 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:10:16.270596 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-c32baa2e-2179-43f3-84f4-b9957fc36d78 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:10:16.271029 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-c32baa2e-2179-43f3-84f4-b9957fc36d78 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:10:16.344811 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-c32baa2e-2179-43f3-84f4-b9957fc36d78 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6be4749041442787482b6e06b6c40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73f3238988e4e1293ad782712a1da53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 16:10:16.354022 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-c32baa2e-2179-43f3-84f4-b9957fc36d78 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] 10.222.0.64 "GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54" status: 200 len: 1350 microversion: 2.1 time: 0.240442 Oct 27 16:10:16.354814 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 955/1842] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 16:10:16 2021] GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54 => generated 1350 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 16:10:17.373901 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-3bf458bd-0060-4f29-8c93-0c1ef5e54d5e tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:10:17.374846 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-3bf458bd-0060-4f29-8c93-0c1ef5e54d5e tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] [instance: 013da7c4-ac69-4554-827b-d68e9bac0e54] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:10:17.384770 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-3bf458bd-0060-4f29-8c93-0c1ef5e54d5e tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:10:17.385819 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-3bf458bd-0060-4f29-8c93-0c1ef5e54d5e tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:10:17.386905 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-3bf458bd-0060-4f29-8c93-0c1ef5e54d5e tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:10:17.387416 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-3bf458bd-0060-4f29-8c93-0c1ef5e54d5e tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:10:17.624705 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-3bf458bd-0060-4f29-8c93-0c1ef5e54d5e tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6be4749041442787482b6e06b6c40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73f3238988e4e1293ad782712a1da53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 16:10:17.634731 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-3bf458bd-0060-4f29-8c93-0c1ef5e54d5e tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] 10.222.0.64 "GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54" status: 200 len: 1350 microversion: 2.1 time: 0.265190 Oct 27 16:10:17.636333 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 888/1843] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 16:10:17 2021] GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54 => generated 1350 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 16:10:18.654771 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-ad9cec70-ab5e-45b5-9a13-20b29485a469 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:10:18.655395 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-ad9cec70-ab5e-45b5-9a13-20b29485a469 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] [instance: 013da7c4-ac69-4554-827b-d68e9bac0e54] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:10:18.661462 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-ad9cec70-ab5e-45b5-9a13-20b29485a469 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:10:18.661896 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-ad9cec70-ab5e-45b5-9a13-20b29485a469 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:10:18.662669 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-ad9cec70-ab5e-45b5-9a13-20b29485a469 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:10:18.663094 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-ad9cec70-ab5e-45b5-9a13-20b29485a469 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:10:18.822049 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-ad9cec70-ab5e-45b5-9a13-20b29485a469 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6be4749041442787482b6e06b6c40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73f3238988e4e1293ad782712a1da53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 16:10:18.832320 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-ad9cec70-ab5e-45b5-9a13-20b29485a469 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] 10.222.0.64 "GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54" status: 200 len: 1350 microversion: 2.1 time: 0.181236 Oct 27 16:10:18.833107 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 956/1844] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 16:10:18 2021] GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54 => generated 1350 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 16:10:19.851467 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-7d770ce0-f71a-43fc-9c41-c9c65217f387 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:10:19.852349 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-7d770ce0-f71a-43fc-9c41-c9c65217f387 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] [instance: 013da7c4-ac69-4554-827b-d68e9bac0e54] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:10:19.859840 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-7d770ce0-f71a-43fc-9c41-c9c65217f387 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:10:19.860309 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-7d770ce0-f71a-43fc-9c41-c9c65217f387 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:10:19.861080 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-7d770ce0-f71a-43fc-9c41-c9c65217f387 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:10:19.861506 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-7d770ce0-f71a-43fc-9c41-c9c65217f387 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:10:19.929848 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-7d770ce0-f71a-43fc-9c41-c9c65217f387 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6be4749041442787482b6e06b6c40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73f3238988e4e1293ad782712a1da53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 16:10:19.939686 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-7d770ce0-f71a-43fc-9c41-c9c65217f387 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] 10.222.0.64 "GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54" status: 200 len: 1350 microversion: 2.1 time: 0.091949 Oct 27 16:10:19.940706 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 889/1845] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 16:10:19 2021] GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54 => generated 1350 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 16:10:20.963588 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-624745d5-9844-4edf-879d-a4e31030383a tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:10:20.964671 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-624745d5-9844-4edf-879d-a4e31030383a tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] [instance: 013da7c4-ac69-4554-827b-d68e9bac0e54] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:10:20.971257 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-624745d5-9844-4edf-879d-a4e31030383a tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:10:20.971757 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-624745d5-9844-4edf-879d-a4e31030383a tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:10:20.972650 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-624745d5-9844-4edf-879d-a4e31030383a tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:10:20.973132 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-624745d5-9844-4edf-879d-a4e31030383a tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:10:21.065271 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-624745d5-9844-4edf-879d-a4e31030383a tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6be4749041442787482b6e06b6c40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73f3238988e4e1293ad782712a1da53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 16:10:21.075428 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-624745d5-9844-4edf-879d-a4e31030383a tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] 10.222.0.64 "GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54" status: 200 len: 1350 microversion: 2.1 time: 0.115560 Oct 27 16:10:21.076171 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 957/1846] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 16:10:20 2021] GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54 => generated 1350 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 16:10:22.097406 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-a679fd05-e280-4322-a6d7-3684e6a89b7c tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:10:22.098178 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-a679fd05-e280-4322-a6d7-3684e6a89b7c tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] [instance: 013da7c4-ac69-4554-827b-d68e9bac0e54] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:10:22.108094 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-a679fd05-e280-4322-a6d7-3684e6a89b7c tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:10:22.108897 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-a679fd05-e280-4322-a6d7-3684e6a89b7c tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:10:22.110389 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-a679fd05-e280-4322-a6d7-3684e6a89b7c tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:10:22.111184 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-a679fd05-e280-4322-a6d7-3684e6a89b7c tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:10:22.187366 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-a679fd05-e280-4322-a6d7-3684e6a89b7c tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6be4749041442787482b6e06b6c40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73f3238988e4e1293ad782712a1da53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 16:10:22.200108 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-a679fd05-e280-4322-a6d7-3684e6a89b7c tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] 10.222.0.64 "GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54" status: 200 len: 1350 microversion: 2.1 time: 0.108679 Oct 27 16:10:22.202925 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 890/1847] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 16:10:22 2021] GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54 => generated 1350 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 16:10:23.228310 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-1f8d47ba-ec18-40cb-a4ea-78723ab7cef9 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:10:23.229871 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-1f8d47ba-ec18-40cb-a4ea-78723ab7cef9 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] [instance: 013da7c4-ac69-4554-827b-d68e9bac0e54] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:10:23.237691 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-1f8d47ba-ec18-40cb-a4ea-78723ab7cef9 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:10:23.238134 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-1f8d47ba-ec18-40cb-a4ea-78723ab7cef9 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:10:23.238930 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-1f8d47ba-ec18-40cb-a4ea-78723ab7cef9 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:10:23.239526 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-1f8d47ba-ec18-40cb-a4ea-78723ab7cef9 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:10:23.331252 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-1f8d47ba-ec18-40cb-a4ea-78723ab7cef9 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6be4749041442787482b6e06b6c40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73f3238988e4e1293ad782712a1da53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 16:10:23.343360 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-1f8d47ba-ec18-40cb-a4ea-78723ab7cef9 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] 10.222.0.64 "GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54" status: 200 len: 1350 microversion: 2.1 time: 0.119840 Oct 27 16:10:23.344467 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 958/1848] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 16:10:23 2021] GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54 => generated 1350 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 16:10:24.369572 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-ad38ee00-6bda-4a11-8042-c2cd6bbf4ee2 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:10:24.370381 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-ad38ee00-6bda-4a11-8042-c2cd6bbf4ee2 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] [instance: 013da7c4-ac69-4554-827b-d68e9bac0e54] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:10:24.376867 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-ad38ee00-6bda-4a11-8042-c2cd6bbf4ee2 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:10:24.377299 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-ad38ee00-6bda-4a11-8042-c2cd6bbf4ee2 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:10:24.378066 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-ad38ee00-6bda-4a11-8042-c2cd6bbf4ee2 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:10:24.378492 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-ad38ee00-6bda-4a11-8042-c2cd6bbf4ee2 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:10:24.448758 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-ad38ee00-6bda-4a11-8042-c2cd6bbf4ee2 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6be4749041442787482b6e06b6c40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73f3238988e4e1293ad782712a1da53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 16:10:24.457551 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-ad38ee00-6bda-4a11-8042-c2cd6bbf4ee2 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] 10.222.0.64 "GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54" status: 200 len: 1350 microversion: 2.1 time: 0.092106 Oct 27 16:10:24.458553 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 891/1849] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 16:10:24 2021] GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54 => generated 1350 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 16:10:25.486357 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-dc17656e-21a6-4dd9-be62-e6f5f4542e72 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:10:25.487015 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-dc17656e-21a6-4dd9-be62-e6f5f4542e72 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] [instance: 013da7c4-ac69-4554-827b-d68e9bac0e54] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:10:25.493676 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-dc17656e-21a6-4dd9-be62-e6f5f4542e72 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:10:25.495061 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-dc17656e-21a6-4dd9-be62-e6f5f4542e72 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:10:25.495979 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-dc17656e-21a6-4dd9-be62-e6f5f4542e72 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:10:25.496581 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-dc17656e-21a6-4dd9-be62-e6f5f4542e72 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:10:25.589880 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-dc17656e-21a6-4dd9-be62-e6f5f4542e72 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6be4749041442787482b6e06b6c40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73f3238988e4e1293ad782712a1da53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 16:10:25.598240 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-dc17656e-21a6-4dd9-be62-e6f5f4542e72 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] 10.222.0.64 "GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54" status: 200 len: 1350 microversion: 2.1 time: 0.116589 Oct 27 16:10:25.598823 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 959/1850] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 16:10:25 2021] GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54 => generated 1350 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 16:10:26.617266 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-025aa826-051d-4333-8807-482d61a27468 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:10:26.617893 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-025aa826-051d-4333-8807-482d61a27468 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] [instance: 013da7c4-ac69-4554-827b-d68e9bac0e54] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:10:26.625125 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-025aa826-051d-4333-8807-482d61a27468 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:10:26.625589 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-025aa826-051d-4333-8807-482d61a27468 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:10:26.626349 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-025aa826-051d-4333-8807-482d61a27468 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:10:26.626779 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-025aa826-051d-4333-8807-482d61a27468 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:10:26.694780 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-025aa826-051d-4333-8807-482d61a27468 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6be4749041442787482b6e06b6c40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73f3238988e4e1293ad782712a1da53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 16:10:26.704473 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-025aa826-051d-4333-8807-482d61a27468 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] 10.222.0.64 "GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54" status: 200 len: 1350 microversion: 2.1 time: 0.091047 Oct 27 16:10:26.705078 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 892/1851] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 16:10:26 2021] GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54 => generated 1350 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 16:10:27.730641 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-f12fee60-843c-4556-9784-85e463f7e133 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:10:27.731346 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-f12fee60-843c-4556-9784-85e463f7e133 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] [instance: 013da7c4-ac69-4554-827b-d68e9bac0e54] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:10:27.737449 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-f12fee60-843c-4556-9784-85e463f7e133 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:10:27.737923 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-f12fee60-843c-4556-9784-85e463f7e133 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:10:27.738700 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-f12fee60-843c-4556-9784-85e463f7e133 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:10:27.739171 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-f12fee60-843c-4556-9784-85e463f7e133 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:10:27.798822 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-f12fee60-843c-4556-9784-85e463f7e133 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6be4749041442787482b6e06b6c40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73f3238988e4e1293ad782712a1da53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 16:10:27.807229 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-f12fee60-843c-4556-9784-85e463f7e133 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] 10.222.0.64 "GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54" status: 200 len: 1350 microversion: 2.1 time: 0.080479 Oct 27 16:10:27.807794 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 960/1852] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 16:10:27 2021] GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54 => generated 1350 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 16:10:28.831111 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-f4bbc2af-8a79-4c6c-92b6-8f23468b9cd0 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:10:28.832135 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-f4bbc2af-8a79-4c6c-92b6-8f23468b9cd0 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] [instance: 013da7c4-ac69-4554-827b-d68e9bac0e54] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:10:28.838932 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-f4bbc2af-8a79-4c6c-92b6-8f23468b9cd0 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:10:28.839460 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-f4bbc2af-8a79-4c6c-92b6-8f23468b9cd0 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:10:28.840519 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-f4bbc2af-8a79-4c6c-92b6-8f23468b9cd0 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:10:28.841054 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-f4bbc2af-8a79-4c6c-92b6-8f23468b9cd0 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:10:28.920369 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-f4bbc2af-8a79-4c6c-92b6-8f23468b9cd0 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6be4749041442787482b6e06b6c40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73f3238988e4e1293ad782712a1da53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 16:10:28.929114 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-f4bbc2af-8a79-4c6c-92b6-8f23468b9cd0 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] 10.222.0.64 "GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54" status: 200 len: 1350 microversion: 2.1 time: 0.102291 Oct 27 16:10:28.929693 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 893/1853] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 16:10:28 2021] GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54 => generated 1350 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 16:10:29.946743 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-2d389ece-2428-4bfb-a9f1-ebae113330bd tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:10:29.947372 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-2d389ece-2428-4bfb-a9f1-ebae113330bd tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] [instance: 013da7c4-ac69-4554-827b-d68e9bac0e54] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:10:29.954494 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-2d389ece-2428-4bfb-a9f1-ebae113330bd tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:10:29.954991 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-2d389ece-2428-4bfb-a9f1-ebae113330bd tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:10:29.955881 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-2d389ece-2428-4bfb-a9f1-ebae113330bd tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:10:29.956366 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-2d389ece-2428-4bfb-a9f1-ebae113330bd tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:10:30.025784 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-2d389ece-2428-4bfb-a9f1-ebae113330bd tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6be4749041442787482b6e06b6c40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73f3238988e4e1293ad782712a1da53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 16:10:30.034085 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-2d389ece-2428-4bfb-a9f1-ebae113330bd tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] 10.222.0.64 "GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54" status: 200 len: 1350 microversion: 2.1 time: 0.091203 Oct 27 16:10:30.034665 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 961/1854] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 16:10:29 2021] GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54 => generated 1350 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 16:10:31.052419 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-08f0d2c3-4d09-470a-9e25-ebea52b7b87f tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:10:31.053112 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-08f0d2c3-4d09-470a-9e25-ebea52b7b87f tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] [instance: 013da7c4-ac69-4554-827b-d68e9bac0e54] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:10:31.059875 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-08f0d2c3-4d09-470a-9e25-ebea52b7b87f tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:10:31.060353 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-08f0d2c3-4d09-470a-9e25-ebea52b7b87f tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:10:31.061125 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-08f0d2c3-4d09-470a-9e25-ebea52b7b87f tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:10:31.061560 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-08f0d2c3-4d09-470a-9e25-ebea52b7b87f tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:10:31.135486 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-08f0d2c3-4d09-470a-9e25-ebea52b7b87f tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6be4749041442787482b6e06b6c40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73f3238988e4e1293ad782712a1da53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 16:10:31.143769 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-08f0d2c3-4d09-470a-9e25-ebea52b7b87f tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] 10.222.0.64 "GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54" status: 200 len: 1350 microversion: 2.1 time: 0.095340 Oct 27 16:10:31.144384 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 894/1855] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 16:10:31 2021] GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54 => generated 1350 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 16:10:32.161469 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-81ad1738-94ae-473a-971b-2eee5276e897 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:10:32.162239 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-81ad1738-94ae-473a-971b-2eee5276e897 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] [instance: 013da7c4-ac69-4554-827b-d68e9bac0e54] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:10:32.168902 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-81ad1738-94ae-473a-971b-2eee5276e897 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:10:32.169340 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-81ad1738-94ae-473a-971b-2eee5276e897 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:10:32.170116 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-81ad1738-94ae-473a-971b-2eee5276e897 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:10:32.170549 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-81ad1738-94ae-473a-971b-2eee5276e897 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:10:32.240006 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-81ad1738-94ae-473a-971b-2eee5276e897 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6be4749041442787482b6e06b6c40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73f3238988e4e1293ad782712a1da53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 16:10:32.248714 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-81ad1738-94ae-473a-971b-2eee5276e897 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] 10.222.0.64 "GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54" status: 200 len: 1350 microversion: 2.1 time: 0.091033 Oct 27 16:10:32.249296 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 962/1856] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 16:10:32 2021] GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54 => generated 1350 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 16:10:33.267376 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-861540cd-b810-471a-8651-2030ce2aa9a2 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:10:33.268195 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-861540cd-b810-471a-8651-2030ce2aa9a2 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] [instance: 013da7c4-ac69-4554-827b-d68e9bac0e54] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:10:33.274567 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-861540cd-b810-471a-8651-2030ce2aa9a2 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:10:33.275054 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-861540cd-b810-471a-8651-2030ce2aa9a2 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:10:33.275997 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-861540cd-b810-471a-8651-2030ce2aa9a2 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:10:33.276472 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-861540cd-b810-471a-8651-2030ce2aa9a2 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:10:33.371272 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-861540cd-b810-471a-8651-2030ce2aa9a2 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6be4749041442787482b6e06b6c40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73f3238988e4e1293ad782712a1da53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 16:10:33.380764 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-861540cd-b810-471a-8651-2030ce2aa9a2 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] 10.222.0.64 "GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54" status: 200 len: 1350 microversion: 2.1 time: 0.116857 Oct 27 16:10:33.387925 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 895/1857] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 16:10:33 2021] GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54 => generated 1350 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 16:10:34.403734 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-11b863eb-369d-481a-b5ec-fa53c6d9b23b tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:10:34.404759 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-11b863eb-369d-481a-b5ec-fa53c6d9b23b tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] [instance: 013da7c4-ac69-4554-827b-d68e9bac0e54] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:10:34.411813 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-11b863eb-369d-481a-b5ec-fa53c6d9b23b tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:10:34.412470 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-11b863eb-369d-481a-b5ec-fa53c6d9b23b tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:10:34.413269 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-11b863eb-369d-481a-b5ec-fa53c6d9b23b tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:10:34.413699 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-11b863eb-369d-481a-b5ec-fa53c6d9b23b tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:10:34.641691 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-11b863eb-369d-481a-b5ec-fa53c6d9b23b tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6be4749041442787482b6e06b6c40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73f3238988e4e1293ad782712a1da53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 16:10:34.650000 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-11b863eb-369d-481a-b5ec-fa53c6d9b23b tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] 10.222.0.64 "GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54" status: 200 len: 1350 microversion: 2.1 time: 0.251503 Oct 27 16:10:34.650776 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 963/1858] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 16:10:34 2021] GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54 => generated 1350 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 16:10:35.668036 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-681003f4-912e-4c0b-b089-b7e71add3c41 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:10:35.668723 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-681003f4-912e-4c0b-b089-b7e71add3c41 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] [instance: 013da7c4-ac69-4554-827b-d68e9bac0e54] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:10:35.675524 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-681003f4-912e-4c0b-b089-b7e71add3c41 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:10:35.676008 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-681003f4-912e-4c0b-b089-b7e71add3c41 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:10:35.676818 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-681003f4-912e-4c0b-b089-b7e71add3c41 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:10:35.677272 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-681003f4-912e-4c0b-b089-b7e71add3c41 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:10:35.745132 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-681003f4-912e-4c0b-b089-b7e71add3c41 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6be4749041442787482b6e06b6c40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73f3238988e4e1293ad782712a1da53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 16:10:35.754892 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-681003f4-912e-4c0b-b089-b7e71add3c41 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] 10.222.0.64 "GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54" status: 200 len: 1350 microversion: 2.1 time: 0.091006 Oct 27 16:10:35.755691 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 896/1859] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 16:10:35 2021] GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54 => generated 1350 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 16:10:36.773453 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-5dad5b29-a772-4204-9409-e5a3416dfd68 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:10:36.774012 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-5dad5b29-a772-4204-9409-e5a3416dfd68 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] [instance: 013da7c4-ac69-4554-827b-d68e9bac0e54] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:10:36.781175 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-5dad5b29-a772-4204-9409-e5a3416dfd68 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:10:36.781665 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-5dad5b29-a772-4204-9409-e5a3416dfd68 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:10:36.782478 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-5dad5b29-a772-4204-9409-e5a3416dfd68 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:10:36.782944 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-5dad5b29-a772-4204-9409-e5a3416dfd68 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:10:36.858657 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-5dad5b29-a772-4204-9409-e5a3416dfd68 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6be4749041442787482b6e06b6c40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73f3238988e4e1293ad782712a1da53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 16:10:36.871559 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-5dad5b29-a772-4204-9409-e5a3416dfd68 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] 10.222.0.64 "GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54" status: 200 len: 1350 microversion: 2.1 time: 0.101521 Oct 27 16:10:36.872185 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 964/1860] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 16:10:36 2021] GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54 => generated 1350 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 16:10:37.892075 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-6137ddc5-f1ac-4283-bf6e-75d6ca3ce28f tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:10:37.892981 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-6137ddc5-f1ac-4283-bf6e-75d6ca3ce28f tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] [instance: 013da7c4-ac69-4554-827b-d68e9bac0e54] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:10:37.903249 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-6137ddc5-f1ac-4283-bf6e-75d6ca3ce28f tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:10:37.903943 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-6137ddc5-f1ac-4283-bf6e-75d6ca3ce28f tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:10:37.905159 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-6137ddc5-f1ac-4283-bf6e-75d6ca3ce28f tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:10:37.905810 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-6137ddc5-f1ac-4283-bf6e-75d6ca3ce28f tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:10:37.991117 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-6137ddc5-f1ac-4283-bf6e-75d6ca3ce28f tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6be4749041442787482b6e06b6c40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73f3238988e4e1293ad782712a1da53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 16:10:38.001318 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-6137ddc5-f1ac-4283-bf6e-75d6ca3ce28f tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] 10.222.0.64 "GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54" status: 200 len: 1350 microversion: 2.1 time: 0.115453 Oct 27 16:10:38.002200 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 897/1861] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 16:10:37 2021] GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54 => generated 1350 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 16:10:39.022845 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-cc6cef13-0af4-4bb5-92d2-748b709f29cc tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:10:39.023952 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-cc6cef13-0af4-4bb5-92d2-748b709f29cc tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] [instance: 013da7c4-ac69-4554-827b-d68e9bac0e54] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:10:39.035597 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-cc6cef13-0af4-4bb5-92d2-748b709f29cc tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:10:39.036416 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-cc6cef13-0af4-4bb5-92d2-748b709f29cc tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:10:39.037820 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-cc6cef13-0af4-4bb5-92d2-748b709f29cc tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:10:39.038597 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-cc6cef13-0af4-4bb5-92d2-748b709f29cc tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:10:39.112335 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-cc6cef13-0af4-4bb5-92d2-748b709f29cc tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6be4749041442787482b6e06b6c40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73f3238988e4e1293ad782712a1da53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 16:10:39.122685 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-cc6cef13-0af4-4bb5-92d2-748b709f29cc tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] 10.222.0.64 "GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54" status: 200 len: 1350 microversion: 2.1 time: 0.106371 Oct 27 16:10:39.123631 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 965/1862] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 16:10:39 2021] GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54 => generated 1350 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 16:10:40.146060 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-16f29feb-7c00-46d9-92c1-4ccf33d902c0 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:10:40.146803 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-16f29feb-7c00-46d9-92c1-4ccf33d902c0 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] [instance: 013da7c4-ac69-4554-827b-d68e9bac0e54] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:10:40.155064 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-16f29feb-7c00-46d9-92c1-4ccf33d902c0 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:10:40.155512 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-16f29feb-7c00-46d9-92c1-4ccf33d902c0 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:10:40.156481 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-16f29feb-7c00-46d9-92c1-4ccf33d902c0 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:10:40.157223 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-16f29feb-7c00-46d9-92c1-4ccf33d902c0 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:10:40.229929 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-16f29feb-7c00-46d9-92c1-4ccf33d902c0 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6be4749041442787482b6e06b6c40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73f3238988e4e1293ad782712a1da53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 16:10:40.244708 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-16f29feb-7c00-46d9-92c1-4ccf33d902c0 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] 10.222.0.64 "GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54" status: 200 len: 1350 microversion: 2.1 time: 0.104439 Oct 27 16:10:40.245694 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 898/1863] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 16:10:40 2021] GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54 => generated 1350 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 16:10:41.276903 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-dd7c90c2-6eda-47a4-8130-68798b41e79e tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:10:41.279125 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-dd7c90c2-6eda-47a4-8130-68798b41e79e tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] [instance: 013da7c4-ac69-4554-827b-d68e9bac0e54] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:10:41.290919 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-dd7c90c2-6eda-47a4-8130-68798b41e79e tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:10:41.291702 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-dd7c90c2-6eda-47a4-8130-68798b41e79e tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:10:41.293535 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-dd7c90c2-6eda-47a4-8130-68798b41e79e tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:10:41.294551 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-dd7c90c2-6eda-47a4-8130-68798b41e79e tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:10:41.383392 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-dd7c90c2-6eda-47a4-8130-68798b41e79e tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6be4749041442787482b6e06b6c40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73f3238988e4e1293ad782712a1da53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 16:10:41.393860 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-dd7c90c2-6eda-47a4-8130-68798b41e79e tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] 10.222.0.64 "GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54" status: 200 len: 1350 microversion: 2.1 time: 0.126530 Oct 27 16:10:41.394581 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 966/1864] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 16:10:41 2021] GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54 => generated 1350 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 16:10:42.413417 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-441e8113-4cea-4b88-aa84-a7b5cfb3d485 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:10:42.414135 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-441e8113-4cea-4b88-aa84-a7b5cfb3d485 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] [instance: 013da7c4-ac69-4554-827b-d68e9bac0e54] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:10:42.420403 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-441e8113-4cea-4b88-aa84-a7b5cfb3d485 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:10:42.420845 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-441e8113-4cea-4b88-aa84-a7b5cfb3d485 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:10:42.421619 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-441e8113-4cea-4b88-aa84-a7b5cfb3d485 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:10:42.422048 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-441e8113-4cea-4b88-aa84-a7b5cfb3d485 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:10:42.486774 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-441e8113-4cea-4b88-aa84-a7b5cfb3d485 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6be4749041442787482b6e06b6c40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73f3238988e4e1293ad782712a1da53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 16:10:42.495538 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-441e8113-4cea-4b88-aa84-a7b5cfb3d485 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] 10.222.0.64 "GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54" status: 200 len: 1350 microversion: 2.1 time: 0.085746 Oct 27 16:10:42.496166 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 899/1865] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 16:10:42 2021] GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54 => generated 1350 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 16:10:43.513953 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-2ebf93b5-833e-4634-a416-cc486c107d41 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:10:43.514556 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-2ebf93b5-833e-4634-a416-cc486c107d41 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] [instance: 013da7c4-ac69-4554-827b-d68e9bac0e54] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:10:43.520805 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-2ebf93b5-833e-4634-a416-cc486c107d41 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:10:43.521247 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-2ebf93b5-833e-4634-a416-cc486c107d41 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:10:43.522012 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-2ebf93b5-833e-4634-a416-cc486c107d41 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:10:43.522437 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-2ebf93b5-833e-4634-a416-cc486c107d41 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:10:43.584345 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-2ebf93b5-833e-4634-a416-cc486c107d41 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6be4749041442787482b6e06b6c40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73f3238988e4e1293ad782712a1da53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 16:10:43.595560 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-2ebf93b5-833e-4634-a416-cc486c107d41 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] 10.222.0.64 "GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54" status: 200 len: 1350 microversion: 2.1 time: 0.086376 Oct 27 16:10:43.596189 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 967/1866] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 16:10:43 2021] GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54 => generated 1350 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 16:10:44.612870 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-2f87c876-011a-42e4-97a2-c47876d867db tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:10:44.613485 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-2f87c876-011a-42e4-97a2-c47876d867db tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] [instance: 013da7c4-ac69-4554-827b-d68e9bac0e54] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:10:44.621045 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-2f87c876-011a-42e4-97a2-c47876d867db tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:10:44.621483 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-2f87c876-011a-42e4-97a2-c47876d867db tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:10:44.622255 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-2f87c876-011a-42e4-97a2-c47876d867db tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:10:44.622678 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-2f87c876-011a-42e4-97a2-c47876d867db tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:10:44.688874 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-2f87c876-011a-42e4-97a2-c47876d867db tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6be4749041442787482b6e06b6c40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73f3238988e4e1293ad782712a1da53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 16:10:44.697456 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-2f87c876-011a-42e4-97a2-c47876d867db tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] 10.222.0.64 "GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54" status: 200 len: 1350 microversion: 2.1 time: 0.087656 Oct 27 16:10:44.698130 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 900/1867] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 16:10:44 2021] GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54 => generated 1350 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 16:10:45.715089 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-c354da52-4d42-4238-8188-a6cf8ffef7f7 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:10:45.715672 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-c354da52-4d42-4238-8188-a6cf8ffef7f7 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] [instance: 013da7c4-ac69-4554-827b-d68e9bac0e54] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:10:45.721959 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-c354da52-4d42-4238-8188-a6cf8ffef7f7 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:10:45.722427 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-c354da52-4d42-4238-8188-a6cf8ffef7f7 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:10:45.723169 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-c354da52-4d42-4238-8188-a6cf8ffef7f7 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:10:45.723601 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-c354da52-4d42-4238-8188-a6cf8ffef7f7 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:10:45.787408 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-c354da52-4d42-4238-8188-a6cf8ffef7f7 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6be4749041442787482b6e06b6c40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73f3238988e4e1293ad782712a1da53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 16:10:45.796343 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-c354da52-4d42-4238-8188-a6cf8ffef7f7 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] 10.222.0.64 "GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54" status: 200 len: 1350 microversion: 2.1 time: 0.085600 Oct 27 16:10:45.796921 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 968/1868] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 16:10:45 2021] GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54 => generated 1350 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 16:10:46.813497 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-508e0404-dcdf-4910-a2cc-c76596ee48a3 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:10:46.814057 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-508e0404-dcdf-4910-a2cc-c76596ee48a3 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] [instance: 013da7c4-ac69-4554-827b-d68e9bac0e54] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:10:46.820359 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-508e0404-dcdf-4910-a2cc-c76596ee48a3 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:10:46.820810 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-508e0404-dcdf-4910-a2cc-c76596ee48a3 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:10:46.821580 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-508e0404-dcdf-4910-a2cc-c76596ee48a3 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:10:46.822014 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-508e0404-dcdf-4910-a2cc-c76596ee48a3 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:10:46.884401 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-508e0404-dcdf-4910-a2cc-c76596ee48a3 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6be4749041442787482b6e06b6c40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73f3238988e4e1293ad782712a1da53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 16:10:46.892370 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-508e0404-dcdf-4910-a2cc-c76596ee48a3 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] 10.222.0.64 "GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54" status: 200 len: 1350 microversion: 2.1 time: 0.082595 Oct 27 16:10:46.892944 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 901/1869] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 16:10:46 2021] GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54 => generated 1350 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 16:10:47.909126 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-8b8cf5cd-0cb3-4c43-82e0-291b932e4e63 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:10:47.909677 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-8b8cf5cd-0cb3-4c43-82e0-291b932e4e63 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] [instance: 013da7c4-ac69-4554-827b-d68e9bac0e54] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:10:47.916828 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-8b8cf5cd-0cb3-4c43-82e0-291b932e4e63 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:10:47.917305 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-8b8cf5cd-0cb3-4c43-82e0-291b932e4e63 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:10:47.918115 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-8b8cf5cd-0cb3-4c43-82e0-291b932e4e63 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:10:47.918569 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-8b8cf5cd-0cb3-4c43-82e0-291b932e4e63 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:10:47.983416 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-8b8cf5cd-0cb3-4c43-82e0-291b932e4e63 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6be4749041442787482b6e06b6c40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73f3238988e4e1293ad782712a1da53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 16:10:47.991403 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-8b8cf5cd-0cb3-4c43-82e0-291b932e4e63 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] 10.222.0.64 "GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54" status: 200 len: 1350 microversion: 2.1 time: 0.086242 Oct 27 16:10:47.991997 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 969/1870] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 16:10:47 2021] GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54 => generated 1350 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 16:10:49.009505 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-94318764-cdf2-4bc1-9769-99f47f88f2d7 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:10:49.010231 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-94318764-cdf2-4bc1-9769-99f47f88f2d7 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] [instance: 013da7c4-ac69-4554-827b-d68e9bac0e54] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:10:49.016400 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-94318764-cdf2-4bc1-9769-99f47f88f2d7 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:10:49.016843 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-94318764-cdf2-4bc1-9769-99f47f88f2d7 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:10:49.017594 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-94318764-cdf2-4bc1-9769-99f47f88f2d7 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:10:49.018019 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-94318764-cdf2-4bc1-9769-99f47f88f2d7 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:10:49.079337 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-94318764-cdf2-4bc1-9769-99f47f88f2d7 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6be4749041442787482b6e06b6c40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73f3238988e4e1293ad782712a1da53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 16:10:49.087504 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-94318764-cdf2-4bc1-9769-99f47f88f2d7 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] 10.222.0.64 "GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54" status: 200 len: 1350 microversion: 2.1 time: 0.082129 Oct 27 16:10:49.088109 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 902/1871] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 16:10:49 2021] GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54 => generated 1350 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 16:10:50.104628 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-7641c219-9afd-4405-8c3e-1b3db0e8a972 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:10:50.105234 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-7641c219-9afd-4405-8c3e-1b3db0e8a972 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] [instance: 013da7c4-ac69-4554-827b-d68e9bac0e54] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:10:50.111217 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-7641c219-9afd-4405-8c3e-1b3db0e8a972 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:10:50.111658 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-7641c219-9afd-4405-8c3e-1b3db0e8a972 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:10:50.112454 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-7641c219-9afd-4405-8c3e-1b3db0e8a972 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:10:50.112991 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-7641c219-9afd-4405-8c3e-1b3db0e8a972 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:10:50.174654 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-7641c219-9afd-4405-8c3e-1b3db0e8a972 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6be4749041442787482b6e06b6c40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73f3238988e4e1293ad782712a1da53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 16:10:50.186186 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-7641c219-9afd-4405-8c3e-1b3db0e8a972 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] 10.222.0.64 "GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54" status: 200 len: 1350 microversion: 2.1 time: 0.084029 Oct 27 16:10:50.186186 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 970/1872] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 16:10:50 2021] GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54 => generated 1350 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 16:10:51.201587 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-7005d8c0-0306-481b-b07a-bdbdce2e8bee tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:10:51.202188 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-7005d8c0-0306-481b-b07a-bdbdce2e8bee tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] [instance: 013da7c4-ac69-4554-827b-d68e9bac0e54] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:10:51.208444 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-7005d8c0-0306-481b-b07a-bdbdce2e8bee tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:10:51.208889 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-7005d8c0-0306-481b-b07a-bdbdce2e8bee tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:10:51.209656 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-7005d8c0-0306-481b-b07a-bdbdce2e8bee tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:10:51.210082 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-7005d8c0-0306-481b-b07a-bdbdce2e8bee tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:10:51.288734 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-7005d8c0-0306-481b-b07a-bdbdce2e8bee tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6be4749041442787482b6e06b6c40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73f3238988e4e1293ad782712a1da53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 16:10:51.297378 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-7005d8c0-0306-481b-b07a-bdbdce2e8bee tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] 10.222.0.64 "GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54" status: 200 len: 1350 microversion: 2.1 time: 0.099713 Oct 27 16:10:51.297957 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 903/1873] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 16:10:51 2021] GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54 => generated 1350 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 16:10:52.315838 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-891de690-bbec-4eb9-bd03-7f3c2badb673 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:10:52.316595 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-891de690-bbec-4eb9-bd03-7f3c2badb673 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] [instance: 013da7c4-ac69-4554-827b-d68e9bac0e54] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:10:52.323647 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-891de690-bbec-4eb9-bd03-7f3c2badb673 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:10:52.324111 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-891de690-bbec-4eb9-bd03-7f3c2badb673 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:10:52.324891 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-891de690-bbec-4eb9-bd03-7f3c2badb673 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:10:52.325368 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-891de690-bbec-4eb9-bd03-7f3c2badb673 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:10:52.390890 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-891de690-bbec-4eb9-bd03-7f3c2badb673 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6be4749041442787482b6e06b6c40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73f3238988e4e1293ad782712a1da53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 16:10:52.399004 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-891de690-bbec-4eb9-bd03-7f3c2badb673 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] 10.222.0.64 "GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54" status: 200 len: 1350 microversion: 2.1 time: 0.086838 Oct 27 16:10:52.399677 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 971/1874] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 16:10:52 2021] GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54 => generated 1350 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 16:10:53.418082 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-fce1f5e7-8937-47da-ada5-2d9ba7f12083 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:10:53.418727 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-fce1f5e7-8937-47da-ada5-2d9ba7f12083 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] [instance: 013da7c4-ac69-4554-827b-d68e9bac0e54] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:10:53.427160 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-fce1f5e7-8937-47da-ada5-2d9ba7f12083 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:10:53.427713 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-fce1f5e7-8937-47da-ada5-2d9ba7f12083 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:10:53.428650 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-fce1f5e7-8937-47da-ada5-2d9ba7f12083 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:10:53.429209 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-fce1f5e7-8937-47da-ada5-2d9ba7f12083 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:10:53.501233 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-fce1f5e7-8937-47da-ada5-2d9ba7f12083 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6be4749041442787482b6e06b6c40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73f3238988e4e1293ad782712a1da53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 16:10:53.510498 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-fce1f5e7-8937-47da-ada5-2d9ba7f12083 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] 10.222.0.64 "GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54" status: 200 len: 1350 microversion: 2.1 time: 0.094815 Oct 27 16:10:53.511090 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 904/1875] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 16:10:53 2021] GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54 => generated 1350 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 16:10:54.526381 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-848271cf-6f3a-4034-9692-e1b4c71ff85e tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:10:54.527744 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-848271cf-6f3a-4034-9692-e1b4c71ff85e tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] [instance: 013da7c4-ac69-4554-827b-d68e9bac0e54] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:10:54.534674 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-848271cf-6f3a-4034-9692-e1b4c71ff85e tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:10:54.535120 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-848271cf-6f3a-4034-9692-e1b4c71ff85e tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:10:54.535973 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-848271cf-6f3a-4034-9692-e1b4c71ff85e tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:10:54.536447 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-848271cf-6f3a-4034-9692-e1b4c71ff85e tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:10:54.598380 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-848271cf-6f3a-4034-9692-e1b4c71ff85e tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6be4749041442787482b6e06b6c40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73f3238988e4e1293ad782712a1da53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 16:10:54.607025 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-848271cf-6f3a-4034-9692-e1b4c71ff85e tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] 10.222.0.64 "GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54" status: 200 len: 1350 microversion: 2.1 time: 0.084305 Oct 27 16:10:54.607627 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 972/1876] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 16:10:54 2021] GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54 => generated 1350 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 16:10:55.627607 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-3438a04f-b7f5-4e5d-8eff-dd56e1ae584d tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:10:55.628594 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-3438a04f-b7f5-4e5d-8eff-dd56e1ae584d tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] [instance: 013da7c4-ac69-4554-827b-d68e9bac0e54] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:10:55.638255 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-3438a04f-b7f5-4e5d-8eff-dd56e1ae584d tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:10:55.638918 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-3438a04f-b7f5-4e5d-8eff-dd56e1ae584d tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:10:55.640120 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-3438a04f-b7f5-4e5d-8eff-dd56e1ae584d tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:10:55.640780 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-3438a04f-b7f5-4e5d-8eff-dd56e1ae584d tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:10:55.716824 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-3438a04f-b7f5-4e5d-8eff-dd56e1ae584d tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6be4749041442787482b6e06b6c40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73f3238988e4e1293ad782712a1da53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 16:10:55.726307 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-3438a04f-b7f5-4e5d-8eff-dd56e1ae584d tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] 10.222.0.64 "GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54" status: 200 len: 1350 microversion: 2.1 time: 0.104594 Oct 27 16:10:55.727134 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 905/1877] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 16:10:55 2021] GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54 => generated 1350 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 16:10:56.747496 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-f4fcbb47-2a78-4476-9071-643376751a7f tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:10:56.748497 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-f4fcbb47-2a78-4476-9071-643376751a7f tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] [instance: 013da7c4-ac69-4554-827b-d68e9bac0e54] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:10:56.755994 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-f4fcbb47-2a78-4476-9071-643376751a7f tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:10:56.756661 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-f4fcbb47-2a78-4476-9071-643376751a7f tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:10:56.757349 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-f4fcbb47-2a78-4476-9071-643376751a7f tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:10:56.757881 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-f4fcbb47-2a78-4476-9071-643376751a7f tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:10:56.841264 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-f4fcbb47-2a78-4476-9071-643376751a7f tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6be4749041442787482b6e06b6c40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73f3238988e4e1293ad782712a1da53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 16:10:56.853855 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-f4fcbb47-2a78-4476-9071-643376751a7f tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] 10.222.0.64 "GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54" status: 200 len: 1350 microversion: 2.1 time: 0.110245 Oct 27 16:10:56.854750 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 973/1878] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 16:10:56 2021] GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54 => generated 1350 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 16:10:57.257047 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 27 16:10:57.257856 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: Wed Oct 27 16:10:57 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Oct 27 16:10:57.886618 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-386aa899-8551-4019-a538-3bee53c9f8d0 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:10:57.887611 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-386aa899-8551-4019-a538-3bee53c9f8d0 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] [instance: 013da7c4-ac69-4554-827b-d68e9bac0e54] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:10:57.899420 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-386aa899-8551-4019-a538-3bee53c9f8d0 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:10:57.900222 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-386aa899-8551-4019-a538-3bee53c9f8d0 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:10:57.901538 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-386aa899-8551-4019-a538-3bee53c9f8d0 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:10:57.902201 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-386aa899-8551-4019-a538-3bee53c9f8d0 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:10:57.983667 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-386aa899-8551-4019-a538-3bee53c9f8d0 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6be4749041442787482b6e06b6c40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73f3238988e4e1293ad782712a1da53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 16:10:57.996268 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-386aa899-8551-4019-a538-3bee53c9f8d0 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] 10.222.0.64 "GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54" status: 200 len: 1350 microversion: 2.1 time: 0.116722 Oct 27 16:10:57.997120 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 906/1879] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 16:10:57 2021] GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54 => generated 1350 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 16:10:59.014433 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-8183b9e9-a6aa-4408-bae0-0671b8829818 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:10:59.015311 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-8183b9e9-a6aa-4408-bae0-0671b8829818 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] [instance: 013da7c4-ac69-4554-827b-d68e9bac0e54] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:10:59.022409 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-8183b9e9-a6aa-4408-bae0-0671b8829818 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:10:59.022907 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-8183b9e9-a6aa-4408-bae0-0671b8829818 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:10:59.023762 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-8183b9e9-a6aa-4408-bae0-0671b8829818 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:10:59.024873 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-8183b9e9-a6aa-4408-bae0-0671b8829818 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:10:59.091386 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-8183b9e9-a6aa-4408-bae0-0671b8829818 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6be4749041442787482b6e06b6c40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73f3238988e4e1293ad782712a1da53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 16:10:59.099888 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-8183b9e9-a6aa-4408-bae0-0671b8829818 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] 10.222.0.64 "GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54" status: 200 len: 1350 microversion: 2.1 time: 0.089215 Oct 27 16:10:59.100454 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 974/1880] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 16:10:59 2021] GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54 => generated 1350 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 16:11:00.116355 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-38e97fec-eb41-4575-81f0-a4b0ed4c3ced tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:11:00.117010 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-38e97fec-eb41-4575-81f0-a4b0ed4c3ced tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] [instance: 013da7c4-ac69-4554-827b-d68e9bac0e54] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:11:00.123376 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-38e97fec-eb41-4575-81f0-a4b0ed4c3ced tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:11:00.123817 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-38e97fec-eb41-4575-81f0-a4b0ed4c3ced tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:11:00.124616 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-38e97fec-eb41-4575-81f0-a4b0ed4c3ced tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:11:00.125047 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-38e97fec-eb41-4575-81f0-a4b0ed4c3ced tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:11:00.185023 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-38e97fec-eb41-4575-81f0-a4b0ed4c3ced tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6be4749041442787482b6e06b6c40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73f3238988e4e1293ad782712a1da53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 16:11:00.193580 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-38e97fec-eb41-4575-81f0-a4b0ed4c3ced tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] 10.222.0.64 "GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54" status: 200 len: 1350 microversion: 2.1 time: 0.080909 Oct 27 16:11:00.194155 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 907/1881] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 16:11:00 2021] GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54 => generated 1350 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 16:11:01.210796 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-d61745fd-d9f7-405b-bcb6-a2789c977786 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:11:01.211345 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-d61745fd-d9f7-405b-bcb6-a2789c977786 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] [instance: 013da7c4-ac69-4554-827b-d68e9bac0e54] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:11:01.217723 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-d61745fd-d9f7-405b-bcb6-a2789c977786 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:11:01.218170 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-d61745fd-d9f7-405b-bcb6-a2789c977786 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:11:01.218998 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-d61745fd-d9f7-405b-bcb6-a2789c977786 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:11:01.219430 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-d61745fd-d9f7-405b-bcb6-a2789c977786 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:11:01.280266 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-d61745fd-d9f7-405b-bcb6-a2789c977786 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6be4749041442787482b6e06b6c40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73f3238988e4e1293ad782712a1da53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 16:11:01.287972 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-d61745fd-d9f7-405b-bcb6-a2789c977786 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] 10.222.0.64 "GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54" status: 200 len: 1350 microversion: 2.1 time: 0.080961 Oct 27 16:11:01.288532 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 975/1882] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 16:11:01 2021] GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54 => generated 1350 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 16:11:02.304895 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-e15e22b1-b00c-44ad-a46b-65e95561d61e tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:11:02.305974 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-e15e22b1-b00c-44ad-a46b-65e95561d61e tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] [instance: 013da7c4-ac69-4554-827b-d68e9bac0e54] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:11:02.312493 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-e15e22b1-b00c-44ad-a46b-65e95561d61e tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:11:02.312932 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-e15e22b1-b00c-44ad-a46b-65e95561d61e tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:11:02.313699 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-e15e22b1-b00c-44ad-a46b-65e95561d61e tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:11:02.314127 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-e15e22b1-b00c-44ad-a46b-65e95561d61e tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:11:02.375092 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-e15e22b1-b00c-44ad-a46b-65e95561d61e tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6be4749041442787482b6e06b6c40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73f3238988e4e1293ad782712a1da53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 16:11:02.383083 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-e15e22b1-b00c-44ad-a46b-65e95561d61e tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] 10.222.0.64 "GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54" status: 200 len: 1350 microversion: 2.1 time: 0.081901 Oct 27 16:11:02.384432 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 908/1883] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 16:11:02 2021] GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54 => generated 1350 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 16:11:03.401941 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-6ca25b7a-964f-42e6-ac5f-fd142bd44c03 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:11:03.402544 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-6ca25b7a-964f-42e6-ac5f-fd142bd44c03 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] [instance: 013da7c4-ac69-4554-827b-d68e9bac0e54] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:11:03.408813 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-6ca25b7a-964f-42e6-ac5f-fd142bd44c03 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:11:03.409257 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-6ca25b7a-964f-42e6-ac5f-fd142bd44c03 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:11:03.410030 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-6ca25b7a-964f-42e6-ac5f-fd142bd44c03 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:11:03.410459 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-6ca25b7a-964f-42e6-ac5f-fd142bd44c03 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:11:03.479410 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-6ca25b7a-964f-42e6-ac5f-fd142bd44c03 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6be4749041442787482b6e06b6c40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73f3238988e4e1293ad782712a1da53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 16:11:03.488825 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-6ca25b7a-964f-42e6-ac5f-fd142bd44c03 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] 10.222.0.64 "GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54" status: 200 len: 1350 microversion: 2.1 time: 0.091182 Oct 27 16:11:03.489476 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 976/1884] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 16:11:03 2021] GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54 => generated 1350 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 16:11:04.512776 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-575216b8-3a5a-4fc3-a6d1-9fcd3ea55c76 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:11:04.512776 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-575216b8-3a5a-4fc3-a6d1-9fcd3ea55c76 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] [instance: 013da7c4-ac69-4554-827b-d68e9bac0e54] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:11:04.513751 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-575216b8-3a5a-4fc3-a6d1-9fcd3ea55c76 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:11:04.514198 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-575216b8-3a5a-4fc3-a6d1-9fcd3ea55c76 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:11:04.514969 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-575216b8-3a5a-4fc3-a6d1-9fcd3ea55c76 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:11:04.515396 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-575216b8-3a5a-4fc3-a6d1-9fcd3ea55c76 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:11:04.579073 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-575216b8-3a5a-4fc3-a6d1-9fcd3ea55c76 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6be4749041442787482b6e06b6c40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73f3238988e4e1293ad782712a1da53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 16:11:04.590669 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-575216b8-3a5a-4fc3-a6d1-9fcd3ea55c76 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] 10.222.0.64 "GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54" status: 200 len: 1350 microversion: 2.1 time: 0.088147 Oct 27 16:11:04.591264 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 909/1885] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 16:11:04 2021] GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54 => generated 1350 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 16:11:05.608191 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-768522ea-8bcd-4777-96e6-e2f979a4b71c tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:11:05.608801 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-768522ea-8bcd-4777-96e6-e2f979a4b71c tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] [instance: 013da7c4-ac69-4554-827b-d68e9bac0e54] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:11:05.614989 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-768522ea-8bcd-4777-96e6-e2f979a4b71c tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:11:05.615419 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-768522ea-8bcd-4777-96e6-e2f979a4b71c tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:11:05.616205 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-768522ea-8bcd-4777-96e6-e2f979a4b71c tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:11:05.616638 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-768522ea-8bcd-4777-96e6-e2f979a4b71c tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:11:05.676584 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-768522ea-8bcd-4777-96e6-e2f979a4b71c tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6be4749041442787482b6e06b6c40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73f3238988e4e1293ad782712a1da53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 16:11:05.684944 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-768522ea-8bcd-4777-96e6-e2f979a4b71c tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] 10.222.0.64 "GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54" status: 200 len: 1350 microversion: 2.1 time: 0.080399 Oct 27 16:11:05.685501 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 977/1886] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 16:11:05 2021] GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54 => generated 1350 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 16:11:06.702508 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-f1b7ffbc-6cd3-4c48-a101-65c9b21b8c43 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:11:06.703119 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-f1b7ffbc-6cd3-4c48-a101-65c9b21b8c43 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] [instance: 013da7c4-ac69-4554-827b-d68e9bac0e54] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:11:06.709634 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-f1b7ffbc-6cd3-4c48-a101-65c9b21b8c43 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:11:06.710077 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-f1b7ffbc-6cd3-4c48-a101-65c9b21b8c43 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:11:06.710849 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-f1b7ffbc-6cd3-4c48-a101-65c9b21b8c43 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:11:06.711289 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-f1b7ffbc-6cd3-4c48-a101-65c9b21b8c43 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:11:06.770829 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-f1b7ffbc-6cd3-4c48-a101-65c9b21b8c43 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6be4749041442787482b6e06b6c40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73f3238988e4e1293ad782712a1da53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 16:11:06.778760 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-f1b7ffbc-6cd3-4c48-a101-65c9b21b8c43 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] 10.222.0.64 "GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54" status: 200 len: 1350 microversion: 2.1 time: 0.080005 Oct 27 16:11:06.779316 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 910/1887] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 16:11:06 2021] GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54 => generated 1350 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 16:11:07.796153 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-3622f420-2a98-4bec-be6d-11db1ca99a20 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:11:07.796752 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-3622f420-2a98-4bec-be6d-11db1ca99a20 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] [instance: 013da7c4-ac69-4554-827b-d68e9bac0e54] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:11:07.804294 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-3622f420-2a98-4bec-be6d-11db1ca99a20 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:11:07.804740 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-3622f420-2a98-4bec-be6d-11db1ca99a20 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:11:07.805545 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-3622f420-2a98-4bec-be6d-11db1ca99a20 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:11:07.805977 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-3622f420-2a98-4bec-be6d-11db1ca99a20 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:11:07.866872 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-3622f420-2a98-4bec-be6d-11db1ca99a20 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6be4749041442787482b6e06b6c40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73f3238988e4e1293ad782712a1da53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 16:11:07.875258 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-3622f420-2a98-4bec-be6d-11db1ca99a20 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] 10.222.0.64 "GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54" status: 200 len: 1350 microversion: 2.1 time: 0.083616 Oct 27 16:11:07.875833 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 978/1888] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 16:11:07 2021] GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54 => generated 1350 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 16:11:08.893575 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-46c3ba84-1cd7-45d6-822d-e60b7063bce7 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:11:08.894190 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-46c3ba84-1cd7-45d6-822d-e60b7063bce7 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] [instance: 013da7c4-ac69-4554-827b-d68e9bac0e54] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:11:08.901118 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-46c3ba84-1cd7-45d6-822d-e60b7063bce7 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:11:08.901561 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-46c3ba84-1cd7-45d6-822d-e60b7063bce7 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:11:08.902337 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-46c3ba84-1cd7-45d6-822d-e60b7063bce7 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:11:08.902780 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-46c3ba84-1cd7-45d6-822d-e60b7063bce7 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:11:08.966814 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-46c3ba84-1cd7-45d6-822d-e60b7063bce7 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6be4749041442787482b6e06b6c40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73f3238988e4e1293ad782712a1da53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 16:11:08.974715 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-46c3ba84-1cd7-45d6-822d-e60b7063bce7 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] 10.222.0.64 "GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54" status: 200 len: 1350 microversion: 2.1 time: 0.085066 Oct 27 16:11:08.975278 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 911/1889] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 16:11:08 2021] GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54 => generated 1350 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 16:11:09.992421 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-cb2f29f1-089f-4feb-8657-e073246282d0 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:11:09.993673 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-cb2f29f1-089f-4feb-8657-e073246282d0 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] [instance: 013da7c4-ac69-4554-827b-d68e9bac0e54] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:11:10.000053 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-cb2f29f1-089f-4feb-8657-e073246282d0 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:11:10.000498 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-cb2f29f1-089f-4feb-8657-e073246282d0 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:11:10.001269 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-cb2f29f1-089f-4feb-8657-e073246282d0 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:11:10.001752 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-cb2f29f1-089f-4feb-8657-e073246282d0 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:11:10.088130 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-cb2f29f1-089f-4feb-8657-e073246282d0 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6be4749041442787482b6e06b6c40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73f3238988e4e1293ad782712a1da53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 16:11:10.096149 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-cb2f29f1-089f-4feb-8657-e073246282d0 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] 10.222.0.64 "GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54" status: 200 len: 1350 microversion: 2.1 time: 0.107323 Oct 27 16:11:10.096723 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 979/1890] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 16:11:09 2021] GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54 => generated 1350 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 16:11:11.113174 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-fffb67f2-8002-4a0c-bd31-7228011a0209 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:11:11.114852 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-fffb67f2-8002-4a0c-bd31-7228011a0209 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] [instance: 013da7c4-ac69-4554-827b-d68e9bac0e54] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:11:11.122714 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-fffb67f2-8002-4a0c-bd31-7228011a0209 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:11:11.123231 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-fffb67f2-8002-4a0c-bd31-7228011a0209 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:11:11.124134 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-fffb67f2-8002-4a0c-bd31-7228011a0209 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:11:11.124655 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-fffb67f2-8002-4a0c-bd31-7228011a0209 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:11:11.198366 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-fffb67f2-8002-4a0c-bd31-7228011a0209 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6be4749041442787482b6e06b6c40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73f3238988e4e1293ad782712a1da53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 16:11:11.206343 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-fffb67f2-8002-4a0c-bd31-7228011a0209 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] 10.222.0.64 "GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54" status: 200 len: 1350 microversion: 2.1 time: 0.096649 Oct 27 16:11:11.206899 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 912/1891] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 16:11:11 2021] GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54 => generated 1350 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 16:11:12.231264 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-b3f3d77a-c57e-4466-a3cb-164a0150980d tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:11:12.232072 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-b3f3d77a-c57e-4466-a3cb-164a0150980d tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] [instance: 013da7c4-ac69-4554-827b-d68e9bac0e54] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:11:12.239977 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-b3f3d77a-c57e-4466-a3cb-164a0150980d tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:11:12.240631 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-b3f3d77a-c57e-4466-a3cb-164a0150980d tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:11:12.241417 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-b3f3d77a-c57e-4466-a3cb-164a0150980d tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:11:12.241844 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-b3f3d77a-c57e-4466-a3cb-164a0150980d tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:11:12.325291 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-b3f3d77a-c57e-4466-a3cb-164a0150980d tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6be4749041442787482b6e06b6c40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73f3238988e4e1293ad782712a1da53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 16:11:12.335540 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-b3f3d77a-c57e-4466-a3cb-164a0150980d tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] 10.222.0.64 "GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54" status: 200 len: 1350 microversion: 2.1 time: 0.115437 Oct 27 16:11:12.336171 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 980/1892] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 16:11:12 2021] GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54 => generated 1350 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 16:11:13.355050 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-17c9f4d1-1eee-4713-a8c6-b989bcfcbcf4 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:11:13.355651 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-17c9f4d1-1eee-4713-a8c6-b989bcfcbcf4 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] [instance: 013da7c4-ac69-4554-827b-d68e9bac0e54] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:11:13.361937 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-17c9f4d1-1eee-4713-a8c6-b989bcfcbcf4 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:11:13.362383 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-17c9f4d1-1eee-4713-a8c6-b989bcfcbcf4 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:11:13.363150 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-17c9f4d1-1eee-4713-a8c6-b989bcfcbcf4 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:11:13.363574 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-17c9f4d1-1eee-4713-a8c6-b989bcfcbcf4 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:11:13.425782 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-17c9f4d1-1eee-4713-a8c6-b989bcfcbcf4 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6be4749041442787482b6e06b6c40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73f3238988e4e1293ad782712a1da53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 16:11:13.433678 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-17c9f4d1-1eee-4713-a8c6-b989bcfcbcf4 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] 10.222.0.64 "GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54" status: 200 len: 1350 microversion: 2.1 time: 0.082944 Oct 27 16:11:13.434246 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 913/1893] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 16:11:13 2021] GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54 => generated 1350 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 16:11:14.452736 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-f6dc393d-9f7e-4afd-b878-e45f989cae44 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:11:14.453635 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-f6dc393d-9f7e-4afd-b878-e45f989cae44 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] [instance: 013da7c4-ac69-4554-827b-d68e9bac0e54] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:11:14.459798 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-f6dc393d-9f7e-4afd-b878-e45f989cae44 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:11:14.460261 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-f6dc393d-9f7e-4afd-b878-e45f989cae44 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:11:14.461036 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-f6dc393d-9f7e-4afd-b878-e45f989cae44 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:11:14.462011 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-f6dc393d-9f7e-4afd-b878-e45f989cae44 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:11:14.529290 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-f6dc393d-9f7e-4afd-b878-e45f989cae44 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6be4749041442787482b6e06b6c40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73f3238988e4e1293ad782712a1da53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 16:11:14.538039 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-f6dc393d-9f7e-4afd-b878-e45f989cae44 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] 10.222.0.64 "GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54" status: 200 len: 1350 microversion: 2.1 time: 0.089859 Oct 27 16:11:14.538712 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 981/1894] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 16:11:14 2021] GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54 => generated 1350 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 16:11:15.557112 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-2b6cfcb3-fbd3-4459-abd7-927d8c9567d8 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:11:15.557720 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-2b6cfcb3-fbd3-4459-abd7-927d8c9567d8 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] [instance: 013da7c4-ac69-4554-827b-d68e9bac0e54] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:11:15.564045 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-2b6cfcb3-fbd3-4459-abd7-927d8c9567d8 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:11:15.564493 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-2b6cfcb3-fbd3-4459-abd7-927d8c9567d8 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:11:15.565438 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-2b6cfcb3-fbd3-4459-abd7-927d8c9567d8 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:11:15.565692 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-2b6cfcb3-fbd3-4459-abd7-927d8c9567d8 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:11:15.629097 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-2b6cfcb3-fbd3-4459-abd7-927d8c9567d8 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6be4749041442787482b6e06b6c40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73f3238988e4e1293ad782712a1da53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 16:11:15.638446 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-2b6cfcb3-fbd3-4459-abd7-927d8c9567d8 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] 10.222.0.64 "GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54" status: 200 len: 1350 microversion: 2.1 time: 0.086038 Oct 27 16:11:15.638900 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 914/1895] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 16:11:15 2021] GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54 => generated 1350 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 16:11:16.659787 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-7906b6b2-e00a-4cd1-adbe-28d53e600110 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:11:16.660949 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-7906b6b2-e00a-4cd1-adbe-28d53e600110 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] [instance: 013da7c4-ac69-4554-827b-d68e9bac0e54] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:11:16.673298 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-7906b6b2-e00a-4cd1-adbe-28d53e600110 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:11:16.674083 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-7906b6b2-e00a-4cd1-adbe-28d53e600110 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:11:16.675431 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-7906b6b2-e00a-4cd1-adbe-28d53e600110 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:11:16.676258 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-7906b6b2-e00a-4cd1-adbe-28d53e600110 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:11:16.773489 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-7906b6b2-e00a-4cd1-adbe-28d53e600110 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6be4749041442787482b6e06b6c40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73f3238988e4e1293ad782712a1da53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 16:11:16.787647 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-7906b6b2-e00a-4cd1-adbe-28d53e600110 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] 10.222.0.64 "GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54" status: 200 len: 1350 microversion: 2.1 time: 0.134236 Oct 27 16:11:16.788703 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 982/1896] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 16:11:16 2021] GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54 => generated 1350 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 16:11:17.807975 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-2ce93f51-61da-457a-96a4-f7e29ee8b354 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:11:17.808663 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-2ce93f51-61da-457a-96a4-f7e29ee8b354 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] [instance: 013da7c4-ac69-4554-827b-d68e9bac0e54] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:11:17.816269 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-2ce93f51-61da-457a-96a4-f7e29ee8b354 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:11:17.816795 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-2ce93f51-61da-457a-96a4-f7e29ee8b354 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:11:17.817656 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-2ce93f51-61da-457a-96a4-f7e29ee8b354 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:11:17.818223 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-2ce93f51-61da-457a-96a4-f7e29ee8b354 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:11:17.885397 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-2ce93f51-61da-457a-96a4-f7e29ee8b354 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6be4749041442787482b6e06b6c40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73f3238988e4e1293ad782712a1da53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 16:11:17.893765 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-2ce93f51-61da-457a-96a4-f7e29ee8b354 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] 10.222.0.64 "GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54" status: 200 len: 1350 microversion: 2.1 time: 0.091093 Oct 27 16:11:17.894347 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 915/1897] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 16:11:17 2021] GET /compute/v2.1/servers/013da7c4-ac69-4554-827b-d68e9bac0e54 => generated 1350 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 16:11:19.044252 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 27 16:11:19.045355 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: Wed Oct 27 16:11:19 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Oct 27 16:11:21.477947 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 27 16:11:21.478498 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: Wed Oct 27 16:11:21 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Oct 27 16:12:15.340057 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-ce691103-b99d-43d0-bc49-4afe76d3dee0 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:12:15.341376 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-ce691103-b99d-43d0-bc49-4afe76d3dee0 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: 9f9373f8-c3ad-4d3c-ac64-e5edf9cb4cd6] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:12:15.347383 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-ce691103-b99d-43d0-bc49-4afe76d3dee0 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:12:15.347910 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-ce691103-b99d-43d0-bc49-4afe76d3dee0 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:12:15.348750 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-ce691103-b99d-43d0-bc49-4afe76d3dee0 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:12:15.349224 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-ce691103-b99d-43d0-bc49-4afe76d3dee0 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:12:15.364611 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.wsgi [None req-ce691103-b99d-43d0-bc49-4afe76d3dee0 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] HTTP exception thrown: Instance 9f9373f8-c3ad-4d3c-ac64-e5edf9cb4cd6 could not be found. Oct 27 16:12:15.365263 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-ce691103-b99d-43d0-bc49-4afe76d3dee0 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Returning 404 to user: Instance 9f9373f8-c3ad-4d3c-ac64-e5edf9cb4cd6 could not be found. {{(pid=122224) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 27 16:12:15.367136 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-ce691103-b99d-43d0-bc49-4afe76d3dee0 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "DELETE /compute/v2.1/servers/9f9373f8-c3ad-4d3c-ac64-e5edf9cb4cd6" status: 404 len: 111 microversion: 2.1 time: 0.031236 Oct 27 16:12:15.367767 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 983/1898] 10.222.0.64 () {58 vars in 1238 bytes} [Wed Oct 27 16:12:15 2021] DELETE /compute/v2.1/servers/9f9373f8-c3ad-4d3c-ac64-e5edf9cb4cd6 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 16:12:15.382231 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-3960758d-1e73-4155-be9f-af232daa5d74 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:12:15.383595 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-3960758d-1e73-4155-be9f-af232daa5d74 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: 9f9373f8-c3ad-4d3c-ac64-e5edf9cb4cd6] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:12:15.393944 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-3960758d-1e73-4155-be9f-af232daa5d74 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:12:15.394742 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-3960758d-1e73-4155-be9f-af232daa5d74 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:12:15.396109 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-3960758d-1e73-4155-be9f-af232daa5d74 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:12:15.396907 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-3960758d-1e73-4155-be9f-af232daa5d74 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:12:15.422890 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.wsgi [None req-3960758d-1e73-4155-be9f-af232daa5d74 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] HTTP exception thrown: Instance 9f9373f8-c3ad-4d3c-ac64-e5edf9cb4cd6 could not be found. Oct 27 16:12:15.424315 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-3960758d-1e73-4155-be9f-af232daa5d74 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Returning 404 to user: Instance 9f9373f8-c3ad-4d3c-ac64-e5edf9cb4cd6 could not be found. {{(pid=122225) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 27 16:12:15.427220 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-3960758d-1e73-4155-be9f-af232daa5d74 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "GET /compute/v2.1/servers/9f9373f8-c3ad-4d3c-ac64-e5edf9cb4cd6" status: 404 len: 111 microversion: 2.1 time: 0.052565 Oct 27 16:12:15.432252 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 916/1899] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 16:12:15 2021] GET /compute/v2.1/servers/9f9373f8-c3ad-4d3c-ac64-e5edf9cb4cd6 => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 16:12:37.176490 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 27 16:12:37.177403 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: Wed Oct 27 16:12:37 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Oct 27 16:12:41.517924 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 27 16:12:41.518593 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: Wed Oct 27 16:12:41 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Oct 27 16:12:45.651764 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 27 16:12:45.652353 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: Wed Oct 27 16:12:45 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Oct 27 16:14:17.278088 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 27 16:14:17.278746 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: Wed Oct 27 16:14:17 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Oct 27 16:14:39.065113 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 27 16:14:39.066036 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: Wed Oct 27 16:14:39 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Oct 27 16:14:41.501180 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 27 16:14:41.501795 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: Wed Oct 27 16:14:41 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Oct 27 16:15:39.346961 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: ERROR oslo.messaging._drivers.impl_rabbit [-] [9e5083a7-54ed-4130-8943-3bf7cba382f9] AMQP server on 10.222.0.64:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 27 16:15:39.350639 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-709d51a2-fbf7-4331-8b84-343d22f0a4e6 tempest-TestShelveInstance-876090071 tempest-TestShelveInstance-876090071-project] Calling method '.version_select at 0x7fbc0ac02af0>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:15:39.378314 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-709d51a2-fbf7-4331-8b84-343d22f0a4e6 tempest-TestShelveInstance-876090071 tempest-TestShelveInstance-876090071-project] 10.222.0.64 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-691977933" status: 202 len: 0 microversion: 2.1 time: 0.033827 Oct 27 16:15:39.379576 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 984/1900] 10.222.0.64 () {58 vars in 1250 bytes} [Wed Oct 27 16:15:39 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-691977933 => generated 0 bytes in 37 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 16:15:57.195540 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 27 16:15:57.196298 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: Wed Oct 27 16:15:57 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Oct 27 16:16:01.537171 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 27 16:16:01.538029 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: Wed Oct 27 16:16:01 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Oct 27 16:17:13.717637 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: ERROR oslo.messaging._drivers.impl_rabbit [-] [974aee41-ada3-4d82-a5f5-5a715e2d6c08] AMQP server on 10.222.0.64:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 27 16:17:13.720947 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-aa5aa82d-9707-4488-8de5-132eefccad42 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:17:13.722177 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-aa5aa82d-9707-4488-8de5-132eefccad42 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:17:13.728788 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-aa5aa82d-9707-4488-8de5-132eefccad42 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:17:13.729226 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-aa5aa82d-9707-4488-8de5-132eefccad42 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:17:13.730011 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-aa5aa82d-9707-4488-8de5-132eefccad42 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:17:13.730437 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-aa5aa82d-9707-4488-8de5-132eefccad42 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:17:13.743690 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.wsgi [None req-aa5aa82d-9707-4488-8de5-132eefccad42 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] HTTP exception thrown: Instance a115c672-012e-4e45-b5c9-4427e7b66672 could not be found. Oct 27 16:17:13.744300 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-aa5aa82d-9707-4488-8de5-132eefccad42 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Returning 404 to user: Instance a115c672-012e-4e45-b5c9-4427e7b66672 could not be found. {{(pid=122225) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 27 16:17:13.745116 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-aa5aa82d-9707-4488-8de5-132eefccad42 tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "DELETE /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672" status: 404 len: 111 microversion: 2.1 time: 0.029482 Oct 27 16:17:13.745647 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 917/1901] 10.222.0.64 () {58 vars in 1238 bytes} [Wed Oct 27 16:17:13 2021] DELETE /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 16:17:13.766849 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-0de7cc3a-f328-4d0a-b706-2aaced9a7aff tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:17:13.767451 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-0de7cc3a-f328-4d0a-b706-2aaced9a7aff tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] [instance: a115c672-012e-4e45-b5c9-4427e7b66672] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:17:13.776520 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO oslo.messaging._drivers.impl_rabbit [-] [9e5083a7-54ed-4130-8943-3bf7cba382f9] Reconnected to AMQP server on 10.222.0.64:5672 via [amqp] client with port 50476. Oct 27 16:17:13.778553 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-0de7cc3a-f328-4d0a-b706-2aaced9a7aff tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:17:13.779004 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-0de7cc3a-f328-4d0a-b706-2aaced9a7aff tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:17:13.779779 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-0de7cc3a-f328-4d0a-b706-2aaced9a7aff tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:17:13.780244 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-0de7cc3a-f328-4d0a-b706-2aaced9a7aff tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:17:13.793776 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.wsgi [None req-0de7cc3a-f328-4d0a-b706-2aaced9a7aff tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] HTTP exception thrown: Instance a115c672-012e-4e45-b5c9-4427e7b66672 could not be found. Oct 27 16:17:13.794367 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-0de7cc3a-f328-4d0a-b706-2aaced9a7aff tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] Returning 404 to user: Instance a115c672-012e-4e45-b5c9-4427e7b66672 could not be found. {{(pid=122224) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 27 16:17:13.795186 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-0de7cc3a-f328-4d0a-b706-2aaced9a7aff tempest-AttachVolumeShelveTestJSON-1144793860 tempest-AttachVolumeShelveTestJSON-1144793860-project] 10.222.0.64 "GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672" status: 404 len: 111 microversion: 2.1 time: 0.045519 Oct 27 16:17:13.795715 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 985/1902] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 16:17:13 2021] GET /compute/v2.1/servers/a115c672-012e-4e45-b5c9-4427e7b66672 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 16:17:14.057222 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-4c5a1a75-c646-4a05-af0e-98feaae23dd3 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:17:14.057710 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-4c5a1a75-c646-4a05-af0e-98feaae23dd3 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: bced4f24-572a-4316-97e8-3ceedc61a621] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:17:14.063829 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-4c5a1a75-c646-4a05-af0e-98feaae23dd3 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:17:14.064298 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-4c5a1a75-c646-4a05-af0e-98feaae23dd3 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:17:14.065073 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-4c5a1a75-c646-4a05-af0e-98feaae23dd3 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:17:14.065501 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-4c5a1a75-c646-4a05-af0e-98feaae23dd3 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:17:14.092699 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-4c5a1a75-c646-4a05-af0e-98feaae23dd3 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: bced4f24-572a-4316-97e8-3ceedc61a621] Going to try to terminate instance {{(pid=122225) delete /opt/stack/nova/nova/compute/api.py:2612}} Oct 27 16:17:14.177246 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-4c5a1a75-c646-4a05-af0e-98feaae23dd3 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "DELETE /compute/v2.1/servers/bced4f24-572a-4316-97e8-3ceedc61a621" status: 204 len: 0 microversion: 2.1 time: 0.123500 Oct 27 16:17:14.178010 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 918/1903] 10.222.0.64 () {58 vars in 1238 bytes} [Wed Oct 27 16:17:14 2021] DELETE /compute/v2.1/servers/bced4f24-572a-4316-97e8-3ceedc61a621 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 16:17:14.186153 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-131fd3ad-5519-4b0b-a2d9-d69dc7f9584a tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:17:14.186765 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-131fd3ad-5519-4b0b-a2d9-d69dc7f9584a tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: bced4f24-572a-4316-97e8-3ceedc61a621] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:17:14.193716 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-131fd3ad-5519-4b0b-a2d9-d69dc7f9584a tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:17:14.194195 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-131fd3ad-5519-4b0b-a2d9-d69dc7f9584a tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:17:14.194991 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-131fd3ad-5519-4b0b-a2d9-d69dc7f9584a tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:17:14.196062 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-131fd3ad-5519-4b0b-a2d9-d69dc7f9584a tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:17:14.562007 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-131fd3ad-5519-4b0b-a2d9-d69dc7f9584a tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96b599f8890b4281a7e311cf37a039e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d7fcab5d3f465793d650f16c6ea8de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 16:17:14.569976 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-131fd3ad-5519-4b0b-a2d9-d69dc7f9584a tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/bced4f24-572a-4316-97e8-3ceedc61a621" status: 200 len: 1506 microversion: 2.1 time: 0.387608 Oct 27 16:17:14.570444 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 986/1904] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 16:17:14 2021] GET /compute/v2.1/servers/bced4f24-572a-4316-97e8-3ceedc61a621 => generated 1506 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 16:17:15.588318 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-d2c4fa15-6ca9-433c-ba20-76a68558e2f1 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:17:15.589152 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-d2c4fa15-6ca9-433c-ba20-76a68558e2f1 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: bced4f24-572a-4316-97e8-3ceedc61a621] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:17:15.605701 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-d2c4fa15-6ca9-433c-ba20-76a68558e2f1 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:17:15.606786 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-d2c4fa15-6ca9-433c-ba20-76a68558e2f1 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:17:15.607584 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-d2c4fa15-6ca9-433c-ba20-76a68558e2f1 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:17:15.608048 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-d2c4fa15-6ca9-433c-ba20-76a68558e2f1 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:17:15.624833 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO oslo.messaging._drivers.impl_rabbit [-] [974aee41-ada3-4d82-a5f5-5a715e2d6c08] Reconnected to AMQP server on 10.222.0.64:5672 via [amqp] client with port 50496. Oct 27 16:17:15.804051 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-d2c4fa15-6ca9-433c-ba20-76a68558e2f1 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96b599f8890b4281a7e311cf37a039e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d7fcab5d3f465793d650f16c6ea8de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 16:17:15.811493 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-d2c4fa15-6ca9-433c-ba20-76a68558e2f1 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/bced4f24-572a-4316-97e8-3ceedc61a621" status: 200 len: 1506 microversion: 2.1 time: 0.227313 Oct 27 16:17:15.812855 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 919/1905] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 16:17:15 2021] GET /compute/v2.1/servers/bced4f24-572a-4316-97e8-3ceedc61a621 => generated 1506 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 16:17:16.829684 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-6262c5e5-9ad1-4012-8940-50c1e50cd090 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:17:16.830324 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-6262c5e5-9ad1-4012-8940-50c1e50cd090 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: bced4f24-572a-4316-97e8-3ceedc61a621] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:17:16.837918 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-6262c5e5-9ad1-4012-8940-50c1e50cd090 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:17:16.838367 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-6262c5e5-9ad1-4012-8940-50c1e50cd090 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:17:16.839157 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-6262c5e5-9ad1-4012-8940-50c1e50cd090 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:17:16.839587 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-6262c5e5-9ad1-4012-8940-50c1e50cd090 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:17:17.010781 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-6262c5e5-9ad1-4012-8940-50c1e50cd090 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96b599f8890b4281a7e311cf37a039e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d7fcab5d3f465793d650f16c6ea8de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 16:17:17.022412 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-6262c5e5-9ad1-4012-8940-50c1e50cd090 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/bced4f24-572a-4316-97e8-3ceedc61a621" status: 200 len: 1506 microversion: 2.1 time: 0.196610 Oct 27 16:17:17.023148 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 987/1906] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 16:17:16 2021] GET /compute/v2.1/servers/bced4f24-572a-4316-97e8-3ceedc61a621 => generated 1506 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 16:17:17.686865 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-1a4500be-b5fb-499b-b6ed-87d21a5b2102 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-194668680", "imageRef": "b585ffbc-6a36-48c9-81b3-e26f9bd0fcba", "flavorRef": "452", "networks": [{"uuid": "4288875b-e618-420b-929c-d1092831a759"}]}} {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 16:17:17.754014 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.network.neutron [None req-1a4500be-b5fb-499b-b6ed-87d21a5b2102 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] validate_networks() for [('4288875b-e618-420b-929c-d1092831a759', None, None, None, None, None)] {{(pid=122225) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Oct 27 16:17:18.041017 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-d3ad2b33-5cbd-4541-973c-92871fc17e47 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:17:18.041632 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-d3ad2b33-5cbd-4541-973c-92871fc17e47 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: bced4f24-572a-4316-97e8-3ceedc61a621] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:17:18.050981 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-d3ad2b33-5cbd-4541-973c-92871fc17e47 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:17:18.052712 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-d3ad2b33-5cbd-4541-973c-92871fc17e47 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:17:18.053970 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-d3ad2b33-5cbd-4541-973c-92871fc17e47 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:17:18.054782 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-d3ad2b33-5cbd-4541-973c-92871fc17e47 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:17:18.176165 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-d3ad2b33-5cbd-4541-973c-92871fc17e47 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96b599f8890b4281a7e311cf37a039e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d7fcab5d3f465793d650f16c6ea8de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 16:17:18.184234 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-d3ad2b33-5cbd-4541-973c-92871fc17e47 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/bced4f24-572a-4316-97e8-3ceedc61a621" status: 200 len: 1464 microversion: 2.1 time: 0.147013 Oct 27 16:17:18.192651 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 988/1907] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 16:17:18 2021] GET /compute/v2.1/servers/bced4f24-572a-4316-97e8-3ceedc61a621 => generated 1464 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 16:17:18.329086 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.virt.hardware [None req-1a4500be-b5fb-499b-b6ed-87d21a5b2102 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Flavor limits 0:0:0 {{(pid=122225) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 16:17:18.329831 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.virt.hardware [None req-1a4500be-b5fb-499b-b6ed-87d21a5b2102 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Image limits 0:0:0 {{(pid=122225) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 16:17:18.330488 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.virt.hardware [None req-1a4500be-b5fb-499b-b6ed-87d21a5b2102 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Flavor pref 0:0:0 {{(pid=122225) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 16:17:18.331226 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.virt.hardware [None req-1a4500be-b5fb-499b-b6ed-87d21a5b2102 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Image pref 0:0:0 {{(pid=122225) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 16:17:18.331835 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.virt.hardware [None req-1a4500be-b5fb-499b-b6ed-87d21a5b2102 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122225) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 16:17:18.342545 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-1a4500be-b5fb-499b-b6ed-87d21a5b2102 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:17:18.343497 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-1a4500be-b5fb-499b-b6ed-87d21a5b2102 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:17:18.344540 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-1a4500be-b5fb-499b-b6ed-87d21a5b2102 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:17:18.345180 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-1a4500be-b5fb-499b-b6ed-87d21a5b2102 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:17:18.365362 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.quota [None req-1a4500be-b5fb-499b-b6ed-87d21a5b2102 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Getting quotas for project f73f3238988e4e1293ad782712a1da53. Resources: {'ram', 'instances', 'cores'} {{(pid=122225) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 27 16:17:18.369960 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.quota [None req-1a4500be-b5fb-499b-b6ed-87d21a5b2102 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Getting quotas for user 6b6be4749041442787482b6e06b6c40f and project f73f3238988e4e1293ad782712a1da53. Resources: {'ram', 'instances', 'cores'} {{(pid=122225) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 27 16:17:18.382916 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-1a4500be-b5fb-499b-b6ed-87d21a5b2102 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Going to run 1 instances... {{(pid=122225) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Oct 27 16:17:18.385996 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-1a4500be-b5fb-499b-b6ed-87d21a5b2102 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] [instance: 28a08917-c3d3-4103-a106-c9c1f00eba8f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b585ffbc-6a36-48c9-81b3-e26f9bd0fcba',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122225) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Oct 27 16:17:18.435837 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: ERROR oslo.messaging._drivers.impl_rabbit [None req-1a4500be-b5fb-499b-b6ed-87d21a5b2102 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] [2ed72785-92a6-4641-88e2-12b223d534d0] AMQP server on 10.222.0.64:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 27 16:17:18.529544 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [req-26287de2-6799-40b1-b629-63afbd11e5b4 req-fb416fde-04b4-4ead-9adc-be6d877532e3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bced4f24-572a-4316-97e8-3ceedc61a621", "name": "network-vif-deleted", "tag": "4638d661-d8d4-4d3b-ac20-f85ec470f7f4"}]} {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 16:17:18.531181 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 27 16:17:18.531181 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: warnings.warn(msg) Oct 27 16:17:18.539257 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [req-26287de2-6799-40b1-b629-63afbd11e5b4 req-fb416fde-04b4-4ead-9adc-be6d877532e3 service nova] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:17:18.539704 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [req-26287de2-6799-40b1-b629-63afbd11e5b4 req-fb416fde-04b4-4ead-9adc-be6d877532e3 service nova] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:17:18.551191 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.compute.server_external_events [req-26287de2-6799-40b1-b629-63afbd11e5b4 req-fb416fde-04b4-4ead-9adc-be6d877532e3 service nova] Creating event network-vif-deleted:4638d661-d8d4-4d3b-ac20-f85ec470f7f4 for instance bced4f24-572a-4316-97e8-3ceedc61a621 on hv-cinder-80070 Oct 27 16:17:18.558468 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [req-26287de2-6799-40b1-b629-63afbd11e5b4 req-fb416fde-04b4-4ead-9adc-be6d877532e3 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.321180 Oct 27 16:17:18.559045 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 989/1908] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Oct 27 16:17:18 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 16:17:19.205691 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-cb074486-ba6e-4286-bf59-fa9ecd6654e5 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:17:19.206401 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-cb074486-ba6e-4286-bf59-fa9ecd6654e5 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: bced4f24-572a-4316-97e8-3ceedc61a621] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:17:19.213893 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-cb074486-ba6e-4286-bf59-fa9ecd6654e5 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:17:19.214383 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-cb074486-ba6e-4286-bf59-fa9ecd6654e5 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:17:19.215494 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-cb074486-ba6e-4286-bf59-fa9ecd6654e5 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:17:19.216002 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-cb074486-ba6e-4286-bf59-fa9ecd6654e5 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:17:19.231293 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.wsgi [None req-cb074486-ba6e-4286-bf59-fa9ecd6654e5 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] HTTP exception thrown: Instance bced4f24-572a-4316-97e8-3ceedc61a621 could not be found. Oct 27 16:17:19.231939 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-cb074486-ba6e-4286-bf59-fa9ecd6654e5 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Returning 404 to user: Instance bced4f24-572a-4316-97e8-3ceedc61a621 could not be found. {{(pid=122224) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 27 16:17:19.232783 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-cb074486-ba6e-4286-bf59-fa9ecd6654e5 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/bced4f24-572a-4316-97e8-3ceedc61a621" status: 404 len: 111 microversion: 2.1 time: 0.032027 Oct 27 16:17:19.233345 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 990/1909] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 16:17:19 2021] GET /compute/v2.1/servers/bced4f24-572a-4316-97e8-3ceedc61a621 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 27 16:17:19.242306 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-4b5fbaf7-87dc-4bbc-8a93-fb392cb6f9d5 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:17:19.242800 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-4b5fbaf7-87dc-4bbc-8a93-fb392cb6f9d5 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: 62c89161-c119-48b2-839d-712db798ff96] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:17:19.248652 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-4b5fbaf7-87dc-4bbc-8a93-fb392cb6f9d5 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:17:19.249107 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-4b5fbaf7-87dc-4bbc-8a93-fb392cb6f9d5 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:17:19.249894 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-4b5fbaf7-87dc-4bbc-8a93-fb392cb6f9d5 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:17:19.250336 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-4b5fbaf7-87dc-4bbc-8a93-fb392cb6f9d5 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:17:19.278307 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-4b5fbaf7-87dc-4bbc-8a93-fb392cb6f9d5 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: 62c89161-c119-48b2-839d-712db798ff96] Going to try to terminate instance {{(pid=122224) delete /opt/stack/nova/nova/compute/api.py:2612}} Oct 27 16:17:19.377930 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-4b5fbaf7-87dc-4bbc-8a93-fb392cb6f9d5 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "DELETE /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96" status: 204 len: 0 microversion: 2.1 time: 0.139487 Oct 27 16:17:19.379045 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 991/1910] 10.222.0.64 () {58 vars in 1238 bytes} [Wed Oct 27 16:17:19 2021] DELETE /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 27 16:17:19.389402 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-3080ba0e-07cc-405b-ad2d-9e397f2389f4 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:17:19.390297 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-3080ba0e-07cc-405b-ad2d-9e397f2389f4 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: 62c89161-c119-48b2-839d-712db798ff96] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:17:19.400000 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-3080ba0e-07cc-405b-ad2d-9e397f2389f4 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:17:19.400563 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-3080ba0e-07cc-405b-ad2d-9e397f2389f4 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:17:19.401737 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-3080ba0e-07cc-405b-ad2d-9e397f2389f4 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:17:19.402351 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-3080ba0e-07cc-405b-ad2d-9e397f2389f4 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:17:19.461979 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO oslo.messaging._drivers.impl_rabbit [None req-1a4500be-b5fb-499b-b6ed-87d21a5b2102 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] [2ed72785-92a6-4641-88e2-12b223d534d0] Reconnected to AMQP server on 10.222.0.64:5672 via [amqp] client with port 50572. Oct 27 16:17:19.467895 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-1a4500be-b5fb-499b-b6ed-87d21a5b2102 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.784630 Oct 27 16:17:19.468840 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 920/1911] 10.222.0.64 () {60 vars in 1146 bytes} [Wed Oct 27 16:17:17 2021] POST /compute/v2.1/servers => generated 380 bytes in 1786 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 16:17:19.479108 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-9ee9c967-1a0b-4969-9a59-7a015f68459d tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:17:19.480035 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-9ee9c967-1a0b-4969-9a59-7a015f68459d tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] [instance: 28a08917-c3d3-4103-a106-c9c1f00eba8f] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:17:19.583482 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-9ee9c967-1a0b-4969-9a59-7a015f68459d tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6be4749041442787482b6e06b6c40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73f3238988e4e1293ad782712a1da53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 16:17:19.593532 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-9ee9c967-1a0b-4969-9a59-7a015f68459d tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] 10.222.0.64 "GET /compute/v2.1/servers/28a08917-c3d3-4103-a106-c9c1f00eba8f" status: 200 len: 1218 microversion: 2.1 time: 0.118248 Oct 27 16:17:19.594394 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 921/1912] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 16:17:19 2021] GET /compute/v2.1/servers/28a08917-c3d3-4103-a106-c9c1f00eba8f => generated 1218 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 16:17:19.600656 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-3080ba0e-07cc-405b-ad2d-9e397f2389f4 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96b599f8890b4281a7e311cf37a039e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d7fcab5d3f465793d650f16c6ea8de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 16:17:19.610446 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-3080ba0e-07cc-405b-ad2d-9e397f2389f4 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96" status: 200 len: 1567 microversion: 2.1 time: 0.225556 Oct 27 16:17:19.611355 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 992/1913] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 16:17:19 2021] GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96 => generated 1567 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 16:17:20.636564 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-31e35150-747e-45c1-b06f-351b71b9832f tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:17:20.637482 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-31e35150-747e-45c1-b06f-351b71b9832f tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] [instance: 28a08917-c3d3-4103-a106-c9c1f00eba8f] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:17:20.639923 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-d514724d-2856-4ed2-b87b-4844ea69a8cb tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:17:20.640702 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-d514724d-2856-4ed2-b87b-4844ea69a8cb tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: 62c89161-c119-48b2-839d-712db798ff96] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:17:20.652181 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-31e35150-747e-45c1-b06f-351b71b9832f tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:17:20.652639 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-31e35150-747e-45c1-b06f-351b71b9832f tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:17:20.653446 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-31e35150-747e-45c1-b06f-351b71b9832f tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:17:20.653907 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-31e35150-747e-45c1-b06f-351b71b9832f tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:17:20.654340 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-d514724d-2856-4ed2-b87b-4844ea69a8cb tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:17:20.654768 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-d514724d-2856-4ed2-b87b-4844ea69a8cb tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:17:20.655744 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-d514724d-2856-4ed2-b87b-4844ea69a8cb tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:17:20.656263 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-d514724d-2856-4ed2-b87b-4844ea69a8cb tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:17:20.911484 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-31e35150-747e-45c1-b06f-351b71b9832f tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6be4749041442787482b6e06b6c40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73f3238988e4e1293ad782712a1da53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 16:17:20.946148 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-31e35150-747e-45c1-b06f-351b71b9832f tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] 10.222.0.64 "GET /compute/v2.1/servers/28a08917-c3d3-4103-a106-c9c1f00eba8f" status: 200 len: 1270 microversion: 2.1 time: 0.312737 Oct 27 16:17:20.960179 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 922/1914] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 16:17:20 2021] GET /compute/v2.1/servers/28a08917-c3d3-4103-a106-c9c1f00eba8f => generated 1270 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 16:17:21.080719 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-d514724d-2856-4ed2-b87b-4844ea69a8cb tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96b599f8890b4281a7e311cf37a039e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d7fcab5d3f465793d650f16c6ea8de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 16:17:21.090222 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-d514724d-2856-4ed2-b87b-4844ea69a8cb tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96" status: 200 len: 1567 microversion: 2.1 time: 0.454064 Oct 27 16:17:21.090971 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 993/1915] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 16:17:20 2021] GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96 => generated 1567 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 16:17:21.638469 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [req-ab18e296-9414-4632-b552-0aa72af54260 req-cb42747a-9613-4d88-b163-e3ca4467d979 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "62c89161-c119-48b2-839d-712db798ff96", "name": "network-vif-deleted", "tag": "f24ff64f-4146-482c-b9d5-4ee7e53b36d2"}]} {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 16:17:21.649795 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 27 16:17:21.649795 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: warnings.warn(msg) Oct 27 16:17:21.674942 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [req-ab18e296-9414-4632-b552-0aa72af54260 req-cb42747a-9613-4d88-b163-e3ca4467d979 service nova] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:17:21.675365 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [req-ab18e296-9414-4632-b552-0aa72af54260 req-cb42747a-9613-4d88-b163-e3ca4467d979 service nova] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:17:21.707323 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.compute.server_external_events [req-ab18e296-9414-4632-b552-0aa72af54260 req-cb42747a-9613-4d88-b163-e3ca4467d979 service nova] Creating event network-vif-deleted:f24ff64f-4146-482c-b9d5-4ee7e53b36d2 for instance 62c89161-c119-48b2-839d-712db798ff96 on hv-cinder-80070 Oct 27 16:17:21.737751 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [req-ab18e296-9414-4632-b552-0aa72af54260 req-cb42747a-9613-4d88-b163-e3ca4467d979 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091478 Oct 27 16:17:21.739571 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 923/1916] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Oct 27 16:17:21 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 16:17:21.967618 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-11e61f91-50c8-4176-9561-ea83b3c8be68 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:17:21.969189 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-11e61f91-50c8-4176-9561-ea83b3c8be68 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] [instance: 28a08917-c3d3-4103-a106-c9c1f00eba8f] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:17:21.976387 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-11e61f91-50c8-4176-9561-ea83b3c8be68 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:17:21.977164 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-11e61f91-50c8-4176-9561-ea83b3c8be68 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:17:21.978164 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-11e61f91-50c8-4176-9561-ea83b3c8be68 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:17:21.978779 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-11e61f91-50c8-4176-9561-ea83b3c8be68 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:17:22.109377 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-106c5983-2aff-4fcd-a2ea-acd08e922fc8 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:17:22.110430 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-106c5983-2aff-4fcd-a2ea-acd08e922fc8 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: 62c89161-c119-48b2-839d-712db798ff96] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:17:22.117373 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-106c5983-2aff-4fcd-a2ea-acd08e922fc8 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:17:22.118229 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-106c5983-2aff-4fcd-a2ea-acd08e922fc8 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:17:22.119430 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-106c5983-2aff-4fcd-a2ea-acd08e922fc8 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:17:22.120200 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-106c5983-2aff-4fcd-a2ea-acd08e922fc8 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:17:22.179460 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-106c5983-2aff-4fcd-a2ea-acd08e922fc8 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:17:22.183601 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-106c5983-2aff-4fcd-a2ea-acd08e922fc8 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:17:22.185860 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.objects.instance [None req-106c5983-2aff-4fcd-a2ea-acd08e922fc8 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lazy-loading 'fault' on Instance uuid 62c89161-c119-48b2-839d-712db798ff96 {{(pid=122225) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 27 16:17:22.290203 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-106c5983-2aff-4fcd-a2ea-acd08e922fc8 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96b599f8890b4281a7e311cf37a039e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d7fcab5d3f465793d650f16c6ea8de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 16:17:22.300468 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-106c5983-2aff-4fcd-a2ea-acd08e922fc8 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96" status: 200 len: 1446 microversion: 2.1 time: 0.195512 Oct 27 16:17:22.302981 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 924/1917] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 16:17:22 2021] GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96 => generated 1446 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 16:17:22.412662 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-11e61f91-50c8-4176-9561-ea83b3c8be68 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6be4749041442787482b6e06b6c40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73f3238988e4e1293ad782712a1da53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 16:17:22.423683 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-11e61f91-50c8-4176-9561-ea83b3c8be68 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] 10.222.0.64 "GET /compute/v2.1/servers/28a08917-c3d3-4103-a106-c9c1f00eba8f" status: 200 len: 1318 microversion: 2.1 time: 0.459610 Oct 27 16:17:22.424620 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 994/1918] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 16:17:21 2021] GET /compute/v2.1/servers/28a08917-c3d3-4103-a106-c9c1f00eba8f => generated 1318 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 16:17:22.979995 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [req-a5551d72-502d-45c2-bfc6-8c0e887aa73d req-b7dae55b-6424-40ee-9d96-1bcfeb5c5585 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "28a08917-c3d3-4103-a106-c9c1f00eba8f", "tag": "d044e9e3-3156-4c7f-9e4a-f4749ade8f0c"}]} {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 16:17:22.981807 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 27 16:17:22.981807 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: warnings.warn(msg) Oct 27 16:17:22.993127 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [req-a5551d72-502d-45c2-bfc6-8c0e887aa73d req-b7dae55b-6424-40ee-9d96-1bcfeb5c5585 service nova] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:17:22.993683 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [req-a5551d72-502d-45c2-bfc6-8c0e887aa73d req-b7dae55b-6424-40ee-9d96-1bcfeb5c5585 service nova] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:17:23.006906 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.compute.server_external_events [req-a5551d72-502d-45c2-bfc6-8c0e887aa73d req-b7dae55b-6424-40ee-9d96-1bcfeb5c5585 service nova] Creating event network-changed:d044e9e3-3156-4c7f-9e4a-f4749ade8f0c for instance 28a08917-c3d3-4103-a106-c9c1f00eba8f on hv-cinder-80070 Oct 27 16:17:23.012698 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [req-a5551d72-502d-45c2-bfc6-8c0e887aa73d req-b7dae55b-6424-40ee-9d96-1bcfeb5c5585 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.218329 Oct 27 16:17:23.013591 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 925/1919] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Oct 27 16:17:22 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 16:17:23.319155 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-ec95c7c7-507c-4c32-98f8-a5f99d893b23 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:17:23.320631 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-ec95c7c7-507c-4c32-98f8-a5f99d893b23 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] [instance: 62c89161-c119-48b2-839d-712db798ff96] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:17:23.327295 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-ec95c7c7-507c-4c32-98f8-a5f99d893b23 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:17:23.327742 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-ec95c7c7-507c-4c32-98f8-a5f99d893b23 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:17:23.328581 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-ec95c7c7-507c-4c32-98f8-a5f99d893b23 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:17:23.329006 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-ec95c7c7-507c-4c32-98f8-a5f99d893b23 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:17:23.344036 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.wsgi [None req-ec95c7c7-507c-4c32-98f8-a5f99d893b23 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] HTTP exception thrown: Instance 62c89161-c119-48b2-839d-712db798ff96 could not be found. Oct 27 16:17:23.344946 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-ec95c7c7-507c-4c32-98f8-a5f99d893b23 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] Returning 404 to user: Instance 62c89161-c119-48b2-839d-712db798ff96 could not be found. {{(pid=122224) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 27 16:17:23.345981 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-ec95c7c7-507c-4c32-98f8-a5f99d893b23 tempest-ServerRescueNegativeTestJSON-665317558 tempest-ServerRescueNegativeTestJSON-665317558-project] 10.222.0.64 "GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96" status: 404 len: 111 microversion: 2.1 time: 0.031304 Oct 27 16:17:23.352403 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 995/1920] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 16:17:23 2021] GET /compute/v2.1/servers/62c89161-c119-48b2-839d-712db798ff96 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 27 16:17:23.450276 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-43b57c55-61c4-4d53-97f7-74822a64b3ab tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:17:23.452782 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-43b57c55-61c4-4d53-97f7-74822a64b3ab tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] [instance: 28a08917-c3d3-4103-a106-c9c1f00eba8f] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:17:23.464874 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-43b57c55-61c4-4d53-97f7-74822a64b3ab tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:17:23.466000 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-43b57c55-61c4-4d53-97f7-74822a64b3ab tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:17:23.467186 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-43b57c55-61c4-4d53-97f7-74822a64b3ab tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:17:23.468157 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-43b57c55-61c4-4d53-97f7-74822a64b3ab tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:17:23.782608 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-43b57c55-61c4-4d53-97f7-74822a64b3ab tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6be4749041442787482b6e06b6c40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73f3238988e4e1293ad782712a1da53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 16:17:23.800254 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-43b57c55-61c4-4d53-97f7-74822a64b3ab tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] 10.222.0.64 "GET /compute/v2.1/servers/28a08917-c3d3-4103-a106-c9c1f00eba8f" status: 200 len: 1318 microversion: 2.1 time: 0.360900 Oct 27 16:17:23.801985 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 926/1921] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 16:17:23 2021] GET /compute/v2.1/servers/28a08917-c3d3-4103-a106-c9c1f00eba8f => generated 1318 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 16:17:24.830339 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-60e37adf-8882-4255-bb70-939e61f203c5 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:17:24.831585 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-60e37adf-8882-4255-bb70-939e61f203c5 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] [instance: 28a08917-c3d3-4103-a106-c9c1f00eba8f] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:17:24.846673 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-60e37adf-8882-4255-bb70-939e61f203c5 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:17:24.847134 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-60e37adf-8882-4255-bb70-939e61f203c5 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:17:24.847999 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-60e37adf-8882-4255-bb70-939e61f203c5 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:17:24.848781 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-60e37adf-8882-4255-bb70-939e61f203c5 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:17:25.194943 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-60e37adf-8882-4255-bb70-939e61f203c5 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6be4749041442787482b6e06b6c40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73f3238988e4e1293ad782712a1da53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 16:17:25.204313 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-60e37adf-8882-4255-bb70-939e61f203c5 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] 10.222.0.64 "GET /compute/v2.1/servers/28a08917-c3d3-4103-a106-c9c1f00eba8f" status: 200 len: 1318 microversion: 2.1 time: 0.381128 Oct 27 16:17:25.205129 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 996/1922] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 16:17:24 2021] GET /compute/v2.1/servers/28a08917-c3d3-4103-a106-c9c1f00eba8f => generated 1318 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 16:17:26.221276 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-a3302c0b-e95a-4e64-bcd1-1fbac78c915c tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:17:26.222186 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-a3302c0b-e95a-4e64-bcd1-1fbac78c915c tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] [instance: 28a08917-c3d3-4103-a106-c9c1f00eba8f] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:17:26.229101 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-a3302c0b-e95a-4e64-bcd1-1fbac78c915c tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:17:26.229880 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-a3302c0b-e95a-4e64-bcd1-1fbac78c915c tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:17:26.230833 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-a3302c0b-e95a-4e64-bcd1-1fbac78c915c tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:17:26.231515 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-a3302c0b-e95a-4e64-bcd1-1fbac78c915c tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:17:26.516588 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-a3302c0b-e95a-4e64-bcd1-1fbac78c915c tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6be4749041442787482b6e06b6c40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73f3238988e4e1293ad782712a1da53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 16:17:26.529229 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-a3302c0b-e95a-4e64-bcd1-1fbac78c915c tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] 10.222.0.64 "GET /compute/v2.1/servers/28a08917-c3d3-4103-a106-c9c1f00eba8f" status: 200 len: 1318 microversion: 2.1 time: 0.311768 Oct 27 16:17:26.541134 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 927/1923] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 16:17:26 2021] GET /compute/v2.1/servers/28a08917-c3d3-4103-a106-c9c1f00eba8f => generated 1318 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 16:17:26.597756 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-8be11ab5-aa1c-42c3-a603-1f24fab5e8ae tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Action: 'create', calling method: .version_select at 0x7fbc0abfda60>, body: {"keypair": {"name": "tempest-keypair-360934905"}} {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 16:17:26.617867 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.quota [None req-8be11ab5-aa1c-42c3-a603-1f24fab5e8ae tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Getting quotas for project 0ac26dbbef464ff198b60547a106ce2a. Resources: {'key_pairs'} {{(pid=122224) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 27 16:17:26.622151 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.quota [None req-8be11ab5-aa1c-42c3-a603-1f24fab5e8ae tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Getting quotas for user d24c0e6b236d435bacfb99467b03254d and project 0ac26dbbef464ff198b60547a106ce2a. Resources: {'key_pairs'} {{(pid=122224) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 27 16:17:26.930901 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.quota [None req-8be11ab5-aa1c-42c3-a603-1f24fab5e8ae tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Getting quotas for project 0ac26dbbef464ff198b60547a106ce2a. Resources: {'key_pairs'} {{(pid=122224) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 27 16:17:26.936208 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.quota [None req-8be11ab5-aa1c-42c3-a603-1f24fab5e8ae tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Getting quotas for user d24c0e6b236d435bacfb99467b03254d and project 0ac26dbbef464ff198b60547a106ce2a. Resources: {'key_pairs'} {{(pid=122224) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 27 16:17:26.953900 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-8be11ab5-aa1c-42c3-a603-1f24fab5e8ae tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] 10.222.0.64 "POST /compute/v2.1/os-keypairs" status: 200 len: 2300 microversion: 2.1 time: 0.418719 Oct 27 16:17:26.954514 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 997/1924] 10.222.0.64 () {60 vars in 1157 bytes} [Wed Oct 27 16:17:26 2021] POST /compute/v2.1/os-keypairs => generated 2300 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 16:17:27.550266 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-924d02a4-f549-4046-b88c-50e08d0be2d9 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:17:27.553556 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-924d02a4-f549-4046-b88c-50e08d0be2d9 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] [instance: 28a08917-c3d3-4103-a106-c9c1f00eba8f] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:17:27.564015 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-924d02a4-f549-4046-b88c-50e08d0be2d9 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:17:27.565042 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-924d02a4-f549-4046-b88c-50e08d0be2d9 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:17:27.567440 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-924d02a4-f549-4046-b88c-50e08d0be2d9 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:17:27.568529 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-924d02a4-f549-4046-b88c-50e08d0be2d9 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:17:27.898808 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-924d02a4-f549-4046-b88c-50e08d0be2d9 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6be4749041442787482b6e06b6c40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73f3238988e4e1293ad782712a1da53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 16:17:27.919265 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-924d02a4-f549-4046-b88c-50e08d0be2d9 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] 10.222.0.64 "GET /compute/v2.1/servers/28a08917-c3d3-4103-a106-c9c1f00eba8f" status: 200 len: 1318 microversion: 2.1 time: 0.374561 Oct 27 16:17:27.920484 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 928/1925] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 16:17:27 2021] GET /compute/v2.1/servers/28a08917-c3d3-4103-a106-c9c1f00eba8f => generated 1318 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 16:17:28.937458 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-7a3bfb22-642e-465b-bfae-0f34df89cda9 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:17:28.938749 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-7a3bfb22-642e-465b-bfae-0f34df89cda9 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] [instance: 28a08917-c3d3-4103-a106-c9c1f00eba8f] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:17:28.963201 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-7a3bfb22-642e-465b-bfae-0f34df89cda9 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:17:28.963949 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-7a3bfb22-642e-465b-bfae-0f34df89cda9 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:17:28.968150 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-7a3bfb22-642e-465b-bfae-0f34df89cda9 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:17:28.970507 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-7a3bfb22-642e-465b-bfae-0f34df89cda9 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:17:29.038445 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-63581467-4fb1-4aa2-9274-bd6fbecbede0 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1343158152", "imageRef": "b585ffbc-6a36-48c9-81b3-e26f9bd0fcba", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ad10d048-5630-46ff-a3f3-4c2a7f3aa1a7"}], "security_groups": [{"name": "tempest-securitygroup--1509543838"}], "key_name": "tempest-keypair-360934905", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 16:17:29.153923 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.network.neutron [None req-63581467-4fb1-4aa2-9274-bd6fbecbede0 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] validate_networks() for [('ad10d048-5630-46ff-a3f3-4c2a7f3aa1a7', None, None, None, None, None)] {{(pid=122225) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Oct 27 16:17:29.154160 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-7a3bfb22-642e-465b-bfae-0f34df89cda9 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6be4749041442787482b6e06b6c40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73f3238988e4e1293ad782712a1da53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 16:17:29.175964 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-7a3bfb22-642e-465b-bfae-0f34df89cda9 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] 10.222.0.64 "GET /compute/v2.1/servers/28a08917-c3d3-4103-a106-c9c1f00eba8f" status: 200 len: 1318 microversion: 2.1 time: 0.240985 Oct 27 16:17:29.178441 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 998/1926] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 16:17:28 2021] GET /compute/v2.1/servers/28a08917-c3d3-4103-a106-c9c1f00eba8f => generated 1318 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 16:17:29.463871 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-c2fe4cc3-9dc3-4c6d-87a9-e9c36c1cdab1 tempest-VolumesSnapshotsTestJSON-1299422331 tempest-VolumesSnapshotsTestJSON-1299422331-project] Action: 'create', calling method: .version_select at 0x7fbc0ac02670>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-574041558"}} {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 16:17:29.691631 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.virt.hardware [None req-63581467-4fb1-4aa2-9274-bd6fbecbede0 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Flavor limits 0:0:0 {{(pid=122225) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 16:17:29.692753 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.virt.hardware [None req-63581467-4fb1-4aa2-9274-bd6fbecbede0 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Image limits 0:0:0 {{(pid=122225) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 16:17:29.693278 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.virt.hardware [None req-63581467-4fb1-4aa2-9274-bd6fbecbede0 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Flavor pref 0:0:0 {{(pid=122225) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 16:17:29.693918 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.virt.hardware [None req-63581467-4fb1-4aa2-9274-bd6fbecbede0 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Image pref 0:0:0 {{(pid=122225) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 16:17:29.694485 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.virt.hardware [None req-63581467-4fb1-4aa2-9274-bd6fbecbede0 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122225) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 16:17:29.708776 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-63581467-4fb1-4aa2-9274-bd6fbecbede0 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:17:29.709362 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-63581467-4fb1-4aa2-9274-bd6fbecbede0 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:17:29.710673 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-63581467-4fb1-4aa2-9274-bd6fbecbede0 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:17:29.711119 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-63581467-4fb1-4aa2-9274-bd6fbecbede0 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:17:29.733506 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.quota [None req-63581467-4fb1-4aa2-9274-bd6fbecbede0 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Getting quotas for project 0ac26dbbef464ff198b60547a106ce2a. Resources: {'ram', 'instances', 'cores'} {{(pid=122225) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 27 16:17:29.738371 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.quota [None req-63581467-4fb1-4aa2-9274-bd6fbecbede0 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Getting quotas for user d24c0e6b236d435bacfb99467b03254d and project 0ac26dbbef464ff198b60547a106ce2a. Resources: {'ram', 'instances', 'cores'} {{(pid=122225) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 27 16:17:29.752690 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-63581467-4fb1-4aa2-9274-bd6fbecbede0 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Going to run 1 instances... {{(pid=122225) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Oct 27 16:17:29.755543 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-63581467-4fb1-4aa2-9274-bd6fbecbede0 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] [instance: 70be9dd7-1f43-4843-be62-288d53f57c81] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b585ffbc-6a36-48c9-81b3-e26f9bd0fcba',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122225) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Oct 27 16:17:29.808804 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-63581467-4fb1-4aa2-9274-bd6fbecbede0 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.775328 Oct 27 16:17:29.814894 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 929/1927] 10.222.0.64 () {60 vars in 1146 bytes} [Wed Oct 27 16:17:29 2021] POST /compute/v2.1/servers => generated 402 bytes in 782 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 27 16:17:29.903976 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-c2fe4cc3-9dc3-4c6d-87a9-e9c36c1cdab1 tempest-VolumesSnapshotsTestJSON-1299422331 tempest-VolumesSnapshotsTestJSON-1299422331-project] 10.222.0.64 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 0.681189 Oct 27 16:17:29.911723 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 999/1928] 10.222.0.64 () {60 vars in 1154 bytes} [Wed Oct 27 16:17:29 2021] POST /compute/v2.1/os-volumes => generated 344 bytes in 684 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Oct 27 16:17:29.911723 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-981e03cb-eacc-4bc6-be90-9554726c0488 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:17:29.916056 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-981e03cb-eacc-4bc6-be90-9554726c0488 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] [instance: 70be9dd7-1f43-4843-be62-288d53f57c81] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:17:29.916483 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [req-af684de7-259b-4f51-9b78-8be9cc5611ff req-b19208d2-35b5-435d-aa4b-9d127fdaa7c8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "28a08917-c3d3-4103-a106-c9c1f00eba8f", "name": "network-vif-plugged", "status": "completed", "tag": "d044e9e3-3156-4c7f-9e4a-f4749ade8f0c"}]} {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 16:17:29.918153 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 27 16:17:29.918153 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: warnings.warn(msg) Oct 27 16:17:29.933693 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [req-af684de7-259b-4f51-9b78-8be9cc5611ff req-b19208d2-35b5-435d-aa4b-9d127fdaa7c8 service nova] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:17:29.934242 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [req-af684de7-259b-4f51-9b78-8be9cc5611ff req-b19208d2-35b5-435d-aa4b-9d127fdaa7c8 service nova] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:17:29.966107 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.compute.server_external_events [req-af684de7-259b-4f51-9b78-8be9cc5611ff req-b19208d2-35b5-435d-aa4b-9d127fdaa7c8 service nova] Creating event network-vif-plugged:d044e9e3-3156-4c7f-9e4a-f4749ade8f0c for instance 28a08917-c3d3-4103-a106-c9c1f00eba8f on hv-cinder-80070 Oct 27 16:17:29.976529 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [req-af684de7-259b-4f51-9b78-8be9cc5611ff req-b19208d2-35b5-435d-aa4b-9d127fdaa7c8 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.159911 Oct 27 16:17:29.980047 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 930/1929] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Oct 27 16:17:29 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 16:17:29.987264 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-6ffea9cb-d08c-4bfa-b234-3ed27d272463 tempest-VolumesSnapshotsTestJSON-1299422331 tempest-VolumesSnapshotsTestJSON-1299422331-project] Calling method '.version_select at 0x7fbc0ac29ca0>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:17:29.992648 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-981e03cb-eacc-4bc6-be90-9554726c0488 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd24c0e6b236d435bacfb99467b03254d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac26dbbef464ff198b60547a106ce2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 16:17:30.018005 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-981e03cb-eacc-4bc6-be90-9554726c0488 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] 10.222.0.64 "GET /compute/v2.1/servers/70be9dd7-1f43-4843-be62-288d53f57c81" status: 200 len: 1237 microversion: 2.1 time: 0.112091 Oct 27 16:17:30.019748 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 1000/1930] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 16:17:29 2021] GET /compute/v2.1/servers/70be9dd7-1f43-4843-be62-288d53f57c81 => generated 1237 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 16:17:30.056734 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-6ffea9cb-d08c-4bfa-b234-3ed27d272463 tempest-VolumesSnapshotsTestJSON-1299422331 tempest-VolumesSnapshotsTestJSON-1299422331-project] 10.222.0.64 "GET /compute/v2.1/os-volumes/bcce6b9d-6ce5-4938-beb4-35da357ee5a8" status: 200 len: 344 microversion: 2.1 time: 0.075347 Oct 27 16:17:30.058005 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 931/1931] 10.222.0.64 () {58 vars in 1244 bytes} [Wed Oct 27 16:17:29 2021] GET /compute/v2.1/os-volumes/bcce6b9d-6ce5-4938-beb4-35da357ee5a8 => generated 344 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 16:17:30.196372 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-9d4aa3ea-0591-42b7-bcc5-f65615f41511 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:17:30.197287 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-9d4aa3ea-0591-42b7-bcc5-f65615f41511 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] [instance: 28a08917-c3d3-4103-a106-c9c1f00eba8f] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:17:30.205893 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-9d4aa3ea-0591-42b7-bcc5-f65615f41511 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:17:30.206559 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-9d4aa3ea-0591-42b7-bcc5-f65615f41511 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:17:30.208110 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-9d4aa3ea-0591-42b7-bcc5-f65615f41511 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:17:30.210065 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-9d4aa3ea-0591-42b7-bcc5-f65615f41511 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:17:30.359093 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-9d4aa3ea-0591-42b7-bcc5-f65615f41511 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6be4749041442787482b6e06b6c40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73f3238988e4e1293ad782712a1da53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 16:17:30.367267 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-9d4aa3ea-0591-42b7-bcc5-f65615f41511 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] 10.222.0.64 "GET /compute/v2.1/servers/28a08917-c3d3-4103-a106-c9c1f00eba8f" status: 200 len: 1318 microversion: 2.1 time: 0.176692 Oct 27 16:17:30.368470 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 1001/1932] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 16:17:30 2021] GET /compute/v2.1/servers/28a08917-c3d3-4103-a106-c9c1f00eba8f => generated 1318 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 16:17:31.036661 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-40cc2008-0c8b-4887-8215-d56c4fcb14f8 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:17:31.038640 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-40cc2008-0c8b-4887-8215-d56c4fcb14f8 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] [instance: 70be9dd7-1f43-4843-be62-288d53f57c81] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:17:31.045710 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-40cc2008-0c8b-4887-8215-d56c4fcb14f8 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:17:31.047156 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-40cc2008-0c8b-4887-8215-d56c4fcb14f8 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:17:31.048105 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-40cc2008-0c8b-4887-8215-d56c4fcb14f8 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:17:31.048764 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-40cc2008-0c8b-4887-8215-d56c4fcb14f8 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:17:31.069930 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-34b0586a-94f5-4a66-b6bb-1ee423b9fe04 tempest-VolumesSnapshotsTestJSON-1299422331 tempest-VolumesSnapshotsTestJSON-1299422331-project] Calling method '.version_select at 0x7fbc05e618b0>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:17:31.122534 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-40cc2008-0c8b-4887-8215-d56c4fcb14f8 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd24c0e6b236d435bacfb99467b03254d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac26dbbef464ff198b60547a106ce2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 16:17:31.124921 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-34b0586a-94f5-4a66-b6bb-1ee423b9fe04 tempest-VolumesSnapshotsTestJSON-1299422331 tempest-VolumesSnapshotsTestJSON-1299422331-project] 10.222.0.64 "GET /compute/v2.1/os-volumes/bcce6b9d-6ce5-4938-beb4-35da357ee5a8" status: 200 len: 345 microversion: 2.1 time: 0.059943 Oct 27 16:17:31.125805 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 1002/1933] 10.222.0.64 () {58 vars in 1244 bytes} [Wed Oct 27 16:17:31 2021] GET /compute/v2.1/os-volumes/bcce6b9d-6ce5-4938-beb4-35da357ee5a8 => generated 345 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 16:17:31.135266 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-40cc2008-0c8b-4887-8215-d56c4fcb14f8 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] 10.222.0.64 "GET /compute/v2.1/servers/70be9dd7-1f43-4843-be62-288d53f57c81" status: 200 len: 1307 microversion: 2.1 time: 0.102617 Oct 27 16:17:31.141000 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-13b81e65-a105-492b-a8bb-56e785c59f13 tempest-VolumesSnapshotsTestJSON-1299422331 tempest-VolumesSnapshotsTestJSON-1299422331-project] Action: 'create', calling method: .version_select at 0x7fbc0ac4d670>, body: {"snapshot": {"volume_id": "bcce6b9d-6ce5-4938-beb4-35da357ee5a8", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-630559810"}} {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 16:17:31.147152 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 932/1934] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 16:17:31 2021] GET /compute/v2.1/servers/70be9dd7-1f43-4843-be62-288d53f57c81 => generated 1307 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 16:17:31.323279 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-13b81e65-a105-492b-a8bb-56e785c59f13 tempest-VolumesSnapshotsTestJSON-1299422331 tempest-VolumesSnapshotsTestJSON-1299422331-project] 10.222.0.64 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.189338 Oct 27 16:17:31.323898 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 1003/1935] 10.222.0.64 () {60 vars in 1161 bytes} [Wed Oct 27 16:17:31 2021] POST /compute/v2.1/os-snapshots => generated 286 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 16:17:31.335452 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-3baff701-4d94-4fe3-9b07-245b6604090c tempest-VolumesSnapshotsTestJSON-1299422331 tempest-VolumesSnapshotsTestJSON-1299422331-project] Calling method '.version_select at 0x7fbc0abef5e0>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:17:31.380988 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-3baff701-4d94-4fe3-9b07-245b6604090c tempest-VolumesSnapshotsTestJSON-1299422331 tempest-VolumesSnapshotsTestJSON-1299422331-project] 10.222.0.64 "GET /compute/v2.1/os-snapshots/ba7cb102-53a2-483b-8b48-4d23fba0e8ec" status: 200 len: 286 microversion: 2.1 time: 0.050538 Oct 27 16:17:31.386511 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 933/1936] 10.222.0.64 () {58 vars in 1250 bytes} [Wed Oct 27 16:17:31 2021] GET /compute/v2.1/os-snapshots/ba7cb102-53a2-483b-8b48-4d23fba0e8ec => generated 286 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 16:17:31.389399 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-a8e03983-6e4b-4a6d-99e0-9f20d9ed9f25 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:17:31.390673 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-a8e03983-6e4b-4a6d-99e0-9f20d9ed9f25 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] [instance: 28a08917-c3d3-4103-a106-c9c1f00eba8f] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:17:31.391709 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-67e6010c-1c61-4cc0-9211-705fe6189706 tempest-VolumesSnapshotsTestJSON-1299422331 tempest-VolumesSnapshotsTestJSON-1299422331-project] Calling method '.version_select at 0x7fbc0ac6e700>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:17:31.403445 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-a8e03983-6e4b-4a6d-99e0-9f20d9ed9f25 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:17:31.404672 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-a8e03983-6e4b-4a6d-99e0-9f20d9ed9f25 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:17:31.406090 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-a8e03983-6e4b-4a6d-99e0-9f20d9ed9f25 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:17:31.407152 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-a8e03983-6e4b-4a6d-99e0-9f20d9ed9f25 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:17:31.426072 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-67e6010c-1c61-4cc0-9211-705fe6189706 tempest-VolumesSnapshotsTestJSON-1299422331 tempest-VolumesSnapshotsTestJSON-1299422331-project] 10.222.0.64 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.038339 Oct 27 16:17:31.429866 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 934/1937] 10.222.0.64 () {58 vars in 1139 bytes} [Wed Oct 27 16:17:31 2021] GET /compute/v2.1/os-snapshots => generated 289 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 16:17:31.439394 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-e56a8d31-98d5-4fc1-9130-562ce672cde1 tempest-VolumesSnapshotsTestJSON-1299422331 tempest-VolumesSnapshotsTestJSON-1299422331-project] Calling method '.version_select at 0x7fbc0ac29c10>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:17:31.474284 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-e56a8d31-98d5-4fc1-9130-562ce672cde1 tempest-VolumesSnapshotsTestJSON-1299422331 tempest-VolumesSnapshotsTestJSON-1299422331-project] 10.222.0.64 "GET /compute/v2.1/os-snapshots/ba7cb102-53a2-483b-8b48-4d23fba0e8ec" status: 200 len: 286 microversion: 2.1 time: 0.039895 Oct 27 16:17:31.475728 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 935/1938] 10.222.0.64 () {58 vars in 1250 bytes} [Wed Oct 27 16:17:31 2021] GET /compute/v2.1/os-snapshots/ba7cb102-53a2-483b-8b48-4d23fba0e8ec => generated 286 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 16:17:31.570514 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-a8e03983-6e4b-4a6d-99e0-9f20d9ed9f25 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6be4749041442787482b6e06b6c40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73f3238988e4e1293ad782712a1da53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 16:17:31.579211 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-a8e03983-6e4b-4a6d-99e0-9f20d9ed9f25 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] 10.222.0.64 "GET /compute/v2.1/servers/28a08917-c3d3-4103-a106-c9c1f00eba8f" status: 200 len: 1506 microversion: 2.1 time: 0.197038 Oct 27 16:17:31.579900 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 1004/1939] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 16:17:31 2021] GET /compute/v2.1/servers/28a08917-c3d3-4103-a106-c9c1f00eba8f => generated 1506 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 16:17:31.595797 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-face005b-81c8-4d62-9ee4-28114482bc3d tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "27bdbf1a-8c5b-480b-935e-731fa93490eb", "device": "/dev/sdb"}} {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 16:17:31.596991 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-face005b-81c8-4d62-9ee4-28114482bc3d tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] [instance: 28a08917-c3d3-4103-a106-c9c1f00eba8f] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:17:31.603532 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-face005b-81c8-4d62-9ee4-28114482bc3d tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:17:31.604018 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-face005b-81c8-4d62-9ee4-28114482bc3d tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:17:31.604783 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-face005b-81c8-4d62-9ee4-28114482bc3d tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:17:31.605211 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-face005b-81c8-4d62-9ee4-28114482bc3d tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:17:32.153285 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-a3d67034-936c-4f89-a24c-1d0b43ceb919 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:17:32.153891 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-a3d67034-936c-4f89-a24c-1d0b43ceb919 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] [instance: 70be9dd7-1f43-4843-be62-288d53f57c81] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:17:32.160418 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-a3d67034-936c-4f89-a24c-1d0b43ceb919 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:17:32.162058 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-a3d67034-936c-4f89-a24c-1d0b43ceb919 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:17:32.162839 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-a3d67034-936c-4f89-a24c-1d0b43ceb919 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:17:32.163282 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-a3d67034-936c-4f89-a24c-1d0b43ceb919 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:17:32.299758 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-a3d67034-936c-4f89-a24c-1d0b43ceb919 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd24c0e6b236d435bacfb99467b03254d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac26dbbef464ff198b60547a106ce2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 16:17:32.308023 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-a3d67034-936c-4f89-a24c-1d0b43ceb919 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] 10.222.0.64 "GET /compute/v2.1/servers/70be9dd7-1f43-4843-be62-288d53f57c81" status: 200 len: 1363 microversion: 2.1 time: 0.158398 Oct 27 16:17:32.308649 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 1005/1940] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 16:17:32 2021] GET /compute/v2.1/servers/70be9dd7-1f43-4843-be62-288d53f57c81 => generated 1363 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 16:17:32.486772 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-827a279e-f4a5-4cc8-a986-82409ecf000f tempest-VolumesSnapshotsTestJSON-1299422331 tempest-VolumesSnapshotsTestJSON-1299422331-project] Calling method '.version_select at 0x7fbc05f388b0>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:17:32.520535 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-827a279e-f4a5-4cc8-a986-82409ecf000f tempest-VolumesSnapshotsTestJSON-1299422331 tempest-VolumesSnapshotsTestJSON-1299422331-project] 10.222.0.64 "GET /compute/v2.1/os-snapshots/ba7cb102-53a2-483b-8b48-4d23fba0e8ec" status: 200 len: 286 microversion: 2.1 time: 0.036848 Oct 27 16:17:32.521209 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 1006/1941] 10.222.0.64 () {58 vars in 1250 bytes} [Wed Oct 27 16:17:32 2021] GET /compute/v2.1/os-snapshots/ba7cb102-53a2-483b-8b48-4d23fba0e8ec => generated 286 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 16:17:33.326829 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-0a0b38dd-e24c-4d62-ac2f-1b9e5897a455 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:17:33.327548 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-0a0b38dd-e24c-4d62-ac2f-1b9e5897a455 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] [instance: 70be9dd7-1f43-4843-be62-288d53f57c81] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:17:33.334431 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-0a0b38dd-e24c-4d62-ac2f-1b9e5897a455 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:17:33.334895 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-0a0b38dd-e24c-4d62-ac2f-1b9e5897a455 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:17:33.335678 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-0a0b38dd-e24c-4d62-ac2f-1b9e5897a455 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:17:33.336140 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-0a0b38dd-e24c-4d62-ac2f-1b9e5897a455 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:17:33.462943 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-0a0b38dd-e24c-4d62-ac2f-1b9e5897a455 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd24c0e6b236d435bacfb99467b03254d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac26dbbef464ff198b60547a106ce2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 16:17:33.470826 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-0a0b38dd-e24c-4d62-ac2f-1b9e5897a455 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] 10.222.0.64 "GET /compute/v2.1/servers/70be9dd7-1f43-4843-be62-288d53f57c81" status: 200 len: 1363 microversion: 2.1 time: 0.148448 Oct 27 16:17:33.471324 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 1007/1942] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 16:17:33 2021] GET /compute/v2.1/servers/70be9dd7-1f43-4843-be62-288d53f57c81 => generated 1363 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 16:17:33.532698 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-bc447784-47ec-4acb-a25e-781d390f4d78 tempest-VolumesSnapshotsTestJSON-1299422331 tempest-VolumesSnapshotsTestJSON-1299422331-project] Calling method '.version_select at 0x7fbc0abfd700>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:17:33.564000 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-bc447784-47ec-4acb-a25e-781d390f4d78 tempest-VolumesSnapshotsTestJSON-1299422331 tempest-VolumesSnapshotsTestJSON-1299422331-project] 10.222.0.64 "GET /compute/v2.1/os-snapshots/ba7cb102-53a2-483b-8b48-4d23fba0e8ec" status: 200 len: 286 microversion: 2.1 time: 0.035209 Oct 27 16:17:33.564558 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 1008/1943] 10.222.0.64 () {58 vars in 1250 bytes} [Wed Oct 27 16:17:33 2021] GET /compute/v2.1/os-snapshots/ba7cb102-53a2-483b-8b48-4d23fba0e8ec => generated 286 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 16:17:34.489476 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-30ac987d-f5e6-4b1e-ae88-93a5e0b0fb23 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:17:34.490190 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-30ac987d-f5e6-4b1e-ae88-93a5e0b0fb23 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] [instance: 70be9dd7-1f43-4843-be62-288d53f57c81] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:17:34.496453 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-30ac987d-f5e6-4b1e-ae88-93a5e0b0fb23 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:17:34.496950 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-30ac987d-f5e6-4b1e-ae88-93a5e0b0fb23 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:17:34.497673 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-30ac987d-f5e6-4b1e-ae88-93a5e0b0fb23 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:17:34.498159 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-30ac987d-f5e6-4b1e-ae88-93a5e0b0fb23 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:17:34.635397 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-30ac987d-f5e6-4b1e-ae88-93a5e0b0fb23 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd24c0e6b236d435bacfb99467b03254d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac26dbbef464ff198b60547a106ce2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 16:17:34.645868 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-30ac987d-f5e6-4b1e-ae88-93a5e0b0fb23 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] 10.222.0.64 "GET /compute/v2.1/servers/70be9dd7-1f43-4843-be62-288d53f57c81" status: 200 len: 1363 microversion: 2.1 time: 0.160580 Oct 27 16:17:34.646695 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 1009/1944] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 16:17:34 2021] GET /compute/v2.1/servers/70be9dd7-1f43-4843-be62-288d53f57c81 => generated 1363 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 16:17:34.656232 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-0b66519d-1f71-4a3b-a1e3-1bdb653e29e5 tempest-VolumesSnapshotsTestJSON-1299422331 tempest-VolumesSnapshotsTestJSON-1299422331-project] Calling method '.version_select at 0x7fbc05d3f9d0>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:17:34.691392 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-0b66519d-1f71-4a3b-a1e3-1bdb653e29e5 tempest-VolumesSnapshotsTestJSON-1299422331 tempest-VolumesSnapshotsTestJSON-1299422331-project] 10.222.0.64 "GET /compute/v2.1/os-snapshots/ba7cb102-53a2-483b-8b48-4d23fba0e8ec" status: 200 len: 286 microversion: 2.1 time: 0.042699 Oct 27 16:17:34.693123 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 1010/1945] 10.222.0.64 () {58 vars in 1250 bytes} [Wed Oct 27 16:17:34 2021] GET /compute/v2.1/os-snapshots/ba7cb102-53a2-483b-8b48-4d23fba0e8ec => generated 286 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 16:17:34.869140 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-face005b-81c8-4d62-9ee4-28114482bc3d tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] 10.222.0.64 "POST /compute/v2.1/servers/28a08917-c3d3-4103-a106-c9c1f00eba8f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 3.276718 Oct 27 16:17:34.870613 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 936/1946] 10.222.0.64 () {60 vars in 1322 bytes} [Wed Oct 27 16:17:31 2021] POST /compute/v2.1/servers/28a08917-c3d3-4103-a106-c9c1f00eba8f/os-volume_attachments => generated 194 bytes in 3279 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 16:17:35.463299 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [req-c9ab77c3-5296-4e2f-b2e6-b3ec23574de5 req-f18eac7a-81c4-4883-a9ec-d1020df2c57a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "70be9dd7-1f43-4843-be62-288d53f57c81", "tag": "9092995e-af0c-485d-a42c-1090313651e1"}]} {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 16:17:35.466621 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 27 16:17:35.466621 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: warnings.warn(msg) Oct 27 16:17:35.493652 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [req-c9ab77c3-5296-4e2f-b2e6-b3ec23574de5 req-f18eac7a-81c4-4883-a9ec-d1020df2c57a service nova] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:17:35.495091 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [req-c9ab77c3-5296-4e2f-b2e6-b3ec23574de5 req-f18eac7a-81c4-4883-a9ec-d1020df2c57a service nova] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:17:35.517643 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.compute.server_external_events [req-c9ab77c3-5296-4e2f-b2e6-b3ec23574de5 req-f18eac7a-81c4-4883-a9ec-d1020df2c57a service nova] Creating event network-changed:9092995e-af0c-485d-a42c-1090313651e1 for instance 70be9dd7-1f43-4843-be62-288d53f57c81 on hv-cinder-80070 Oct 27 16:17:35.525513 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [req-c9ab77c3-5296-4e2f-b2e6-b3ec23574de5 req-f18eac7a-81c4-4883-a9ec-d1020df2c57a service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068516 Oct 27 16:17:35.526735 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 1011/1947] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Oct 27 16:17:35 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 16:17:35.673332 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-b5057524-f037-4bb2-be72-06771e3d783b tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:17:35.674465 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-b5057524-f037-4bb2-be72-06771e3d783b tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] [instance: 70be9dd7-1f43-4843-be62-288d53f57c81] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:17:35.684467 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-b5057524-f037-4bb2-be72-06771e3d783b tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:17:35.684964 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-b5057524-f037-4bb2-be72-06771e3d783b tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:17:35.685894 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-b5057524-f037-4bb2-be72-06771e3d783b tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:17:35.686423 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-b5057524-f037-4bb2-be72-06771e3d783b tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:17:35.705200 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-e6c7d14f-5c36-4f1a-9f47-5d1e9952c81a tempest-VolumesSnapshotsTestJSON-1299422331 tempest-VolumesSnapshotsTestJSON-1299422331-project] Calling method '.version_select at 0x7fbc05e61430>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:17:35.753124 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-e6c7d14f-5c36-4f1a-9f47-5d1e9952c81a tempest-VolumesSnapshotsTestJSON-1299422331 tempest-VolumesSnapshotsTestJSON-1299422331-project] 10.222.0.64 "GET /compute/v2.1/os-snapshots/ba7cb102-53a2-483b-8b48-4d23fba0e8ec" status: 200 len: 287 microversion: 2.1 time: 0.052240 Oct 27 16:17:35.753702 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 1012/1948] 10.222.0.64 () {58 vars in 1250 bytes} [Wed Oct 27 16:17:35 2021] GET /compute/v2.1/os-snapshots/ba7cb102-53a2-483b-8b48-4d23fba0e8ec => generated 287 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 16:17:35.763941 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-2851ad4e-af2d-4b53-ba88-5baa9e1df53e tempest-VolumesSnapshotsTestJSON-1299422331 tempest-VolumesSnapshotsTestJSON-1299422331-project] Calling method '.version_select at 0x7fbc06016280>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:17:35.827143 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-2851ad4e-af2d-4b53-ba88-5baa9e1df53e tempest-VolumesSnapshotsTestJSON-1299422331 tempest-VolumesSnapshotsTestJSON-1299422331-project] 10.222.0.64 "DELETE /compute/v2.1/os-snapshots/ba7cb102-53a2-483b-8b48-4d23fba0e8ec" status: 202 len: 0 microversion: 2.1 time: 0.065828 Oct 27 16:17:35.828717 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 1013/1949] 10.222.0.64 () {58 vars in 1253 bytes} [Wed Oct 27 16:17:35 2021] DELETE /compute/v2.1/os-snapshots/ba7cb102-53a2-483b-8b48-4d23fba0e8ec => generated 0 bytes in 69 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 27 16:17:35.838673 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-13a9bae1-7af5-4302-b4ca-cb2aac33b664 tempest-VolumesSnapshotsTestJSON-1299422331 tempest-VolumesSnapshotsTestJSON-1299422331-project] Calling method '.version_select at 0x7fbc05fa3a60>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:17:35.869390 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-13a9bae1-7af5-4302-b4ca-cb2aac33b664 tempest-VolumesSnapshotsTestJSON-1299422331 tempest-VolumesSnapshotsTestJSON-1299422331-project] 10.222.0.64 "GET /compute/v2.1/os-snapshots/ba7cb102-53a2-483b-8b48-4d23fba0e8ec" status: 200 len: 286 microversion: 2.1 time: 0.035394 Oct 27 16:17:35.869958 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 1014/1950] 10.222.0.64 () {58 vars in 1250 bytes} [Wed Oct 27 16:17:35 2021] GET /compute/v2.1/os-snapshots/ba7cb102-53a2-483b-8b48-4d23fba0e8ec => generated 286 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 16:17:35.920591 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-b5057524-f037-4bb2-be72-06771e3d783b tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd24c0e6b236d435bacfb99467b03254d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac26dbbef464ff198b60547a106ce2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 16:17:35.929976 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-b5057524-f037-4bb2-be72-06771e3d783b tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] 10.222.0.64 "GET /compute/v2.1/servers/70be9dd7-1f43-4843-be62-288d53f57c81" status: 200 len: 1363 microversion: 2.1 time: 0.262284 Oct 27 16:17:35.930613 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 937/1951] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 16:17:35 2021] GET /compute/v2.1/servers/70be9dd7-1f43-4843-be62-288d53f57c81 => generated 1363 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 16:17:36.882595 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-1967c294-6846-4613-a4aa-3e68269382af tempest-VolumesSnapshotsTestJSON-1299422331 tempest-VolumesSnapshotsTestJSON-1299422331-project] Calling method '.version_select at 0x7fbc06016a60>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:17:36.908891 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.wsgi [None req-1967c294-6846-4613-a4aa-3e68269382af tempest-VolumesSnapshotsTestJSON-1299422331 tempest-VolumesSnapshotsTestJSON-1299422331-project] HTTP exception thrown: Snapshot ba7cb102-53a2-483b-8b48-4d23fba0e8ec could not be found. Oct 27 16:17:36.909500 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-1967c294-6846-4613-a4aa-3e68269382af tempest-VolumesSnapshotsTestJSON-1299422331 tempest-VolumesSnapshotsTestJSON-1299422331-project] Returning 404 to user: Snapshot ba7cb102-53a2-483b-8b48-4d23fba0e8ec could not be found. {{(pid=122224) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 27 16:17:36.910846 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-1967c294-6846-4613-a4aa-3e68269382af tempest-VolumesSnapshotsTestJSON-1299422331 tempest-VolumesSnapshotsTestJSON-1299422331-project] 10.222.0.64 "GET /compute/v2.1/os-snapshots/ba7cb102-53a2-483b-8b48-4d23fba0e8ec" status: 404 len: 111 microversion: 2.1 time: 0.032634 Oct 27 16:17:36.911396 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 1015/1952] 10.222.0.64 () {58 vars in 1250 bytes} [Wed Oct 27 16:17:36 2021] GET /compute/v2.1/os-snapshots/ba7cb102-53a2-483b-8b48-4d23fba0e8ec => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 16:17:36.921605 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-2f1dc9fa-8bd0-4baa-9e7a-7247ac4d6f57 tempest-VolumesSnapshotsTestJSON-1299422331 tempest-VolumesSnapshotsTestJSON-1299422331-project] Calling method '.version_select at 0x7fbc0ac6e700>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:17:36.957696 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-f22006bb-4165-46b4-81f7-394923a35f0e tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:17:36.958730 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-f22006bb-4165-46b4-81f7-394923a35f0e tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] [instance: 70be9dd7-1f43-4843-be62-288d53f57c81] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:17:36.967297 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-f22006bb-4165-46b4-81f7-394923a35f0e tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:17:36.968046 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-f22006bb-4165-46b4-81f7-394923a35f0e tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:17:36.968742 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-f22006bb-4165-46b4-81f7-394923a35f0e tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:17:36.969197 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-f22006bb-4165-46b4-81f7-394923a35f0e tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:17:36.995312 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-2f1dc9fa-8bd0-4baa-9e7a-7247ac4d6f57 tempest-VolumesSnapshotsTestJSON-1299422331 tempest-VolumesSnapshotsTestJSON-1299422331-project] 10.222.0.64 "DELETE /compute/v2.1/os-volumes/bcce6b9d-6ce5-4938-beb4-35da357ee5a8" status: 202 len: 0 microversion: 2.1 time: 0.073590 Oct 27 16:17:36.995312 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 938/1953] 10.222.0.64 () {58 vars in 1247 bytes} [Wed Oct 27 16:17:36 2021] DELETE /compute/v2.1/os-volumes/bcce6b9d-6ce5-4938-beb4-35da357ee5a8 => generated 0 bytes in 75 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 27 16:17:37.004607 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-9087fc95-269a-4dc3-a2ed-e91320a59564 tempest-VolumesSnapshotsTestJSON-1299422331 tempest-VolumesSnapshotsTestJSON-1299422331-project] Calling method '.version_select at 0x7fbc0ac29790>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:17:37.070242 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-9087fc95-269a-4dc3-a2ed-e91320a59564 tempest-VolumesSnapshotsTestJSON-1299422331 tempest-VolumesSnapshotsTestJSON-1299422331-project] 10.222.0.64 "GET /compute/v2.1/os-volumes/bcce6b9d-6ce5-4938-beb4-35da357ee5a8" status: 200 len: 344 microversion: 2.1 time: 0.073045 Oct 27 16:17:37.071066 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 939/1954] 10.222.0.64 () {58 vars in 1244 bytes} [Wed Oct 27 16:17:36 2021] GET /compute/v2.1/os-volumes/bcce6b9d-6ce5-4938-beb4-35da357ee5a8 => generated 344 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 16:17:37.128679 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-f22006bb-4165-46b4-81f7-394923a35f0e tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd24c0e6b236d435bacfb99467b03254d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac26dbbef464ff198b60547a106ce2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 16:17:37.136512 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-f22006bb-4165-46b4-81f7-394923a35f0e tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] 10.222.0.64 "GET /compute/v2.1/servers/70be9dd7-1f43-4843-be62-288d53f57c81" status: 200 len: 1363 microversion: 2.1 time: 0.184202 Oct 27 16:17:37.137012 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 1016/1955] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 16:17:36 2021] GET /compute/v2.1/servers/70be9dd7-1f43-4843-be62-288d53f57c81 => generated 1363 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 16:17:38.082521 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-7951f3c8-cada-44d2-b43f-acfedd88cbc1 tempest-VolumesSnapshotsTestJSON-1299422331 tempest-VolumesSnapshotsTestJSON-1299422331-project] Calling method '.version_select at 0x7fbc0abf53a0>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:17:38.109616 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.wsgi [None req-7951f3c8-cada-44d2-b43f-acfedd88cbc1 tempest-VolumesSnapshotsTestJSON-1299422331 tempest-VolumesSnapshotsTestJSON-1299422331-project] HTTP exception thrown: Volume bcce6b9d-6ce5-4938-beb4-35da357ee5a8 could not be found. Oct 27 16:17:38.110224 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-7951f3c8-cada-44d2-b43f-acfedd88cbc1 tempest-VolumesSnapshotsTestJSON-1299422331 tempest-VolumesSnapshotsTestJSON-1299422331-project] Returning 404 to user: Volume bcce6b9d-6ce5-4938-beb4-35da357ee5a8 could not be found. {{(pid=122225) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 27 16:17:38.111058 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-7951f3c8-cada-44d2-b43f-acfedd88cbc1 tempest-VolumesSnapshotsTestJSON-1299422331 tempest-VolumesSnapshotsTestJSON-1299422331-project] 10.222.0.64 "GET /compute/v2.1/os-volumes/bcce6b9d-6ce5-4938-beb4-35da357ee5a8" status: 404 len: 109 microversion: 2.1 time: 0.032636 Oct 27 16:17:38.111597 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 940/1956] 10.222.0.64 () {58 vars in 1244 bytes} [Wed Oct 27 16:17:38 2021] GET /compute/v2.1/os-volumes/bcce6b9d-6ce5-4938-beb4-35da357ee5a8 => generated 109 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 16:17:38.131212 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-95c178af-9fcd-48ed-a7b9-764ae35a053b tempest-VolumesSnapshotsTestJSON-1299422331 tempest-VolumesSnapshotsTestJSON-1299422331-project] Calling method '.version_select at 0x7fbc05e781f0>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:17:38.153874 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-f5f68b19-35ab-4379-aa5a-403edb6193cb tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:17:38.154526 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-f5f68b19-35ab-4379-aa5a-403edb6193cb tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] [instance: 70be9dd7-1f43-4843-be62-288d53f57c81] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:17:38.158618 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.wsgi [None req-95c178af-9fcd-48ed-a7b9-764ae35a053b tempest-VolumesSnapshotsTestJSON-1299422331 tempest-VolumesSnapshotsTestJSON-1299422331-project] HTTP exception thrown: Volume bcce6b9d-6ce5-4938-beb4-35da357ee5a8 could not be found. Oct 27 16:17:38.159217 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-95c178af-9fcd-48ed-a7b9-764ae35a053b tempest-VolumesSnapshotsTestJSON-1299422331 tempest-VolumesSnapshotsTestJSON-1299422331-project] Returning 404 to user: Volume bcce6b9d-6ce5-4938-beb4-35da357ee5a8 could not be found. {{(pid=122224) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 27 16:17:38.160085 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-95c178af-9fcd-48ed-a7b9-764ae35a053b tempest-VolumesSnapshotsTestJSON-1299422331 tempest-VolumesSnapshotsTestJSON-1299422331-project] 10.222.0.64 "DELETE /compute/v2.1/os-volumes/bcce6b9d-6ce5-4938-beb4-35da357ee5a8" status: 404 len: 109 microversion: 2.1 time: 0.033606 Oct 27 16:17:38.161293 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 1017/1957] 10.222.0.64 () {58 vars in 1247 bytes} [Wed Oct 27 16:17:38 2021] DELETE /compute/v2.1/os-volumes/bcce6b9d-6ce5-4938-beb4-35da357ee5a8 => generated 109 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 27 16:17:38.162732 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-f5f68b19-35ab-4379-aa5a-403edb6193cb tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:17:38.163175 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-f5f68b19-35ab-4379-aa5a-403edb6193cb tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:17:38.163994 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-f5f68b19-35ab-4379-aa5a-403edb6193cb tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:17:38.164516 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-f5f68b19-35ab-4379-aa5a-403edb6193cb tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:17:38.169228 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-45b4155f-2cae-4f1b-8c05-5bb6dd4879a7 tempest-VolumesSnapshotsTestJSON-1299422331 tempest-VolumesSnapshotsTestJSON-1299422331-project] Calling method '.version_select at 0x7fbc05c39550>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:17:38.197037 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.wsgi [None req-45b4155f-2cae-4f1b-8c05-5bb6dd4879a7 tempest-VolumesSnapshotsTestJSON-1299422331 tempest-VolumesSnapshotsTestJSON-1299422331-project] HTTP exception thrown: Volume bcce6b9d-6ce5-4938-beb4-35da357ee5a8 could not be found. Oct 27 16:17:38.197630 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-45b4155f-2cae-4f1b-8c05-5bb6dd4879a7 tempest-VolumesSnapshotsTestJSON-1299422331 tempest-VolumesSnapshotsTestJSON-1299422331-project] Returning 404 to user: Volume bcce6b9d-6ce5-4938-beb4-35da357ee5a8 could not be found. {{(pid=122224) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 27 16:17:38.199233 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-45b4155f-2cae-4f1b-8c05-5bb6dd4879a7 tempest-VolumesSnapshotsTestJSON-1299422331 tempest-VolumesSnapshotsTestJSON-1299422331-project] 10.222.0.64 "GET /compute/v2.1/os-volumes/bcce6b9d-6ce5-4938-beb4-35da357ee5a8" status: 404 len: 109 microversion: 2.1 time: 0.033530 Oct 27 16:17:38.199936 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 1018/1958] 10.222.0.64 () {58 vars in 1244 bytes} [Wed Oct 27 16:17:38 2021] GET /compute/v2.1/os-volumes/bcce6b9d-6ce5-4938-beb4-35da357ee5a8 => generated 109 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 16:17:38.297335 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-f5f68b19-35ab-4379-aa5a-403edb6193cb tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd24c0e6b236d435bacfb99467b03254d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac26dbbef464ff198b60547a106ce2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 16:17:38.305207 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-f5f68b19-35ab-4379-aa5a-403edb6193cb tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] 10.222.0.64 "GET /compute/v2.1/servers/70be9dd7-1f43-4843-be62-288d53f57c81" status: 200 len: 1363 microversion: 2.1 time: 0.155039 Oct 27 16:17:38.305784 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 941/1959] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 16:17:38 2021] GET /compute/v2.1/servers/70be9dd7-1f43-4843-be62-288d53f57c81 => generated 1363 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 16:17:39.323363 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-944d3068-e56a-4109-afa3-b7088a9ef3ff tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:17:39.324170 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-944d3068-e56a-4109-afa3-b7088a9ef3ff tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] [instance: 70be9dd7-1f43-4843-be62-288d53f57c81] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:17:39.331308 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-944d3068-e56a-4109-afa3-b7088a9ef3ff tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:17:39.331760 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-944d3068-e56a-4109-afa3-b7088a9ef3ff tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:17:39.332731 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-944d3068-e56a-4109-afa3-b7088a9ef3ff tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:17:39.333161 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-944d3068-e56a-4109-afa3-b7088a9ef3ff tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:17:39.467646 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-944d3068-e56a-4109-afa3-b7088a9ef3ff tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd24c0e6b236d435bacfb99467b03254d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac26dbbef464ff198b60547a106ce2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 16:17:39.476102 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-944d3068-e56a-4109-afa3-b7088a9ef3ff tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] 10.222.0.64 "GET /compute/v2.1/servers/70be9dd7-1f43-4843-be62-288d53f57c81" status: 200 len: 1363 microversion: 2.1 time: 0.156805 Oct 27 16:17:39.476668 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 1019/1960] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 16:17:39 2021] GET /compute/v2.1/servers/70be9dd7-1f43-4843-be62-288d53f57c81 => generated 1363 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 16:17:40.493552 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-dd5a5f43-dda0-4d43-8623-3f112fe69f16 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:17:40.494178 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-dd5a5f43-dda0-4d43-8623-3f112fe69f16 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] [instance: 70be9dd7-1f43-4843-be62-288d53f57c81] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:17:40.501090 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-dd5a5f43-dda0-4d43-8623-3f112fe69f16 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:17:40.501697 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-dd5a5f43-dda0-4d43-8623-3f112fe69f16 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:17:40.502493 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-dd5a5f43-dda0-4d43-8623-3f112fe69f16 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:17:40.502929 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-dd5a5f43-dda0-4d43-8623-3f112fe69f16 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:17:40.652920 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-dd5a5f43-dda0-4d43-8623-3f112fe69f16 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd24c0e6b236d435bacfb99467b03254d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac26dbbef464ff198b60547a106ce2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 16:17:40.664927 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-dd5a5f43-dda0-4d43-8623-3f112fe69f16 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] 10.222.0.64 "GET /compute/v2.1/servers/70be9dd7-1f43-4843-be62-288d53f57c81" status: 200 len: 1363 microversion: 2.1 time: 0.174709 Oct 27 16:17:40.666525 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 942/1961] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 16:17:40 2021] GET /compute/v2.1/servers/70be9dd7-1f43-4843-be62-288d53f57c81 => generated 1363 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 16:17:40.928461 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [req-219f7e46-ed42-40e8-a8b2-b0d0e2236785 req-98d80339-cb5e-40bb-a23b-0e817f6e263b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "70be9dd7-1f43-4843-be62-288d53f57c81", "name": "network-vif-plugged", "status": "completed", "tag": "9092995e-af0c-485d-a42c-1090313651e1"}]} {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 16:17:40.930903 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 27 16:17:40.930903 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: warnings.warn(msg) Oct 27 16:17:40.938691 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [req-219f7e46-ed42-40e8-a8b2-b0d0e2236785 req-98d80339-cb5e-40bb-a23b-0e817f6e263b service nova] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:17:40.939153 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [req-219f7e46-ed42-40e8-a8b2-b0d0e2236785 req-98d80339-cb5e-40bb-a23b-0e817f6e263b service nova] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:17:40.952135 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.compute.server_external_events [req-219f7e46-ed42-40e8-a8b2-b0d0e2236785 req-98d80339-cb5e-40bb-a23b-0e817f6e263b service nova] Creating event network-vif-plugged:9092995e-af0c-485d-a42c-1090313651e1 for instance 70be9dd7-1f43-4843-be62-288d53f57c81 on hv-cinder-80070 Oct 27 16:17:40.959260 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [req-219f7e46-ed42-40e8-a8b2-b0d0e2236785 req-98d80339-cb5e-40bb-a23b-0e817f6e263b service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037361 Oct 27 16:17:40.959884 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 1020/1962] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Oct 27 16:17:40 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 16:17:41.685924 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-b6ad7fb3-9aa2-4c83-b101-d754e5620a58 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:17:41.686945 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-b6ad7fb3-9aa2-4c83-b101-d754e5620a58 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] [instance: 70be9dd7-1f43-4843-be62-288d53f57c81] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:17:41.698838 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-b6ad7fb3-9aa2-4c83-b101-d754e5620a58 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:17:41.699540 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-b6ad7fb3-9aa2-4c83-b101-d754e5620a58 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:17:41.701091 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-b6ad7fb3-9aa2-4c83-b101-d754e5620a58 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:17:41.701801 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-b6ad7fb3-9aa2-4c83-b101-d754e5620a58 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:17:41.834417 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-b6ad7fb3-9aa2-4c83-b101-d754e5620a58 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd24c0e6b236d435bacfb99467b03254d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac26dbbef464ff198b60547a106ce2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 16:17:41.842063 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-b6ad7fb3-9aa2-4c83-b101-d754e5620a58 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] 10.222.0.64 "GET /compute/v2.1/servers/70be9dd7-1f43-4843-be62-288d53f57c81" status: 200 len: 1363 microversion: 2.1 time: 0.161971 Oct 27 16:17:41.842618 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 943/1963] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 16:17:41 2021] GET /compute/v2.1/servers/70be9dd7-1f43-4843-be62-288d53f57c81 => generated 1363 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 16:17:42.859678 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-b1a0c189-4503-4ebd-b3e3-1eae9eb1025e tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:17:42.860400 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-b1a0c189-4503-4ebd-b3e3-1eae9eb1025e tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] [instance: 70be9dd7-1f43-4843-be62-288d53f57c81] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:17:42.867220 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-b1a0c189-4503-4ebd-b3e3-1eae9eb1025e tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:17:42.867656 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-b1a0c189-4503-4ebd-b3e3-1eae9eb1025e tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:17:42.868455 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-b1a0c189-4503-4ebd-b3e3-1eae9eb1025e tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:17:42.868886 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-b1a0c189-4503-4ebd-b3e3-1eae9eb1025e tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:17:43.011490 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-b1a0c189-4503-4ebd-b3e3-1eae9eb1025e tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd24c0e6b236d435bacfb99467b03254d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac26dbbef464ff198b60547a106ce2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 16:17:43.020384 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-b1a0c189-4503-4ebd-b3e3-1eae9eb1025e tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] 10.222.0.64 "GET /compute/v2.1/servers/70be9dd7-1f43-4843-be62-288d53f57c81" status: 200 len: 1363 microversion: 2.1 time: 0.164649 Oct 27 16:17:43.021040 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 1021/1964] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 16:17:42 2021] GET /compute/v2.1/servers/70be9dd7-1f43-4843-be62-288d53f57c81 => generated 1363 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 16:17:44.037532 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-cdb65d03-e364-4f98-b1ef-b20d3dcedac2 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:17:44.038135 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-cdb65d03-e364-4f98-b1ef-b20d3dcedac2 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] [instance: 70be9dd7-1f43-4843-be62-288d53f57c81] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:17:44.044564 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-cdb65d03-e364-4f98-b1ef-b20d3dcedac2 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:17:44.045006 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-cdb65d03-e364-4f98-b1ef-b20d3dcedac2 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:17:44.045783 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-cdb65d03-e364-4f98-b1ef-b20d3dcedac2 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:17:44.046217 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-cdb65d03-e364-4f98-b1ef-b20d3dcedac2 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:17:44.180564 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-cdb65d03-e364-4f98-b1ef-b20d3dcedac2 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd24c0e6b236d435bacfb99467b03254d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac26dbbef464ff198b60547a106ce2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 16:17:44.188295 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-cdb65d03-e364-4f98-b1ef-b20d3dcedac2 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] 10.222.0.64 "GET /compute/v2.1/servers/70be9dd7-1f43-4843-be62-288d53f57c81" status: 200 len: 1363 microversion: 2.1 time: 0.154543 Oct 27 16:17:44.188872 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 944/1965] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 16:17:44 2021] GET /compute/v2.1/servers/70be9dd7-1f43-4843-be62-288d53f57c81 => generated 1363 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 16:17:45.206958 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-4f06dc4f-0ea7-4793-a7ef-a6cca3462fb5 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:17:45.207577 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-4f06dc4f-0ea7-4793-a7ef-a6cca3462fb5 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] [instance: 70be9dd7-1f43-4843-be62-288d53f57c81] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:17:45.215827 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-4f06dc4f-0ea7-4793-a7ef-a6cca3462fb5 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:17:45.216318 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-4f06dc4f-0ea7-4793-a7ef-a6cca3462fb5 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:17:45.218228 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-4f06dc4f-0ea7-4793-a7ef-a6cca3462fb5 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:17:45.218228 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-4f06dc4f-0ea7-4793-a7ef-a6cca3462fb5 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:17:45.372145 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-4f06dc4f-0ea7-4793-a7ef-a6cca3462fb5 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd24c0e6b236d435bacfb99467b03254d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac26dbbef464ff198b60547a106ce2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 16:17:45.381146 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-4f06dc4f-0ea7-4793-a7ef-a6cca3462fb5 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] 10.222.0.64 "GET /compute/v2.1/servers/70be9dd7-1f43-4843-be62-288d53f57c81" status: 200 len: 1363 microversion: 2.1 time: 0.178762 Oct 27 16:17:45.381753 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 1022/1966] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 16:17:45 2021] GET /compute/v2.1/servers/70be9dd7-1f43-4843-be62-288d53f57c81 => generated 1363 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 16:17:46.398716 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-483481e5-d752-46f3-8a1f-0694e23fcf12 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:17:46.399347 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-483481e5-d752-46f3-8a1f-0694e23fcf12 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] [instance: 70be9dd7-1f43-4843-be62-288d53f57c81] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:17:46.405216 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-483481e5-d752-46f3-8a1f-0694e23fcf12 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:17:46.405657 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-483481e5-d752-46f3-8a1f-0694e23fcf12 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:17:46.406412 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-483481e5-d752-46f3-8a1f-0694e23fcf12 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:17:46.406841 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-483481e5-d752-46f3-8a1f-0694e23fcf12 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:17:46.532018 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-483481e5-d752-46f3-8a1f-0694e23fcf12 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd24c0e6b236d435bacfb99467b03254d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac26dbbef464ff198b60547a106ce2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 16:17:46.540199 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-483481e5-d752-46f3-8a1f-0694e23fcf12 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] 10.222.0.64 "GET /compute/v2.1/servers/70be9dd7-1f43-4843-be62-288d53f57c81" status: 200 len: 1548 microversion: 2.1 time: 0.146215 Oct 27 16:17:46.540781 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 945/1967] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 16:17:46 2021] GET /compute/v2.1/servers/70be9dd7-1f43-4843-be62-288d53f57c81 => generated 1548 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 16:17:46.556669 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-720f26d4-ea85-4500-853f-f5f9fb9580ae tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:17:46.557286 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-720f26d4-ea85-4500-853f-f5f9fb9580ae tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] [instance: 70be9dd7-1f43-4843-be62-288d53f57c81] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:17:46.563462 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-720f26d4-ea85-4500-853f-f5f9fb9580ae tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:17:46.563943 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-720f26d4-ea85-4500-853f-f5f9fb9580ae tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:17:46.564729 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-720f26d4-ea85-4500-853f-f5f9fb9580ae tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:17:46.565156 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-720f26d4-ea85-4500-853f-f5f9fb9580ae tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:17:46.659216 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-720f26d4-ea85-4500-853f-f5f9fb9580ae tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] 10.222.0.64 "GET /compute/v2.1/servers/70be9dd7-1f43-4843-be62-288d53f57c81/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.106254 Oct 27 16:17:46.659812 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 1023/1968] 10.222.0.64 () {58 vars in 1274 bytes} [Wed Oct 27 16:17:46 2021] GET /compute/v2.1/servers/70be9dd7-1f43-4843-be62-288d53f57c81/os-interface => generated 284 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 16:17:47.661830 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [req-c8eed3bd-9df2-42de-a05c-670da82a2c98 req-cd8fcee1-4e20-4763-9d88-f4df6354640b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "70be9dd7-1f43-4843-be62-288d53f57c81", "tag": "9092995e-af0c-485d-a42c-1090313651e1"}]} {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 16:17:47.663402 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 27 16:17:47.663402 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: warnings.warn(msg) Oct 27 16:17:47.664472 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-2726c37c-c2aa-4f91-b4d5-8eb8367ea39d tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 16:17:47.665388 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-2726c37c-c2aa-4f91-b4d5-8eb8367ea39d tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] [instance: 70be9dd7-1f43-4843-be62-288d53f57c81] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:17:47.671020 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [req-c8eed3bd-9df2-42de-a05c-670da82a2c98 req-cd8fcee1-4e20-4763-9d88-f4df6354640b service nova] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:17:47.671335 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-2726c37c-c2aa-4f91-b4d5-8eb8367ea39d tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:17:47.671696 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [req-c8eed3bd-9df2-42de-a05c-670da82a2c98 req-cd8fcee1-4e20-4763-9d88-f4df6354640b service nova] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:17:47.671841 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-2726c37c-c2aa-4f91-b4d5-8eb8367ea39d tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:17:47.672584 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-2726c37c-c2aa-4f91-b4d5-8eb8367ea39d tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:17:47.673020 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-2726c37c-c2aa-4f91-b4d5-8eb8367ea39d tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:17:47.683679 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.compute.server_external_events [req-c8eed3bd-9df2-42de-a05c-670da82a2c98 req-cd8fcee1-4e20-4763-9d88-f4df6354640b service nova] Creating event network-changed:9092995e-af0c-485d-a42c-1090313651e1 for instance 70be9dd7-1f43-4843-be62-288d53f57c81 on hv-cinder-80070 Oct 27 16:17:47.688867 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [req-c8eed3bd-9df2-42de-a05c-670da82a2c98 req-cd8fcee1-4e20-4763-9d88-f4df6354640b service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031479 Oct 27 16:17:47.689488 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 946/1969] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Oct 27 16:17:47 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 16:17:48.424507 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-2726c37c-c2aa-4f91-b4d5-8eb8367ea39d tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] 10.222.0.64 "POST /compute/v2.1/servers/70be9dd7-1f43-4843-be62-288d53f57c81/action" status: 200 len: 14 microversion: 2.1 time: 0.764931 Oct 27 16:17:48.430007 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 1024/1970] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Oct 27 16:17:47 2021] POST /compute/v2.1/servers/70be9dd7-1f43-4843-be62-288d53f57c81/action => generated 14 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 27 16:17:49.437841 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-01414769-1afa-497c-b974-130d23883a02 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 16:17:49.438829 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-01414769-1afa-497c-b974-130d23883a02 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] [instance: 70be9dd7-1f43-4843-be62-288d53f57c81] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:17:49.447010 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-01414769-1afa-497c-b974-130d23883a02 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:17:49.447652 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-01414769-1afa-497c-b974-130d23883a02 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:17:49.448629 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-01414769-1afa-497c-b974-130d23883a02 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:17:49.449165 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-01414769-1afa-497c-b974-130d23883a02 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:17:51.721269 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-01414769-1afa-497c-b974-130d23883a02 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] 10.222.0.64 "POST /compute/v2.1/servers/70be9dd7-1f43-4843-be62-288d53f57c81/action" status: 200 len: 14 microversion: 2.1 time: 2.287804 Oct 27 16:17:51.721990 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 947/1971] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Oct 27 16:17:49 2021] POST /compute/v2.1/servers/70be9dd7-1f43-4843-be62-288d53f57c81/action => generated 14 bytes in 2290 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 27 16:17:52.732335 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-dc09ea20-3304-4cfc-91f5-548301429018 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 16:17:52.733320 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-dc09ea20-3304-4cfc-91f5-548301429018 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] [instance: 70be9dd7-1f43-4843-be62-288d53f57c81] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:17:52.740789 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-dc09ea20-3304-4cfc-91f5-548301429018 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:17:52.741240 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-dc09ea20-3304-4cfc-91f5-548301429018 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:17:52.742042 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-dc09ea20-3304-4cfc-91f5-548301429018 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:17:52.742442 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-dc09ea20-3304-4cfc-91f5-548301429018 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:17:54.940007 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-dc09ea20-3304-4cfc-91f5-548301429018 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] 10.222.0.64 "POST /compute/v2.1/servers/70be9dd7-1f43-4843-be62-288d53f57c81/action" status: 200 len: 14 microversion: 2.1 time: 2.211486 Oct 27 16:17:54.940666 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 1025/1972] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Oct 27 16:17:52 2021] POST /compute/v2.1/servers/70be9dd7-1f43-4843-be62-288d53f57c81/action => generated 14 bytes in 2213 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 27 16:17:55.952266 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-0c722df4-a56a-44b4-b7ac-4d52615d32b9 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 16:17:55.953957 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-0c722df4-a56a-44b4-b7ac-4d52615d32b9 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] [instance: 70be9dd7-1f43-4843-be62-288d53f57c81] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:17:55.961303 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-0c722df4-a56a-44b4-b7ac-4d52615d32b9 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:17:55.961745 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-0c722df4-a56a-44b4-b7ac-4d52615d32b9 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:17:55.962520 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-0c722df4-a56a-44b4-b7ac-4d52615d32b9 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:17:55.963020 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-0c722df4-a56a-44b4-b7ac-4d52615d32b9 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:17:56.029500 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-0c722df4-a56a-44b4-b7ac-4d52615d32b9 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] 10.222.0.64 "POST /compute/v2.1/servers/70be9dd7-1f43-4843-be62-288d53f57c81/action" status: 200 len: 14 microversion: 2.1 time: 0.081344 Oct 27 16:17:56.030224 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 948/1973] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Oct 27 16:17:55 2021] POST /compute/v2.1/servers/70be9dd7-1f43-4843-be62-288d53f57c81/action => generated 14 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 27 16:17:57.040936 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-d4e9bcc5-25e2-4cd0-b14c-b66efe2134b6 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 16:17:57.041936 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-d4e9bcc5-25e2-4cd0-b14c-b66efe2134b6 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] [instance: 70be9dd7-1f43-4843-be62-288d53f57c81] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:17:57.049764 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-d4e9bcc5-25e2-4cd0-b14c-b66efe2134b6 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:17:57.050236 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-d4e9bcc5-25e2-4cd0-b14c-b66efe2134b6 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:17:57.051077 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-d4e9bcc5-25e2-4cd0-b14c-b66efe2134b6 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:17:57.051522 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-d4e9bcc5-25e2-4cd0-b14c-b66efe2134b6 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:17:59.015828 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-d4e9bcc5-25e2-4cd0-b14c-b66efe2134b6 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] 10.222.0.64 "POST /compute/v2.1/servers/70be9dd7-1f43-4843-be62-288d53f57c81/action" status: 200 len: 18398 microversion: 2.1 time: 1.978786 Oct 27 16:17:59.016638 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 1026/1974] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Oct 27 16:17:57 2021] POST /compute/v2.1/servers/70be9dd7-1f43-4843-be62-288d53f57c81/action => generated 18398 bytes in 1981 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 16:18:00.028499 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-1efb1e2f-edca-490c-8a5a-43f4303b9340 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 16:18:00.029491 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-1efb1e2f-edca-490c-8a5a-43f4303b9340 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] [instance: 70be9dd7-1f43-4843-be62-288d53f57c81] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:18:00.036980 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-1efb1e2f-edca-490c-8a5a-43f4303b9340 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:18:00.037421 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-1efb1e2f-edca-490c-8a5a-43f4303b9340 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:18:00.038187 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-1efb1e2f-edca-490c-8a5a-43f4303b9340 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:18:00.038614 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-1efb1e2f-edca-490c-8a5a-43f4303b9340 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:18:00.113138 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-1efb1e2f-edca-490c-8a5a-43f4303b9340 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] 10.222.0.64 "POST /compute/v2.1/servers/70be9dd7-1f43-4843-be62-288d53f57c81/action" status: 200 len: 19342 microversion: 2.1 time: 0.088603 Oct 27 16:18:00.114560 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 949/1975] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Oct 27 16:18:00 2021] POST /compute/v2.1/servers/70be9dd7-1f43-4843-be62-288d53f57c81/action => generated 19342 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 16:18:01.125204 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-b98b5365-d2c9-4958-b824-88e4205a7830 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 16:18:01.126271 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-b98b5365-d2c9-4958-b824-88e4205a7830 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] [instance: 70be9dd7-1f43-4843-be62-288d53f57c81] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:18:01.134191 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-b98b5365-d2c9-4958-b824-88e4205a7830 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:18:01.134639 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-b98b5365-d2c9-4958-b824-88e4205a7830 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:18:01.135419 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-b98b5365-d2c9-4958-b824-88e4205a7830 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:18:01.135877 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-b98b5365-d2c9-4958-b824-88e4205a7830 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:18:01.225745 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-b98b5365-d2c9-4958-b824-88e4205a7830 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] 10.222.0.64 "POST /compute/v2.1/servers/70be9dd7-1f43-4843-be62-288d53f57c81/action" status: 200 len: 21338 microversion: 2.1 time: 0.104405 Oct 27 16:18:01.226415 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 1027/1976] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Oct 27 16:18:01 2021] POST /compute/v2.1/servers/70be9dd7-1f43-4843-be62-288d53f57c81/action => generated 21338 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 16:18:02.238161 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-c2ddd336-df2d-4c29-98c4-c2b71d11d38d tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 16:18:02.239191 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-c2ddd336-df2d-4c29-98c4-c2b71d11d38d tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] [instance: 70be9dd7-1f43-4843-be62-288d53f57c81] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:18:02.246304 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-c2ddd336-df2d-4c29-98c4-c2b71d11d38d tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:18:02.246752 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-c2ddd336-df2d-4c29-98c4-c2b71d11d38d tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:18:02.247534 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-c2ddd336-df2d-4c29-98c4-c2b71d11d38d tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:18:02.248001 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-c2ddd336-df2d-4c29-98c4-c2b71d11d38d tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:18:02.464374 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-d2facc98-fc79-4687-bac8-22647b323d09 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:18:02.464941 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-d2facc98-fc79-4687-bac8-22647b323d09 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] [instance: 28a08917-c3d3-4103-a106-c9c1f00eba8f] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:18:02.472237 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-d2facc98-fc79-4687-bac8-22647b323d09 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:18:02.472661 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-d2facc98-fc79-4687-bac8-22647b323d09 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:18:02.473447 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-d2facc98-fc79-4687-bac8-22647b323d09 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:18:02.473882 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-d2facc98-fc79-4687-bac8-22647b323d09 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:18:02.561332 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.objects.instance [None req-d2facc98-fc79-4687-bac8-22647b323d09 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lazy-loading 'services' on Instance uuid 28a08917-c3d3-4103-a106-c9c1f00eba8f {{(pid=122224) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 27 16:18:02.634542 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-d2facc98-fc79-4687-bac8-22647b323d09 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] 10.222.0.64 "DELETE /compute/v2.1/servers/28a08917-c3d3-4103-a106-c9c1f00eba8f/os-volume_attachments/27bdbf1a-8c5b-480b-935e-731fa93490eb" status: 202 len: 0 microversion: 2.1 time: 0.174470 Oct 27 16:18:02.635139 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 1028/1977] 10.222.0.64 () {58 vars in 1415 bytes} [Wed Oct 27 16:18:02 2021] DELETE /compute/v2.1/servers/28a08917-c3d3-4103-a106-c9c1f00eba8f/os-volume_attachments/27bdbf1a-8c5b-480b-935e-731fa93490eb => generated 0 bytes in 176 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 27 16:18:04.647130 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-c2ddd336-df2d-4c29-98c4-c2b71d11d38d tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] 10.222.0.64 "POST /compute/v2.1/servers/70be9dd7-1f43-4843-be62-288d53f57c81/action" status: 200 len: 25517 microversion: 2.1 time: 2.413103 Oct 27 16:18:04.648476 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 950/1978] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Oct 27 16:18:02 2021] POST /compute/v2.1/servers/70be9dd7-1f43-4843-be62-288d53f57c81/action => generated 25517 bytes in 2415 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 16:18:05.660655 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-3a052fe9-0932-4e65-8195-5a6ba00fc0a2 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 16:18:05.662198 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-3a052fe9-0932-4e65-8195-5a6ba00fc0a2 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] [instance: 70be9dd7-1f43-4843-be62-288d53f57c81] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:18:05.668763 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-3a052fe9-0932-4e65-8195-5a6ba00fc0a2 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:18:05.669285 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-3a052fe9-0932-4e65-8195-5a6ba00fc0a2 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:18:05.670070 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-3a052fe9-0932-4e65-8195-5a6ba00fc0a2 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:18:05.670499 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-3a052fe9-0932-4e65-8195-5a6ba00fc0a2 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:18:05.745510 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-3a052fe9-0932-4e65-8195-5a6ba00fc0a2 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] 10.222.0.64 "POST /compute/v2.1/servers/70be9dd7-1f43-4843-be62-288d53f57c81/action" status: 200 len: 26282 microversion: 2.1 time: 0.089471 Oct 27 16:18:05.746161 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 1029/1979] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Oct 27 16:18:05 2021] POST /compute/v2.1/servers/70be9dd7-1f43-4843-be62-288d53f57c81/action => generated 26282 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 16:18:05.841895 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-2995393b-04ea-47c6-aa97-f143bd1a2fdf tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:18:05.842477 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-2995393b-04ea-47c6-aa97-f143bd1a2fdf tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] [instance: 28a08917-c3d3-4103-a106-c9c1f00eba8f] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:18:05.850978 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-2995393b-04ea-47c6-aa97-f143bd1a2fdf tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:18:05.851416 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-2995393b-04ea-47c6-aa97-f143bd1a2fdf tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:18:05.852313 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-2995393b-04ea-47c6-aa97-f143bd1a2fdf tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:18:05.852692 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-2995393b-04ea-47c6-aa97-f143bd1a2fdf tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:18:05.878090 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-2995393b-04ea-47c6-aa97-f143bd1a2fdf tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] [instance: 28a08917-c3d3-4103-a106-c9c1f00eba8f] Going to try to terminate instance {{(pid=122225) delete /opt/stack/nova/nova/compute/api.py:2612}} Oct 27 16:18:05.964360 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-2995393b-04ea-47c6-aa97-f143bd1a2fdf tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] 10.222.0.64 "DELETE /compute/v2.1/servers/28a08917-c3d3-4103-a106-c9c1f00eba8f" status: 204 len: 0 microversion: 2.1 time: 0.126131 Oct 27 16:18:05.965800 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 951/1980] 10.222.0.64 () {58 vars in 1238 bytes} [Wed Oct 27 16:18:05 2021] DELETE /compute/v2.1/servers/28a08917-c3d3-4103-a106-c9c1f00eba8f => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 16:18:05.976539 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-95002861-3a53-4e87-8546-b0eaeb50de86 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:18:05.977511 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-95002861-3a53-4e87-8546-b0eaeb50de86 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] [instance: 28a08917-c3d3-4103-a106-c9c1f00eba8f] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:18:05.984047 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-95002861-3a53-4e87-8546-b0eaeb50de86 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:18:05.984488 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-95002861-3a53-4e87-8546-b0eaeb50de86 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:18:05.985261 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-95002861-3a53-4e87-8546-b0eaeb50de86 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:18:05.985691 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-95002861-3a53-4e87-8546-b0eaeb50de86 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:18:06.114927 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-95002861-3a53-4e87-8546-b0eaeb50de86 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6be4749041442787482b6e06b6c40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73f3238988e4e1293ad782712a1da53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 16:18:06.122207 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-95002861-3a53-4e87-8546-b0eaeb50de86 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] 10.222.0.64 "GET /compute/v2.1/servers/28a08917-c3d3-4103-a106-c9c1f00eba8f" status: 200 len: 1512 microversion: 2.1 time: 0.150686 Oct 27 16:18:06.122765 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 1030/1981] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 16:18:05 2021] GET /compute/v2.1/servers/28a08917-c3d3-4103-a106-c9c1f00eba8f => generated 1512 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 16:18:06.758226 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-127eca1a-664c-4401-bb63-c07bbd38901a tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 16:18:06.759221 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-127eca1a-664c-4401-bb63-c07bbd38901a tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] [instance: 70be9dd7-1f43-4843-be62-288d53f57c81] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:18:06.765539 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-127eca1a-664c-4401-bb63-c07bbd38901a tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:18:06.765985 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-127eca1a-664c-4401-bb63-c07bbd38901a tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:18:06.766747 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-127eca1a-664c-4401-bb63-c07bbd38901a tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:18:06.767205 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-127eca1a-664c-4401-bb63-c07bbd38901a tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:18:06.848593 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-127eca1a-664c-4401-bb63-c07bbd38901a tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] 10.222.0.64 "POST /compute/v2.1/servers/70be9dd7-1f43-4843-be62-288d53f57c81/action" status: 200 len: 26987 microversion: 2.1 time: 0.094349 Oct 27 16:18:06.849413 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 952/1982] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Oct 27 16:18:06 2021] POST /compute/v2.1/servers/70be9dd7-1f43-4843-be62-288d53f57c81/action => generated 26987 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 16:18:07.139871 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-cafe86d5-e93f-42ac-82d2-0af1f28b3668 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:18:07.140489 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-cafe86d5-e93f-42ac-82d2-0af1f28b3668 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] [instance: 28a08917-c3d3-4103-a106-c9c1f00eba8f] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:18:07.148012 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-cafe86d5-e93f-42ac-82d2-0af1f28b3668 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:18:07.148472 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-cafe86d5-e93f-42ac-82d2-0af1f28b3668 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:18:07.149256 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-cafe86d5-e93f-42ac-82d2-0af1f28b3668 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:18:07.149696 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-cafe86d5-e93f-42ac-82d2-0af1f28b3668 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:18:07.270098 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-cafe86d5-e93f-42ac-82d2-0af1f28b3668 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6be4749041442787482b6e06b6c40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73f3238988e4e1293ad782712a1da53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 16:18:07.277283 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-cafe86d5-e93f-42ac-82d2-0af1f28b3668 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] 10.222.0.64 "GET /compute/v2.1/servers/28a08917-c3d3-4103-a106-c9c1f00eba8f" status: 200 len: 1512 microversion: 2.1 time: 0.141113 Oct 27 16:18:07.277858 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 1031/1983] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 16:18:07 2021] GET /compute/v2.1/servers/28a08917-c3d3-4103-a106-c9c1f00eba8f => generated 1512 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 16:18:07.860967 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-d8edd5ae-0a79-4b6d-903d-d483252edd9c tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 16:18:07.861956 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-d8edd5ae-0a79-4b6d-903d-d483252edd9c tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] [instance: 70be9dd7-1f43-4843-be62-288d53f57c81] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:18:07.868796 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-d8edd5ae-0a79-4b6d-903d-d483252edd9c tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:18:07.869275 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-d8edd5ae-0a79-4b6d-903d-d483252edd9c tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:18:07.870063 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-d8edd5ae-0a79-4b6d-903d-d483252edd9c tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:18:07.870498 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-d8edd5ae-0a79-4b6d-903d-d483252edd9c tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:18:08.295283 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-7c1d7b7d-4c14-4462-9c03-9e8a970073cd tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:18:08.295979 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-7c1d7b7d-4c14-4462-9c03-9e8a970073cd tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] [instance: 28a08917-c3d3-4103-a106-c9c1f00eba8f] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:18:08.302220 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-7c1d7b7d-4c14-4462-9c03-9e8a970073cd tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:18:08.302657 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-7c1d7b7d-4c14-4462-9c03-9e8a970073cd tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:18:08.303417 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-7c1d7b7d-4c14-4462-9c03-9e8a970073cd tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:18:08.303860 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-7c1d7b7d-4c14-4462-9c03-9e8a970073cd tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:18:08.428159 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-7c1d7b7d-4c14-4462-9c03-9e8a970073cd tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6be4749041442787482b6e06b6c40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73f3238988e4e1293ad782712a1da53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 16:18:08.435311 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-7c1d7b7d-4c14-4462-9c03-9e8a970073cd tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] 10.222.0.64 "GET /compute/v2.1/servers/28a08917-c3d3-4103-a106-c9c1f00eba8f" status: 200 len: 1512 microversion: 2.1 time: 0.143713 Oct 27 16:18:08.435884 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 1032/1984] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 16:18:08 2021] GET /compute/v2.1/servers/28a08917-c3d3-4103-a106-c9c1f00eba8f => generated 1512 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 16:18:09.454294 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-4ba75ca8-b001-4f83-88f3-83669bf4fc2f tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:18:09.455012 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-4ba75ca8-b001-4f83-88f3-83669bf4fc2f tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] [instance: 28a08917-c3d3-4103-a106-c9c1f00eba8f] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:18:09.462171 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-4ba75ca8-b001-4f83-88f3-83669bf4fc2f tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:18:09.462620 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-4ba75ca8-b001-4f83-88f3-83669bf4fc2f tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:18:09.463387 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-4ba75ca8-b001-4f83-88f3-83669bf4fc2f tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:18:09.463815 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-4ba75ca8-b001-4f83-88f3-83669bf4fc2f tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:18:09.585426 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-4ba75ca8-b001-4f83-88f3-83669bf4fc2f tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6be4749041442787482b6e06b6c40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73f3238988e4e1293ad782712a1da53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 16:18:09.593452 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-4ba75ca8-b001-4f83-88f3-83669bf4fc2f tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] 10.222.0.64 "GET /compute/v2.1/servers/28a08917-c3d3-4103-a106-c9c1f00eba8f" status: 200 len: 1512 microversion: 2.1 time: 0.143183 Oct 27 16:18:09.594115 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 1033/1985] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 16:18:09 2021] GET /compute/v2.1/servers/28a08917-c3d3-4103-a106-c9c1f00eba8f => generated 1512 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 16:18:10.152369 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-d8edd5ae-0a79-4b6d-903d-d483252edd9c tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] 10.222.0.64 "POST /compute/v2.1/servers/70be9dd7-1f43-4843-be62-288d53f57c81/action" status: 200 len: 27838 microversion: 2.1 time: 2.295206 Oct 27 16:18:10.153045 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 953/1986] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Oct 27 16:18:07 2021] POST /compute/v2.1/servers/70be9dd7-1f43-4843-be62-288d53f57c81/action => generated 27838 bytes in 2297 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 16:18:10.612355 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-98ef176c-5db6-488f-92bb-07bf8a7d7e28 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:18:10.613077 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-98ef176c-5db6-488f-92bb-07bf8a7d7e28 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] [instance: 28a08917-c3d3-4103-a106-c9c1f00eba8f] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:18:10.621180 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-98ef176c-5db6-488f-92bb-07bf8a7d7e28 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:18:10.621629 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-98ef176c-5db6-488f-92bb-07bf8a7d7e28 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:18:10.622468 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-98ef176c-5db6-488f-92bb-07bf8a7d7e28 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:18:10.622906 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-98ef176c-5db6-488f-92bb-07bf8a7d7e28 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:18:10.756361 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-98ef176c-5db6-488f-92bb-07bf8a7d7e28 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6be4749041442787482b6e06b6c40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73f3238988e4e1293ad782712a1da53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 16:18:10.763884 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-98ef176c-5db6-488f-92bb-07bf8a7d7e28 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] 10.222.0.64 "GET /compute/v2.1/servers/28a08917-c3d3-4103-a106-c9c1f00eba8f" status: 200 len: 1512 microversion: 2.1 time: 0.155123 Oct 27 16:18:10.769546 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 1034/1987] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 16:18:10 2021] GET /compute/v2.1/servers/28a08917-c3d3-4103-a106-c9c1f00eba8f => generated 1512 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 16:18:11.128353 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [req-a6dbf97f-567e-44f1-811d-95dae6b1637b req-5cf84d3a-455c-4cd7-bd1d-093cb535b1b9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "28a08917-c3d3-4103-a106-c9c1f00eba8f", "name": "network-vif-deleted", "tag": "d044e9e3-3156-4c7f-9e4a-f4749ade8f0c"}]} {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 16:18:11.130652 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 27 16:18:11.130652 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: warnings.warn(msg) Oct 27 16:18:11.139829 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [req-a6dbf97f-567e-44f1-811d-95dae6b1637b req-5cf84d3a-455c-4cd7-bd1d-093cb535b1b9 service nova] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:18:11.140377 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [req-a6dbf97f-567e-44f1-811d-95dae6b1637b req-5cf84d3a-455c-4cd7-bd1d-093cb535b1b9 service nova] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:18:11.153915 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.compute.server_external_events [req-a6dbf97f-567e-44f1-811d-95dae6b1637b req-5cf84d3a-455c-4cd7-bd1d-093cb535b1b9 service nova] Creating event network-vif-deleted:d044e9e3-3156-4c7f-9e4a-f4749ade8f0c for instance 28a08917-c3d3-4103-a106-c9c1f00eba8f on hv-cinder-80070 Oct 27 16:18:11.164371 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [req-a6dbf97f-567e-44f1-811d-95dae6b1637b req-5cf84d3a-455c-4cd7-bd1d-093cb535b1b9 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041326 Oct 27 16:18:11.165603 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 954/1988] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Oct 27 16:18:11 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 16:18:11.167894 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-7508a4b2-4610-4545-9a07-8dc9c0ec62f8 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 16:18:11.168230 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-7508a4b2-4610-4545-9a07-8dc9c0ec62f8 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] [instance: 70be9dd7-1f43-4843-be62-288d53f57c81] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:18:11.175050 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-7508a4b2-4610-4545-9a07-8dc9c0ec62f8 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:18:11.175585 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-7508a4b2-4610-4545-9a07-8dc9c0ec62f8 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:18:11.176516 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-7508a4b2-4610-4545-9a07-8dc9c0ec62f8 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:18:11.177123 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-7508a4b2-4610-4545-9a07-8dc9c0ec62f8 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:18:11.263182 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-7508a4b2-4610-4545-9a07-8dc9c0ec62f8 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] 10.222.0.64 "POST /compute/v2.1/servers/70be9dd7-1f43-4843-be62-288d53f57c81/action" status: 200 len: 28200 microversion: 2.1 time: 0.100985 Oct 27 16:18:11.263865 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 1035/1989] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Oct 27 16:18:11 2021] POST /compute/v2.1/servers/70be9dd7-1f43-4843-be62-288d53f57c81/action => generated 28200 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 16:18:11.782991 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-f5d7d16c-ee43-4b5e-8553-00c8ed9d0789 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:18:11.783795 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-f5d7d16c-ee43-4b5e-8553-00c8ed9d0789 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] [instance: 28a08917-c3d3-4103-a106-c9c1f00eba8f] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:18:11.790683 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-f5d7d16c-ee43-4b5e-8553-00c8ed9d0789 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:18:11.791129 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-f5d7d16c-ee43-4b5e-8553-00c8ed9d0789 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:18:11.791982 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-f5d7d16c-ee43-4b5e-8553-00c8ed9d0789 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:18:11.792436 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-f5d7d16c-ee43-4b5e-8553-00c8ed9d0789 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:18:11.805839 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.wsgi [None req-f5d7d16c-ee43-4b5e-8553-00c8ed9d0789 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] HTTP exception thrown: Instance 28a08917-c3d3-4103-a106-c9c1f00eba8f could not be found. Oct 27 16:18:11.806590 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-f5d7d16c-ee43-4b5e-8553-00c8ed9d0789 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] Returning 404 to user: Instance 28a08917-c3d3-4103-a106-c9c1f00eba8f could not be found. {{(pid=122225) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 27 16:18:11.807473 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-f5d7d16c-ee43-4b5e-8553-00c8ed9d0789 tempest-VolumesSnapshotTestJSON-1358493303 tempest-VolumesSnapshotTestJSON-1358493303-project] 10.222.0.64 "GET /compute/v2.1/servers/28a08917-c3d3-4103-a106-c9c1f00eba8f" status: 404 len: 111 microversion: 2.1 time: 0.029201 Oct 27 16:18:11.808360 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 955/1990] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 16:18:11 2021] GET /compute/v2.1/servers/28a08917-c3d3-4103-a106-c9c1f00eba8f => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 16:18:12.280837 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-4489244f-e8cb-4cd4-a0e9-3074013320cd tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 16:18:12.281830 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-4489244f-e8cb-4cd4-a0e9-3074013320cd tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] [instance: 70be9dd7-1f43-4843-be62-288d53f57c81] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:18:12.289422 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-4489244f-e8cb-4cd4-a0e9-3074013320cd tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:18:12.289867 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-4489244f-e8cb-4cd4-a0e9-3074013320cd tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:18:12.290680 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-4489244f-e8cb-4cd4-a0e9-3074013320cd tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:18:12.291117 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-4489244f-e8cb-4cd4-a0e9-3074013320cd tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:18:12.359196 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-4489244f-e8cb-4cd4-a0e9-3074013320cd tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] 10.222.0.64 "POST /compute/v2.1/servers/70be9dd7-1f43-4843-be62-288d53f57c81/action" status: 200 len: 28200 microversion: 2.1 time: 0.082545 Oct 27 16:18:12.359956 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 1036/1991] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Oct 27 16:18:12 2021] POST /compute/v2.1/servers/70be9dd7-1f43-4843-be62-288d53f57c81/action => generated 28200 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 16:18:13.371807 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-b0545edb-bbfc-406b-a6f4-816abcc9be91 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 16:18:13.372732 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-b0545edb-bbfc-406b-a6f4-816abcc9be91 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] [instance: 70be9dd7-1f43-4843-be62-288d53f57c81] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:18:13.380087 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-b0545edb-bbfc-406b-a6f4-816abcc9be91 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:18:13.380542 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-b0545edb-bbfc-406b-a6f4-816abcc9be91 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:18:13.381321 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-b0545edb-bbfc-406b-a6f4-816abcc9be91 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:18:13.381756 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-b0545edb-bbfc-406b-a6f4-816abcc9be91 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:18:13.466057 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-b0545edb-bbfc-406b-a6f4-816abcc9be91 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] 10.222.0.64 "POST /compute/v2.1/servers/70be9dd7-1f43-4843-be62-288d53f57c81/action" status: 200 len: 28491 microversion: 2.1 time: 0.097821 Oct 27 16:18:13.466718 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 956/1992] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Oct 27 16:18:13 2021] POST /compute/v2.1/servers/70be9dd7-1f43-4843-be62-288d53f57c81/action => generated 28491 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 16:18:14.478365 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-c0e5e37e-29e1-44ea-807a-690a5818a3b3 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 16:18:14.479826 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-c0e5e37e-29e1-44ea-807a-690a5818a3b3 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] [instance: 70be9dd7-1f43-4843-be62-288d53f57c81] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:18:14.486195 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-c0e5e37e-29e1-44ea-807a-690a5818a3b3 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:18:14.486640 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-c0e5e37e-29e1-44ea-807a-690a5818a3b3 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:18:14.487424 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-c0e5e37e-29e1-44ea-807a-690a5818a3b3 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:18:14.488126 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-c0e5e37e-29e1-44ea-807a-690a5818a3b3 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:18:16.444532 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-c0e5e37e-29e1-44ea-807a-690a5818a3b3 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] 10.222.0.64 "POST /compute/v2.1/servers/70be9dd7-1f43-4843-be62-288d53f57c81/action" status: 200 len: 28491 microversion: 2.1 time: 1.969900 Oct 27 16:18:16.445411 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 1037/1993] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Oct 27 16:18:14 2021] POST /compute/v2.1/servers/70be9dd7-1f43-4843-be62-288d53f57c81/action => generated 28491 bytes in 1972 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 16:18:17.459660 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-c5c3b95b-0ab2-427e-a216-3de38eadfd8a tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 16:18:17.470776 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-c5c3b95b-0ab2-427e-a216-3de38eadfd8a tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] [instance: 70be9dd7-1f43-4843-be62-288d53f57c81] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:18:17.479863 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-c5c3b95b-0ab2-427e-a216-3de38eadfd8a tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:18:17.480580 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-c5c3b95b-0ab2-427e-a216-3de38eadfd8a tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:18:17.481204 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-c5c3b95b-0ab2-427e-a216-3de38eadfd8a tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:18:17.481665 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-c5c3b95b-0ab2-427e-a216-3de38eadfd8a tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:18:17.568789 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-c5c3b95b-0ab2-427e-a216-3de38eadfd8a tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] 10.222.0.64 "POST /compute/v2.1/servers/70be9dd7-1f43-4843-be62-288d53f57c81/action" status: 200 len: 28659 microversion: 2.1 time: 0.115293 Oct 27 16:18:17.570380 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 957/1994] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Oct 27 16:18:17 2021] POST /compute/v2.1/servers/70be9dd7-1f43-4843-be62-288d53f57c81/action => generated 28659 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 16:18:18.582756 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-4d651dcb-af36-4dde-84c2-6507c246a94f tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 16:18:18.583742 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-4d651dcb-af36-4dde-84c2-6507c246a94f tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] [instance: 70be9dd7-1f43-4843-be62-288d53f57c81] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:18:18.592836 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-4d651dcb-af36-4dde-84c2-6507c246a94f tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:18:18.593281 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-4d651dcb-af36-4dde-84c2-6507c246a94f tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:18:18.594060 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-4d651dcb-af36-4dde-84c2-6507c246a94f tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:18:18.594925 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-4d651dcb-af36-4dde-84c2-6507c246a94f tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:18:18.659774 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-4d651dcb-af36-4dde-84c2-6507c246a94f tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] 10.222.0.64 "POST /compute/v2.1/servers/70be9dd7-1f43-4843-be62-288d53f57c81/action" status: 200 len: 28659 microversion: 2.1 time: 0.081077 Oct 27 16:18:18.661562 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 1038/1995] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Oct 27 16:18:18 2021] POST /compute/v2.1/servers/70be9dd7-1f43-4843-be62-288d53f57c81/action => generated 28659 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 16:18:19.673195 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-e97317a5-ad0e-4bcb-97e0-76483941e049 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 16:18:19.674258 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-e97317a5-ad0e-4bcb-97e0-76483941e049 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] [instance: 70be9dd7-1f43-4843-be62-288d53f57c81] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:18:19.682527 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-e97317a5-ad0e-4bcb-97e0-76483941e049 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:18:19.682981 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-e97317a5-ad0e-4bcb-97e0-76483941e049 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:18:19.683837 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-e97317a5-ad0e-4bcb-97e0-76483941e049 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:18:19.684329 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-e97317a5-ad0e-4bcb-97e0-76483941e049 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:18:19.750637 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-e97317a5-ad0e-4bcb-97e0-76483941e049 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] 10.222.0.64 "POST /compute/v2.1/servers/70be9dd7-1f43-4843-be62-288d53f57c81/action" status: 200 len: 28659 microversion: 2.1 time: 0.081541 Oct 27 16:18:19.751318 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 958/1996] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Oct 27 16:18:19 2021] POST /compute/v2.1/servers/70be9dd7-1f43-4843-be62-288d53f57c81/action => generated 28659 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 16:18:20.762972 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-190f4481-27a0-409d-8681-934d72138337 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 16:18:20.764138 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-190f4481-27a0-409d-8681-934d72138337 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] [instance: 70be9dd7-1f43-4843-be62-288d53f57c81] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:18:20.771013 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-190f4481-27a0-409d-8681-934d72138337 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:18:20.771461 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-190f4481-27a0-409d-8681-934d72138337 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:18:20.772261 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-190f4481-27a0-409d-8681-934d72138337 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:18:20.772698 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-190f4481-27a0-409d-8681-934d72138337 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:18:20.852974 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-190f4481-27a0-409d-8681-934d72138337 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] 10.222.0.64 "POST /compute/v2.1/servers/70be9dd7-1f43-4843-be62-288d53f57c81/action" status: 200 len: 28778 microversion: 2.1 time: 0.093711 Oct 27 16:18:20.853485 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 1039/1997] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Oct 27 16:18:20 2021] POST /compute/v2.1/servers/70be9dd7-1f43-4843-be62-288d53f57c81/action => generated 28778 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 16:18:21.867095 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-c1e16974-45fe-46ad-8bf3-091d01f0a52d tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 16:18:21.868239 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-c1e16974-45fe-46ad-8bf3-091d01f0a52d tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] [instance: 70be9dd7-1f43-4843-be62-288d53f57c81] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:18:21.875914 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-c1e16974-45fe-46ad-8bf3-091d01f0a52d tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:18:21.876366 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-c1e16974-45fe-46ad-8bf3-091d01f0a52d tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:18:21.877596 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-c1e16974-45fe-46ad-8bf3-091d01f0a52d tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:18:21.878089 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-c1e16974-45fe-46ad-8bf3-091d01f0a52d tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:18:23.793790 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-c1e16974-45fe-46ad-8bf3-091d01f0a52d tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] 10.222.0.64 "POST /compute/v2.1/servers/70be9dd7-1f43-4843-be62-288d53f57c81/action" status: 200 len: 31844 microversion: 2.1 time: 1.932134 Oct 27 16:18:23.794505 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 959/1998] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Oct 27 16:18:21 2021] POST /compute/v2.1/servers/70be9dd7-1f43-4843-be62-288d53f57c81/action => generated 31844 bytes in 1934 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 27 16:18:24.809545 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-0b098f71-5c58-4605-b1e4-adfd4583e051 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 16:18:24.810538 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-0b098f71-5c58-4605-b1e4-adfd4583e051 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] [instance: 70be9dd7-1f43-4843-be62-288d53f57c81] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:18:24.819226 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-0b098f71-5c58-4605-b1e4-adfd4583e051 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:18:24.819718 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-0b098f71-5c58-4605-b1e4-adfd4583e051 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:18:24.820579 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-0b098f71-5c58-4605-b1e4-adfd4583e051 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:18:24.820978 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-0b098f71-5c58-4605-b1e4-adfd4583e051 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:18:24.904724 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-0b098f71-5c58-4605-b1e4-adfd4583e051 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] 10.222.0.64 "POST /compute/v2.1/servers/70be9dd7-1f43-4843-be62-288d53f57c81/action" status: 200 len: 33508 microversion: 2.1 time: 0.099580 Oct 27 16:18:24.905399 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 1040/1999] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Oct 27 16:18:24 2021] POST /compute/v2.1/servers/70be9dd7-1f43-4843-be62-288d53f57c81/action => generated 33508 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 27 16:18:25.923148 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-bc0a8bff-009c-4677-84fa-edb25a5c8cd5 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 16:18:25.925752 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-bc0a8bff-009c-4677-84fa-edb25a5c8cd5 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] [instance: 70be9dd7-1f43-4843-be62-288d53f57c81] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:18:25.939650 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-bc0a8bff-009c-4677-84fa-edb25a5c8cd5 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:18:25.940802 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-bc0a8bff-009c-4677-84fa-edb25a5c8cd5 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:18:25.942331 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-bc0a8bff-009c-4677-84fa-edb25a5c8cd5 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:18:25.943247 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-bc0a8bff-009c-4677-84fa-edb25a5c8cd5 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:18:26.035364 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-bc0a8bff-009c-4677-84fa-edb25a5c8cd5 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] 10.222.0.64 "POST /compute/v2.1/servers/70be9dd7-1f43-4843-be62-288d53f57c81/action" status: 200 len: 34430 microversion: 2.1 time: 0.120207 Oct 27 16:18:26.036789 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 960/2000] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Oct 27 16:18:25 2021] POST /compute/v2.1/servers/70be9dd7-1f43-4843-be62-288d53f57c81/action => generated 34430 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 16:18:27.054381 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-1a9f72aa-3ad6-4ed0-a98b-6ac546e8afff tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 16:18:27.055792 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-1a9f72aa-3ad6-4ed0-a98b-6ac546e8afff tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] [instance: 70be9dd7-1f43-4843-be62-288d53f57c81] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:18:27.068454 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-1a9f72aa-3ad6-4ed0-a98b-6ac546e8afff tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:18:27.069125 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-1a9f72aa-3ad6-4ed0-a98b-6ac546e8afff tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:18:27.070681 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-1a9f72aa-3ad6-4ed0-a98b-6ac546e8afff tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:18:27.071295 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-1a9f72aa-3ad6-4ed0-a98b-6ac546e8afff tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:18:27.160492 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-1a9f72aa-3ad6-4ed0-a98b-6ac546e8afff tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] 10.222.0.64 "POST /compute/v2.1/servers/70be9dd7-1f43-4843-be62-288d53f57c81/action" status: 200 len: 35498 microversion: 2.1 time: 0.113262 Oct 27 16:18:27.161772 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 1041/2001] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Oct 27 16:18:27 2021] POST /compute/v2.1/servers/70be9dd7-1f43-4843-be62-288d53f57c81/action => generated 35498 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 16:18:28.177461 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-93a25fcc-786f-480c-88f3-89cd22818692 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 16:18:28.178993 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-93a25fcc-786f-480c-88f3-89cd22818692 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] [instance: 70be9dd7-1f43-4843-be62-288d53f57c81] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:18:28.188329 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-93a25fcc-786f-480c-88f3-89cd22818692 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:18:28.188773 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-93a25fcc-786f-480c-88f3-89cd22818692 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:18:28.189627 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-93a25fcc-786f-480c-88f3-89cd22818692 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:18:28.190268 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-93a25fcc-786f-480c-88f3-89cd22818692 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:18:28.272842 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-93a25fcc-786f-480c-88f3-89cd22818692 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] 10.222.0.64 "POST /compute/v2.1/servers/70be9dd7-1f43-4843-be62-288d53f57c81/action" status: 200 len: 36904 microversion: 2.1 time: 0.101182 Oct 27 16:18:28.273629 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 961/2002] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Oct 27 16:18:28 2021] POST /compute/v2.1/servers/70be9dd7-1f43-4843-be62-288d53f57c81/action => generated 36904 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 16:18:29.288607 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-d24f9506-74fe-4a34-9f84-7b6c1292901c tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 16:18:29.289738 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-d24f9506-74fe-4a34-9f84-7b6c1292901c tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] [instance: 70be9dd7-1f43-4843-be62-288d53f57c81] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:18:29.296472 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-d24f9506-74fe-4a34-9f84-7b6c1292901c tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:18:29.296918 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-d24f9506-74fe-4a34-9f84-7b6c1292901c tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:18:29.297703 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-d24f9506-74fe-4a34-9f84-7b6c1292901c tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:18:29.298138 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-d24f9506-74fe-4a34-9f84-7b6c1292901c tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:18:29.375090 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-d24f9506-74fe-4a34-9f84-7b6c1292901c tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] 10.222.0.64 "POST /compute/v2.1/servers/70be9dd7-1f43-4843-be62-288d53f57c81/action" status: 200 len: 38185 microversion: 2.1 time: 0.092340 Oct 27 16:18:29.376931 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 1042/2003] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Oct 27 16:18:29 2021] POST /compute/v2.1/servers/70be9dd7-1f43-4843-be62-288d53f57c81/action => generated 38185 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 16:18:30.397119 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-fc66bf0c-5fc2-4d3e-be27-f8fcc80050d6 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 16:18:30.398876 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-fc66bf0c-5fc2-4d3e-be27-f8fcc80050d6 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] [instance: 70be9dd7-1f43-4843-be62-288d53f57c81] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:18:30.410570 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-fc66bf0c-5fc2-4d3e-be27-f8fcc80050d6 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:18:30.411417 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-fc66bf0c-5fc2-4d3e-be27-f8fcc80050d6 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:18:30.412863 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-fc66bf0c-5fc2-4d3e-be27-f8fcc80050d6 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:18:30.413649 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-fc66bf0c-5fc2-4d3e-be27-f8fcc80050d6 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:18:30.499119 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-fc66bf0c-5fc2-4d3e-be27-f8fcc80050d6 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] 10.222.0.64 "POST /compute/v2.1/servers/70be9dd7-1f43-4843-be62-288d53f57c81/action" status: 200 len: 38185 microversion: 2.1 time: 0.112068 Oct 27 16:18:30.504099 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 962/2004] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Oct 27 16:18:30 2021] POST /compute/v2.1/servers/70be9dd7-1f43-4843-be62-288d53f57c81/action => generated 38185 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 16:18:31.513007 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-54a5e5df-2cb7-4663-aa77-269300489916 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 16:18:31.514038 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-54a5e5df-2cb7-4663-aa77-269300489916 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] [instance: 70be9dd7-1f43-4843-be62-288d53f57c81] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:18:31.522282 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-54a5e5df-2cb7-4663-aa77-269300489916 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:18:31.522769 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-54a5e5df-2cb7-4663-aa77-269300489916 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:18:31.523568 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-54a5e5df-2cb7-4663-aa77-269300489916 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:18:31.524076 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-54a5e5df-2cb7-4663-aa77-269300489916 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:18:31.594084 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-54a5e5df-2cb7-4663-aa77-269300489916 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] 10.222.0.64 "POST /compute/v2.1/servers/70be9dd7-1f43-4843-be62-288d53f57c81/action" status: 200 len: 38185 microversion: 2.1 time: 0.085186 Oct 27 16:18:31.595057 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 1043/2005] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Oct 27 16:18:31 2021] POST /compute/v2.1/servers/70be9dd7-1f43-4843-be62-288d53f57c81/action => generated 38185 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 27 16:18:32.607763 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-181b987f-264b-46e8-964a-1fa15b37d5ec tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 16:18:32.608753 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-181b987f-264b-46e8-964a-1fa15b37d5ec tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] [instance: 70be9dd7-1f43-4843-be62-288d53f57c81] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:18:32.617026 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-181b987f-264b-46e8-964a-1fa15b37d5ec tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:18:32.617626 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-181b987f-264b-46e8-964a-1fa15b37d5ec tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:18:32.618385 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-181b987f-264b-46e8-964a-1fa15b37d5ec tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:18:32.618818 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-181b987f-264b-46e8-964a-1fa15b37d5ec tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:18:32.682424 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-181b987f-264b-46e8-964a-1fa15b37d5ec tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] 10.222.0.64 "POST /compute/v2.1/servers/70be9dd7-1f43-4843-be62-288d53f57c81/action" status: 200 len: 38185 microversion: 2.1 time: 0.078674 Oct 27 16:18:32.684309 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 963/2006] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Oct 27 16:18:32 2021] POST /compute/v2.1/servers/70be9dd7-1f43-4843-be62-288d53f57c81/action => generated 38185 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 27 16:18:33.695337 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-6c14d35d-c263-4ab9-b4c7-57fcd36a65af tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 16:18:33.696357 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-6c14d35d-c263-4ab9-b4c7-57fcd36a65af tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] [instance: 70be9dd7-1f43-4843-be62-288d53f57c81] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:18:33.703534 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-6c14d35d-c263-4ab9-b4c7-57fcd36a65af tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:18:33.704032 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-6c14d35d-c263-4ab9-b4c7-57fcd36a65af tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:18:33.704874 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-6c14d35d-c263-4ab9-b4c7-57fcd36a65af tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:18:33.705257 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-6c14d35d-c263-4ab9-b4c7-57fcd36a65af tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:18:33.790700 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-6c14d35d-c263-4ab9-b4c7-57fcd36a65af tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] 10.222.0.64 "POST /compute/v2.1/servers/70be9dd7-1f43-4843-be62-288d53f57c81/action" status: 200 len: 38316 microversion: 2.1 time: 0.099383 Oct 27 16:18:33.791363 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 1044/2007] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Oct 27 16:18:33 2021] POST /compute/v2.1/servers/70be9dd7-1f43-4843-be62-288d53f57c81/action => generated 38316 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 16:18:33.802530 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-570ceb55-8bbf-47d6-bc6f-9ad478018178 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:18:33.803134 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-570ceb55-8bbf-47d6-bc6f-9ad478018178 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] [instance: 70be9dd7-1f43-4843-be62-288d53f57c81] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:18:33.810058 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-570ceb55-8bbf-47d6-bc6f-9ad478018178 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:18:33.810502 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-570ceb55-8bbf-47d6-bc6f-9ad478018178 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:18:33.811280 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-570ceb55-8bbf-47d6-bc6f-9ad478018178 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:18:33.811716 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-570ceb55-8bbf-47d6-bc6f-9ad478018178 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:18:33.839613 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-570ceb55-8bbf-47d6-bc6f-9ad478018178 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] 10.222.0.64 "GET /compute/v2.1/servers/70be9dd7-1f43-4843-be62-288d53f57c81/ips" status: 200 len: 145 microversion: 2.1 time: 0.041361 Oct 27 16:18:33.840857 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 964/2008] 10.222.0.64 () {58 vars in 1247 bytes} [Wed Oct 27 16:18:33 2021] GET /compute/v2.1/servers/70be9dd7-1f43-4843-be62-288d53f57c81/ips => generated 145 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 16:18:35.935500 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-10c68a09-2206-40f8-8fbf-d3513ee899d7 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7e17fc0c-99d4-4b31-8f82-e5c272421890"}} {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 16:18:35.936675 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-10c68a09-2206-40f8-8fbf-d3513ee899d7 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] [instance: 70be9dd7-1f43-4843-be62-288d53f57c81] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:18:35.944196 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-10c68a09-2206-40f8-8fbf-d3513ee899d7 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:18:35.944650 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-10c68a09-2206-40f8-8fbf-d3513ee899d7 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:18:35.945436 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-10c68a09-2206-40f8-8fbf-d3513ee899d7 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:18:35.945873 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-10c68a09-2206-40f8-8fbf-d3513ee899d7 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:18:36.205442 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-10c68a09-2206-40f8-8fbf-d3513ee899d7 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] 10.222.0.64 "POST /compute/v2.1/servers/70be9dd7-1f43-4843-be62-288d53f57c81/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.273885 Oct 27 16:18:36.206119 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 1045/2009] 10.222.0.64 () {60 vars in 1322 bytes} [Wed Oct 27 16:18:35 2021] POST /compute/v2.1/servers/70be9dd7-1f43-4843-be62-288d53f57c81/os-volume_attachments => generated 194 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 16:18:45.854806 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-f6d5607c-7f4d-4ca2-9d3a-a1d8a3ba357f tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 16:18:45.861954 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-f6d5607c-7f4d-4ca2-9d3a-a1d8a3ba357f tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:18:45.862432 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-f6d5607c-7f4d-4ca2-9d3a-a1d8a3ba357f tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:18:45.951208 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-f6d5607c-7f4d-4ca2-9d3a-a1d8a3ba357f tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] [instance: 70be9dd7-1f43-4843-be62-288d53f57c81] Going to try to stop instance {{(pid=122225) force_stop /opt/stack/nova/nova/compute/api.py:2652}} Oct 27 16:18:46.006846 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-f6d5607c-7f4d-4ca2-9d3a-a1d8a3ba357f tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] 10.222.0.64 "POST /compute/v2.1/servers/70be9dd7-1f43-4843-be62-288d53f57c81/action" status: 202 len: 0 microversion: 2.1 time: 0.155592 Oct 27 16:18:46.007582 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 965/2010] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Oct 27 16:18:45 2021] POST /compute/v2.1/servers/70be9dd7-1f43-4843-be62-288d53f57c81/action => generated 0 bytes in 157 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 16:18:46.021237 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-3ad76c8b-f372-4c63-8a5e-dc7e52b6c2ed tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:18:46.022471 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-3ad76c8b-f372-4c63-8a5e-dc7e52b6c2ed tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] [instance: 70be9dd7-1f43-4843-be62-288d53f57c81] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:18:46.031794 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-3ad76c8b-f372-4c63-8a5e-dc7e52b6c2ed tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:18:46.032295 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-3ad76c8b-f372-4c63-8a5e-dc7e52b6c2ed tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:18:46.033233 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-3ad76c8b-f372-4c63-8a5e-dc7e52b6c2ed tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:18:46.033593 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-3ad76c8b-f372-4c63-8a5e-dc7e52b6c2ed tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:18:46.163220 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-3ad76c8b-f372-4c63-8a5e-dc7e52b6c2ed tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd24c0e6b236d435bacfb99467b03254d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac26dbbef464ff198b60547a106ce2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 16:18:46.171025 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-3ad76c8b-f372-4c63-8a5e-dc7e52b6c2ed tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] 10.222.0.64 "GET /compute/v2.1/servers/70be9dd7-1f43-4843-be62-288d53f57c81" status: 200 len: 1723 microversion: 2.1 time: 0.158280 Oct 27 16:18:46.171606 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 1046/2011] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 16:18:46 2021] GET /compute/v2.1/servers/70be9dd7-1f43-4843-be62-288d53f57c81 => generated 1723 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 16:18:47.190694 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-81ee3501-6f3e-484d-986a-d8186a4a42fa tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:18:47.191373 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-81ee3501-6f3e-484d-986a-d8186a4a42fa tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] [instance: 70be9dd7-1f43-4843-be62-288d53f57c81] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:18:47.197528 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-81ee3501-6f3e-484d-986a-d8186a4a42fa tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:18:47.197965 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-81ee3501-6f3e-484d-986a-d8186a4a42fa tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:18:47.198730 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-81ee3501-6f3e-484d-986a-d8186a4a42fa tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:18:47.199154 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-81ee3501-6f3e-484d-986a-d8186a4a42fa tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:18:47.333165 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-81ee3501-6f3e-484d-986a-d8186a4a42fa tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd24c0e6b236d435bacfb99467b03254d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac26dbbef464ff198b60547a106ce2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 16:18:47.342215 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-81ee3501-6f3e-484d-986a-d8186a4a42fa tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] 10.222.0.64 "GET /compute/v2.1/servers/70be9dd7-1f43-4843-be62-288d53f57c81" status: 200 len: 1723 microversion: 2.1 time: 0.156678 Oct 27 16:18:47.342817 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 966/2012] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 16:18:47 2021] GET /compute/v2.1/servers/70be9dd7-1f43-4843-be62-288d53f57c81 => generated 1723 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 16:18:48.360795 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-4512f0ee-e1b4-4468-bea9-701d2d5776f6 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:18:48.361594 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-4512f0ee-e1b4-4468-bea9-701d2d5776f6 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] [instance: 70be9dd7-1f43-4843-be62-288d53f57c81] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:18:48.368922 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-4512f0ee-e1b4-4468-bea9-701d2d5776f6 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:18:48.369392 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-4512f0ee-e1b4-4468-bea9-701d2d5776f6 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:18:48.370155 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-4512f0ee-e1b4-4468-bea9-701d2d5776f6 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:18:48.370601 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-4512f0ee-e1b4-4468-bea9-701d2d5776f6 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:18:48.505652 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-4512f0ee-e1b4-4468-bea9-701d2d5776f6 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd24c0e6b236d435bacfb99467b03254d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac26dbbef464ff198b60547a106ce2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 16:18:48.514410 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-4512f0ee-e1b4-4468-bea9-701d2d5776f6 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] 10.222.0.64 "GET /compute/v2.1/servers/70be9dd7-1f43-4843-be62-288d53f57c81" status: 200 len: 1723 microversion: 2.1 time: 0.157318 Oct 27 16:18:48.515043 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 1047/2013] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 16:18:48 2021] GET /compute/v2.1/servers/70be9dd7-1f43-4843-be62-288d53f57c81 => generated 1723 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 16:18:49.532313 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-6eb2e1ee-1d1d-4a8f-8736-2f5c035e8f05 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:18:49.532835 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-6eb2e1ee-1d1d-4a8f-8736-2f5c035e8f05 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] [instance: 70be9dd7-1f43-4843-be62-288d53f57c81] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:18:49.539417 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-6eb2e1ee-1d1d-4a8f-8736-2f5c035e8f05 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:18:49.539895 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-6eb2e1ee-1d1d-4a8f-8736-2f5c035e8f05 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:18:49.540730 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-6eb2e1ee-1d1d-4a8f-8736-2f5c035e8f05 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:18:49.541165 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-6eb2e1ee-1d1d-4a8f-8736-2f5c035e8f05 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:18:49.664563 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-6eb2e1ee-1d1d-4a8f-8736-2f5c035e8f05 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd24c0e6b236d435bacfb99467b03254d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac26dbbef464ff198b60547a106ce2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 16:18:49.674570 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-6eb2e1ee-1d1d-4a8f-8736-2f5c035e8f05 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] 10.222.0.64 "GET /compute/v2.1/servers/70be9dd7-1f43-4843-be62-288d53f57c81" status: 200 len: 1723 microversion: 2.1 time: 0.145333 Oct 27 16:18:49.675261 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 967/2014] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 16:18:49 2021] GET /compute/v2.1/servers/70be9dd7-1f43-4843-be62-288d53f57c81 => generated 1723 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 16:18:50.692214 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-fba9565b-96b6-4a85-a704-feda709120ec tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:18:50.692840 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-fba9565b-96b6-4a85-a704-feda709120ec tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] [instance: 70be9dd7-1f43-4843-be62-288d53f57c81] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:18:50.699256 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-fba9565b-96b6-4a85-a704-feda709120ec tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:18:50.700008 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-fba9565b-96b6-4a85-a704-feda709120ec tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:18:50.700789 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-fba9565b-96b6-4a85-a704-feda709120ec tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:18:50.701275 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-fba9565b-96b6-4a85-a704-feda709120ec tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:18:50.828776 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-fba9565b-96b6-4a85-a704-feda709120ec tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd24c0e6b236d435bacfb99467b03254d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac26dbbef464ff198b60547a106ce2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 16:18:50.837470 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-fba9565b-96b6-4a85-a704-feda709120ec tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] 10.222.0.64 "GET /compute/v2.1/servers/70be9dd7-1f43-4843-be62-288d53f57c81" status: 200 len: 1723 microversion: 2.1 time: 0.149530 Oct 27 16:18:50.838046 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 1048/2015] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 16:18:50 2021] GET /compute/v2.1/servers/70be9dd7-1f43-4843-be62-288d53f57c81 => generated 1723 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 16:18:51.856298 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-74a01e41-f9ae-4c0d-893a-e58d3fa0e202 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:18:51.857062 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-74a01e41-f9ae-4c0d-893a-e58d3fa0e202 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] [instance: 70be9dd7-1f43-4843-be62-288d53f57c81] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:18:51.863813 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-74a01e41-f9ae-4c0d-893a-e58d3fa0e202 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:18:51.864285 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-74a01e41-f9ae-4c0d-893a-e58d3fa0e202 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:18:51.865065 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-74a01e41-f9ae-4c0d-893a-e58d3fa0e202 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:18:51.865495 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-74a01e41-f9ae-4c0d-893a-e58d3fa0e202 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:18:52.007634 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-74a01e41-f9ae-4c0d-893a-e58d3fa0e202 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd24c0e6b236d435bacfb99467b03254d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac26dbbef464ff198b60547a106ce2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 16:18:52.015650 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-74a01e41-f9ae-4c0d-893a-e58d3fa0e202 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] 10.222.0.64 "GET /compute/v2.1/servers/70be9dd7-1f43-4843-be62-288d53f57c81" status: 200 len: 1723 microversion: 2.1 time: 0.163990 Oct 27 16:18:52.016267 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 968/2016] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 16:18:51 2021] GET /compute/v2.1/servers/70be9dd7-1f43-4843-be62-288d53f57c81 => generated 1723 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 16:18:53.033493 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-4df67bf6-5a17-43d1-824d-2c839c436c4e tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:18:53.034249 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-4df67bf6-5a17-43d1-824d-2c839c436c4e tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] [instance: 70be9dd7-1f43-4843-be62-288d53f57c81] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:18:53.041404 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-4df67bf6-5a17-43d1-824d-2c839c436c4e tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:18:53.041855 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-4df67bf6-5a17-43d1-824d-2c839c436c4e tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:18:53.042671 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-4df67bf6-5a17-43d1-824d-2c839c436c4e tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:18:53.043107 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-4df67bf6-5a17-43d1-824d-2c839c436c4e tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:18:53.185426 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-4df67bf6-5a17-43d1-824d-2c839c436c4e tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd24c0e6b236d435bacfb99467b03254d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac26dbbef464ff198b60547a106ce2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 16:18:53.193941 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-4df67bf6-5a17-43d1-824d-2c839c436c4e tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] 10.222.0.64 "GET /compute/v2.1/servers/70be9dd7-1f43-4843-be62-288d53f57c81" status: 200 len: 1723 microversion: 2.1 time: 0.164661 Oct 27 16:18:53.194645 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 1049/2017] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 16:18:53 2021] GET /compute/v2.1/servers/70be9dd7-1f43-4843-be62-288d53f57c81 => generated 1723 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 16:18:54.212507 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-68769dd2-4158-4372-b027-0eb39046b8ce tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:18:54.213311 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-68769dd2-4158-4372-b027-0eb39046b8ce tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] [instance: 70be9dd7-1f43-4843-be62-288d53f57c81] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:18:54.220467 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-68769dd2-4158-4372-b027-0eb39046b8ce tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:18:54.221670 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-68769dd2-4158-4372-b027-0eb39046b8ce tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:18:54.222445 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-68769dd2-4158-4372-b027-0eb39046b8ce tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:18:54.222958 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-68769dd2-4158-4372-b027-0eb39046b8ce tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:18:54.358069 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-68769dd2-4158-4372-b027-0eb39046b8ce tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd24c0e6b236d435bacfb99467b03254d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac26dbbef464ff198b60547a106ce2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 16:18:54.366071 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-68769dd2-4158-4372-b027-0eb39046b8ce tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] 10.222.0.64 "GET /compute/v2.1/servers/70be9dd7-1f43-4843-be62-288d53f57c81" status: 200 len: 1723 microversion: 2.1 time: 0.157495 Oct 27 16:18:54.366656 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 969/2018] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 16:18:54 2021] GET /compute/v2.1/servers/70be9dd7-1f43-4843-be62-288d53f57c81 => generated 1723 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 16:18:55.384315 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-c44b089d-4ce8-4a90-92f0-ab6e0075804c tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:18:55.384923 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-c44b089d-4ce8-4a90-92f0-ab6e0075804c tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] [instance: 70be9dd7-1f43-4843-be62-288d53f57c81] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:18:55.391331 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-c44b089d-4ce8-4a90-92f0-ab6e0075804c tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:18:55.391778 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-c44b089d-4ce8-4a90-92f0-ab6e0075804c tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:18:55.393417 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-c44b089d-4ce8-4a90-92f0-ab6e0075804c tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:18:55.393417 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-c44b089d-4ce8-4a90-92f0-ab6e0075804c tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:18:55.563831 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-c44b089d-4ce8-4a90-92f0-ab6e0075804c tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd24c0e6b236d435bacfb99467b03254d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac26dbbef464ff198b60547a106ce2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 16:18:55.573147 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-c44b089d-4ce8-4a90-92f0-ab6e0075804c tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] 10.222.0.64 "GET /compute/v2.1/servers/70be9dd7-1f43-4843-be62-288d53f57c81" status: 200 len: 1723 microversion: 2.1 time: 0.193079 Oct 27 16:18:55.573753 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 1050/2019] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 16:18:55 2021] GET /compute/v2.1/servers/70be9dd7-1f43-4843-be62-288d53f57c81 => generated 1723 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 16:18:56.593535 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-748362c3-ca21-406e-b9e1-5ce1acae33ab tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:18:56.594486 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-748362c3-ca21-406e-b9e1-5ce1acae33ab tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] [instance: 70be9dd7-1f43-4843-be62-288d53f57c81] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:18:56.602545 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-748362c3-ca21-406e-b9e1-5ce1acae33ab tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:18:56.602988 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-748362c3-ca21-406e-b9e1-5ce1acae33ab tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:18:56.603764 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-748362c3-ca21-406e-b9e1-5ce1acae33ab tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:18:56.604221 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-748362c3-ca21-406e-b9e1-5ce1acae33ab tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:18:56.735089 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-748362c3-ca21-406e-b9e1-5ce1acae33ab tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd24c0e6b236d435bacfb99467b03254d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac26dbbef464ff198b60547a106ce2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 16:18:56.743608 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-748362c3-ca21-406e-b9e1-5ce1acae33ab tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] 10.222.0.64 "GET /compute/v2.1/servers/70be9dd7-1f43-4843-be62-288d53f57c81" status: 200 len: 1723 microversion: 2.1 time: 0.156525 Oct 27 16:18:56.744227 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 970/2020] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 16:18:56 2021] GET /compute/v2.1/servers/70be9dd7-1f43-4843-be62-288d53f57c81 => generated 1723 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 16:18:57.761806 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-b2e8b25f-68dd-4a33-ace5-44734e24a68b tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:18:57.762410 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-b2e8b25f-68dd-4a33-ace5-44734e24a68b tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] [instance: 70be9dd7-1f43-4843-be62-288d53f57c81] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:18:57.770723 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-b2e8b25f-68dd-4a33-ace5-44734e24a68b tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:18:57.771155 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-b2e8b25f-68dd-4a33-ace5-44734e24a68b tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:18:57.771969 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-b2e8b25f-68dd-4a33-ace5-44734e24a68b tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:18:57.772397 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-b2e8b25f-68dd-4a33-ace5-44734e24a68b tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:18:57.906522 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-b2e8b25f-68dd-4a33-ace5-44734e24a68b tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd24c0e6b236d435bacfb99467b03254d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac26dbbef464ff198b60547a106ce2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 16:18:57.915388 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-b2e8b25f-68dd-4a33-ace5-44734e24a68b tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] 10.222.0.64 "GET /compute/v2.1/servers/70be9dd7-1f43-4843-be62-288d53f57c81" status: 200 len: 1723 microversion: 2.1 time: 0.157533 Oct 27 16:18:57.916012 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 1051/2021] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 16:18:57 2021] GET /compute/v2.1/servers/70be9dd7-1f43-4843-be62-288d53f57c81 => generated 1723 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 16:18:58.932094 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-ea5e7269-e80b-41e1-812f-62d81d3bb2a1 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:18:58.932708 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-ea5e7269-e80b-41e1-812f-62d81d3bb2a1 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] [instance: 70be9dd7-1f43-4843-be62-288d53f57c81] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:18:58.939671 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-ea5e7269-e80b-41e1-812f-62d81d3bb2a1 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:18:58.939831 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-ea5e7269-e80b-41e1-812f-62d81d3bb2a1 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:18:58.940593 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-ea5e7269-e80b-41e1-812f-62d81d3bb2a1 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:18:58.941040 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-ea5e7269-e80b-41e1-812f-62d81d3bb2a1 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:18:59.080895 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-ea5e7269-e80b-41e1-812f-62d81d3bb2a1 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd24c0e6b236d435bacfb99467b03254d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac26dbbef464ff198b60547a106ce2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 16:18:59.092344 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-ea5e7269-e80b-41e1-812f-62d81d3bb2a1 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] 10.222.0.64 "GET /compute/v2.1/servers/70be9dd7-1f43-4843-be62-288d53f57c81" status: 200 len: 1723 microversion: 2.1 time: 0.163824 Oct 27 16:18:59.093343 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 971/2022] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 16:18:58 2021] GET /compute/v2.1/servers/70be9dd7-1f43-4843-be62-288d53f57c81 => generated 1723 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 16:19:00.114777 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-be02745e-47c8-4017-bda9-59139372b4d4 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:19:00.115913 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-be02745e-47c8-4017-bda9-59139372b4d4 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] [instance: 70be9dd7-1f43-4843-be62-288d53f57c81] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:19:00.127505 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-be02745e-47c8-4017-bda9-59139372b4d4 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:19:00.128126 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-be02745e-47c8-4017-bda9-59139372b4d4 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:19:00.129174 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-be02745e-47c8-4017-bda9-59139372b4d4 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:19:00.129737 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-be02745e-47c8-4017-bda9-59139372b4d4 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:19:00.264256 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-be02745e-47c8-4017-bda9-59139372b4d4 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd24c0e6b236d435bacfb99467b03254d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac26dbbef464ff198b60547a106ce2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 16:19:00.273587 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-be02745e-47c8-4017-bda9-59139372b4d4 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] 10.222.0.64 "GET /compute/v2.1/servers/70be9dd7-1f43-4843-be62-288d53f57c81" status: 200 len: 1723 microversion: 2.1 time: 0.166715 Oct 27 16:19:00.274179 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 1052/2023] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 16:19:00 2021] GET /compute/v2.1/servers/70be9dd7-1f43-4843-be62-288d53f57c81 => generated 1723 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 16:19:01.302298 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-2b00c150-3207-4771-b15a-92cc7efad6ea tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:19:01.303066 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-2b00c150-3207-4771-b15a-92cc7efad6ea tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] [instance: 70be9dd7-1f43-4843-be62-288d53f57c81] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:19:01.310379 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-2b00c150-3207-4771-b15a-92cc7efad6ea tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:19:01.310950 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-2b00c150-3207-4771-b15a-92cc7efad6ea tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:19:01.311898 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-2b00c150-3207-4771-b15a-92cc7efad6ea tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:19:01.312667 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-2b00c150-3207-4771-b15a-92cc7efad6ea tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:19:01.526468 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-2b00c150-3207-4771-b15a-92cc7efad6ea tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd24c0e6b236d435bacfb99467b03254d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac26dbbef464ff198b60547a106ce2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 16:19:01.536355 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-2b00c150-3207-4771-b15a-92cc7efad6ea tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] 10.222.0.64 "GET /compute/v2.1/servers/70be9dd7-1f43-4843-be62-288d53f57c81" status: 200 len: 1723 microversion: 2.1 time: 0.238783 Oct 27 16:19:01.537078 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 972/2024] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 16:19:01 2021] GET /compute/v2.1/servers/70be9dd7-1f43-4843-be62-288d53f57c81 => generated 1723 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 16:19:02.555363 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-9c207896-b621-4409-a5eb-c3da748c9c6d tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:19:02.556091 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-9c207896-b621-4409-a5eb-c3da748c9c6d tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] [instance: 70be9dd7-1f43-4843-be62-288d53f57c81] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:19:02.563053 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-9c207896-b621-4409-a5eb-c3da748c9c6d tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:19:02.563510 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-9c207896-b621-4409-a5eb-c3da748c9c6d tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:19:02.564982 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-9c207896-b621-4409-a5eb-c3da748c9c6d tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:19:02.565426 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-9c207896-b621-4409-a5eb-c3da748c9c6d tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:19:02.724613 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-9c207896-b621-4409-a5eb-c3da748c9c6d tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd24c0e6b236d435bacfb99467b03254d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac26dbbef464ff198b60547a106ce2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 16:19:02.739198 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-9c207896-b621-4409-a5eb-c3da748c9c6d tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] 10.222.0.64 "GET /compute/v2.1/servers/70be9dd7-1f43-4843-be62-288d53f57c81" status: 200 len: 1700 microversion: 2.1 time: 0.187129 Oct 27 16:19:02.740277 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 1053/2025] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 16:19:02 2021] GET /compute/v2.1/servers/70be9dd7-1f43-4843-be62-288d53f57c81 => generated 1700 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 16:19:02.760109 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-6229289e-5a4b-4d2c-aed2-522cffbba998 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 16:19:02.768086 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-6229289e-5a4b-4d2c-aed2-522cffbba998 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:19:02.768666 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-6229289e-5a4b-4d2c-aed2-522cffbba998 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:19:02.796619 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-6229289e-5a4b-4d2c-aed2-522cffbba998 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] [instance: 70be9dd7-1f43-4843-be62-288d53f57c81] Going to try to start instance {{(pid=122225) start /opt/stack/nova/nova/compute/api.py:2675}} Oct 27 16:19:02.863594 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-6229289e-5a4b-4d2c-aed2-522cffbba998 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] 10.222.0.64 "POST /compute/v2.1/servers/70be9dd7-1f43-4843-be62-288d53f57c81/action" status: 202 len: 0 microversion: 2.1 time: 0.105514 Oct 27 16:19:02.864784 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 973/2026] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Oct 27 16:19:02 2021] POST /compute/v2.1/servers/70be9dd7-1f43-4843-be62-288d53f57c81/action => generated 0 bytes in 110 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 27 16:19:02.879649 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-a2f1ea9e-6fc8-4373-b13b-b607b41a1ba4 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:19:02.881012 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-a2f1ea9e-6fc8-4373-b13b-b607b41a1ba4 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] [instance: 70be9dd7-1f43-4843-be62-288d53f57c81] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:19:02.893901 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-a2f1ea9e-6fc8-4373-b13b-b607b41a1ba4 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:19:02.894677 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-a2f1ea9e-6fc8-4373-b13b-b607b41a1ba4 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:19:02.896416 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-a2f1ea9e-6fc8-4373-b13b-b607b41a1ba4 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:19:02.897189 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-a2f1ea9e-6fc8-4373-b13b-b607b41a1ba4 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:19:03.087476 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-a2f1ea9e-6fc8-4373-b13b-b607b41a1ba4 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd24c0e6b236d435bacfb99467b03254d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac26dbbef464ff198b60547a106ce2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 16:19:03.096940 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-a2f1ea9e-6fc8-4373-b13b-b607b41a1ba4 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] 10.222.0.64 "GET /compute/v2.1/servers/70be9dd7-1f43-4843-be62-288d53f57c81" status: 200 len: 1709 microversion: 2.1 time: 0.221675 Oct 27 16:19:03.097546 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 1054/2027] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 16:19:02 2021] GET /compute/v2.1/servers/70be9dd7-1f43-4843-be62-288d53f57c81 => generated 1709 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 16:19:04.117992 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-bdf9dba4-38c4-4325-995c-654cd6d5a875 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:19:04.120038 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-bdf9dba4-38c4-4325-995c-654cd6d5a875 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] [instance: 70be9dd7-1f43-4843-be62-288d53f57c81] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:19:04.130746 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-bdf9dba4-38c4-4325-995c-654cd6d5a875 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:19:04.131551 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-bdf9dba4-38c4-4325-995c-654cd6d5a875 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:19:04.133103 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-bdf9dba4-38c4-4325-995c-654cd6d5a875 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:19:04.134759 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-bdf9dba4-38c4-4325-995c-654cd6d5a875 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:19:04.356118 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-bdf9dba4-38c4-4325-995c-654cd6d5a875 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd24c0e6b236d435bacfb99467b03254d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac26dbbef464ff198b60547a106ce2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 16:19:04.367355 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-bdf9dba4-38c4-4325-995c-654cd6d5a875 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] 10.222.0.64 "GET /compute/v2.1/servers/70be9dd7-1f43-4843-be62-288d53f57c81" status: 200 len: 1709 microversion: 2.1 time: 0.256073 Oct 27 16:19:04.368014 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 974/2028] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 16:19:04 2021] GET /compute/v2.1/servers/70be9dd7-1f43-4843-be62-288d53f57c81 => generated 1709 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 16:19:05.387475 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-56fefb2e-3bc8-4ad6-8056-45d188109f64 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:19:05.388245 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-56fefb2e-3bc8-4ad6-8056-45d188109f64 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] [instance: 70be9dd7-1f43-4843-be62-288d53f57c81] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:19:05.395681 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-56fefb2e-3bc8-4ad6-8056-45d188109f64 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:19:05.396309 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-56fefb2e-3bc8-4ad6-8056-45d188109f64 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:19:05.397115 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-56fefb2e-3bc8-4ad6-8056-45d188109f64 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:19:05.397569 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-56fefb2e-3bc8-4ad6-8056-45d188109f64 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:19:05.590768 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-56fefb2e-3bc8-4ad6-8056-45d188109f64 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd24c0e6b236d435bacfb99467b03254d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac26dbbef464ff198b60547a106ce2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 16:19:05.600395 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-56fefb2e-3bc8-4ad6-8056-45d188109f64 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] 10.222.0.64 "GET /compute/v2.1/servers/70be9dd7-1f43-4843-be62-288d53f57c81" status: 200 len: 1713 microversion: 2.1 time: 0.217030 Oct 27 16:19:05.601002 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 1055/2029] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 16:19:05 2021] GET /compute/v2.1/servers/70be9dd7-1f43-4843-be62-288d53f57c81 => generated 1713 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 16:19:17.213977 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 27 16:19:17.215054 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: Wed Oct 27 16:19:17 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Oct 27 16:19:21.557029 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 27 16:19:21.557613 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: Wed Oct 27 16:19:21 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Oct 27 16:19:32.887191 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-1668876f-a974-48d3-bc48-44dcbadf34e0 tempest-TestMinimumBasicScenario-420461111 tempest-TestMinimumBasicScenario-420461111-project] Action: 'create', calling method: .version_select at 0x7fbc0ac1bca0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1316394532"}} {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 16:19:32.911709 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.quota [None req-1668876f-a974-48d3-bc48-44dcbadf34e0 tempest-TestMinimumBasicScenario-420461111 tempest-TestMinimumBasicScenario-420461111-project] Getting quotas for project 07f6eb1316874ed48d552488e289db7e. Resources: {'key_pairs'} {{(pid=122225) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 27 16:19:32.916940 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.quota [None req-1668876f-a974-48d3-bc48-44dcbadf34e0 tempest-TestMinimumBasicScenario-420461111 tempest-TestMinimumBasicScenario-420461111-project] Getting quotas for user 906ea7817e7b4ca9a240e2c15220e79b and project 07f6eb1316874ed48d552488e289db7e. Resources: {'key_pairs'} {{(pid=122225) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 27 16:19:33.237834 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.quota [None req-1668876f-a974-48d3-bc48-44dcbadf34e0 tempest-TestMinimumBasicScenario-420461111 tempest-TestMinimumBasicScenario-420461111-project] Getting quotas for project 07f6eb1316874ed48d552488e289db7e. Resources: {'key_pairs'} {{(pid=122225) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 27 16:19:33.245660 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.quota [None req-1668876f-a974-48d3-bc48-44dcbadf34e0 tempest-TestMinimumBasicScenario-420461111 tempest-TestMinimumBasicScenario-420461111-project] Getting quotas for user 906ea7817e7b4ca9a240e2c15220e79b and project 07f6eb1316874ed48d552488e289db7e. Resources: {'key_pairs'} {{(pid=122225) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 27 16:19:33.271154 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-1668876f-a974-48d3-bc48-44dcbadf34e0 tempest-TestMinimumBasicScenario-420461111 tempest-TestMinimumBasicScenario-420461111-project] 10.222.0.64 "POST /compute/v2.1/os-keypairs" status: 200 len: 2318 microversion: 2.1 time: 0.387732 Oct 27 16:19:33.272217 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 975/2030] 10.222.0.64 () {60 vars in 1157 bytes} [Wed Oct 27 16:19:32 2021] POST /compute/v2.1/os-keypairs => generated 2318 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 16:19:33.336060 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-15ce6c76-6555-40ea-a493-bf0bcb292502 tempest-TestMinimumBasicScenario-420461111 tempest-TestMinimumBasicScenario-420461111-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1868575408", "imageRef": "18af2b2f-f931-4134-bc1a-421c4db27cf2", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1316394532", "networks": [{"uuid": "aa0cede9-1b09-4a02-ba54-cbf2f53c9580"}]}} {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 16:19:33.399959 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.network.neutron [None req-15ce6c76-6555-40ea-a493-bf0bcb292502 tempest-TestMinimumBasicScenario-420461111 tempest-TestMinimumBasicScenario-420461111-project] validate_networks() for [('aa0cede9-1b09-4a02-ba54-cbf2f53c9580', None, None, None, None, None)] {{(pid=122224) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Oct 27 16:19:34.044889 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.virt.hardware [None req-15ce6c76-6555-40ea-a493-bf0bcb292502 tempest-TestMinimumBasicScenario-420461111 tempest-TestMinimumBasicScenario-420461111-project] Flavor limits 0:0:0 {{(pid=122224) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 16:19:34.047730 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.virt.hardware [None req-15ce6c76-6555-40ea-a493-bf0bcb292502 tempest-TestMinimumBasicScenario-420461111 tempest-TestMinimumBasicScenario-420461111-project] Image limits 0:0:0 {{(pid=122224) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 16:19:34.047730 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.virt.hardware [None req-15ce6c76-6555-40ea-a493-bf0bcb292502 tempest-TestMinimumBasicScenario-420461111 tempest-TestMinimumBasicScenario-420461111-project] Flavor pref 0:0:0 {{(pid=122224) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 16:19:34.047730 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.virt.hardware [None req-15ce6c76-6555-40ea-a493-bf0bcb292502 tempest-TestMinimumBasicScenario-420461111 tempest-TestMinimumBasicScenario-420461111-project] Image pref 0:0:0 {{(pid=122224) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 16:19:34.048928 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.virt.hardware [None req-15ce6c76-6555-40ea-a493-bf0bcb292502 tempest-TestMinimumBasicScenario-420461111 tempest-TestMinimumBasicScenario-420461111-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122224) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 16:19:34.065886 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-15ce6c76-6555-40ea-a493-bf0bcb292502 tempest-TestMinimumBasicScenario-420461111 tempest-TestMinimumBasicScenario-420461111-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:19:34.066733 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-15ce6c76-6555-40ea-a493-bf0bcb292502 tempest-TestMinimumBasicScenario-420461111 tempest-TestMinimumBasicScenario-420461111-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:19:34.068363 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-15ce6c76-6555-40ea-a493-bf0bcb292502 tempest-TestMinimumBasicScenario-420461111 tempest-TestMinimumBasicScenario-420461111-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:19:34.069168 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-15ce6c76-6555-40ea-a493-bf0bcb292502 tempest-TestMinimumBasicScenario-420461111 tempest-TestMinimumBasicScenario-420461111-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:19:34.099711 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.quota [None req-15ce6c76-6555-40ea-a493-bf0bcb292502 tempest-TestMinimumBasicScenario-420461111 tempest-TestMinimumBasicScenario-420461111-project] Getting quotas for project 07f6eb1316874ed48d552488e289db7e. Resources: {'ram', 'instances', 'cores'} {{(pid=122224) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 27 16:19:34.104963 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.quota [None req-15ce6c76-6555-40ea-a493-bf0bcb292502 tempest-TestMinimumBasicScenario-420461111 tempest-TestMinimumBasicScenario-420461111-project] Getting quotas for user 906ea7817e7b4ca9a240e2c15220e79b and project 07f6eb1316874ed48d552488e289db7e. Resources: {'ram', 'instances', 'cores'} {{(pid=122224) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 27 16:19:34.122453 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-15ce6c76-6555-40ea-a493-bf0bcb292502 tempest-TestMinimumBasicScenario-420461111 tempest-TestMinimumBasicScenario-420461111-project] Going to run 1 instances... {{(pid=122224) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Oct 27 16:19:34.124834 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-15ce6c76-6555-40ea-a493-bf0bcb292502 tempest-TestMinimumBasicScenario-420461111 tempest-TestMinimumBasicScenario-420461111-project] [instance: a4e12070-1613-4a12-9f73-f4e7f40fc3f3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='18af2b2f-f931-4134-bc1a-421c4db27cf2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122224) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Oct 27 16:19:34.179890 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-15ce6c76-6555-40ea-a493-bf0bcb292502 tempest-TestMinimumBasicScenario-420461111 tempest-TestMinimumBasicScenario-420461111-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.847403 Oct 27 16:19:34.180385 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 1056/2031] 10.222.0.64 () {60 vars in 1146 bytes} [Wed Oct 27 16:19:33 2021] POST /compute/v2.1/servers => generated 380 bytes in 849 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 27 16:19:34.194994 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-54057028-4ea0-4660-b43e-e931db21d9c0 tempest-TestMinimumBasicScenario-420461111 tempest-TestMinimumBasicScenario-420461111-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:19:34.196330 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-54057028-4ea0-4660-b43e-e931db21d9c0 tempest-TestMinimumBasicScenario-420461111 tempest-TestMinimumBasicScenario-420461111-project] [instance: a4e12070-1613-4a12-9f73-f4e7f40fc3f3] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:19:34.289416 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-54057028-4ea0-4660-b43e-e931db21d9c0 tempest-TestMinimumBasicScenario-420461111 tempest-TestMinimumBasicScenario-420461111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906ea7817e7b4ca9a240e2c15220e79b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f6eb1316874ed48d552488e289db7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 16:19:34.303430 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-54057028-4ea0-4660-b43e-e931db21d9c0 tempest-TestMinimumBasicScenario-420461111 tempest-TestMinimumBasicScenario-420461111-project] 10.222.0.64 "GET /compute/v2.1/servers/a4e12070-1613-4a12-9f73-f4e7f40fc3f3" status: 200 len: 1259 microversion: 2.1 time: 0.115763 Oct 27 16:19:34.304502 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 976/2032] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 16:19:34 2021] GET /compute/v2.1/servers/a4e12070-1613-4a12-9f73-f4e7f40fc3f3 => generated 1259 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 16:19:35.333846 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-18443569-596b-4105-886a-16798c4bb477 tempest-TestMinimumBasicScenario-420461111 tempest-TestMinimumBasicScenario-420461111-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:19:35.334778 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-18443569-596b-4105-886a-16798c4bb477 tempest-TestMinimumBasicScenario-420461111 tempest-TestMinimumBasicScenario-420461111-project] [instance: a4e12070-1613-4a12-9f73-f4e7f40fc3f3] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:19:35.346653 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-18443569-596b-4105-886a-16798c4bb477 tempest-TestMinimumBasicScenario-420461111 tempest-TestMinimumBasicScenario-420461111-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:19:35.347453 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-18443569-596b-4105-886a-16798c4bb477 tempest-TestMinimumBasicScenario-420461111 tempest-TestMinimumBasicScenario-420461111-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:19:35.348904 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-18443569-596b-4105-886a-16798c4bb477 tempest-TestMinimumBasicScenario-420461111 tempest-TestMinimumBasicScenario-420461111-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:19:35.349687 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-18443569-596b-4105-886a-16798c4bb477 tempest-TestMinimumBasicScenario-420461111 tempest-TestMinimumBasicScenario-420461111-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:19:35.447361 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-18443569-596b-4105-886a-16798c4bb477 tempest-TestMinimumBasicScenario-420461111 tempest-TestMinimumBasicScenario-420461111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906ea7817e7b4ca9a240e2c15220e79b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f6eb1316874ed48d552488e289db7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 16:19:35.456306 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-18443569-596b-4105-886a-16798c4bb477 tempest-TestMinimumBasicScenario-420461111 tempest-TestMinimumBasicScenario-420461111-project] 10.222.0.64 "GET /compute/v2.1/servers/a4e12070-1613-4a12-9f73-f4e7f40fc3f3" status: 200 len: 1311 microversion: 2.1 time: 0.129676 Oct 27 16:19:35.458031 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 1057/2033] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 16:19:35 2021] GET /compute/v2.1/servers/a4e12070-1613-4a12-9f73-f4e7f40fc3f3 => generated 1311 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 16:19:36.484680 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-675dcc2f-90fe-4692-9b79-e6b95025e3f3 tempest-TestMinimumBasicScenario-420461111 tempest-TestMinimumBasicScenario-420461111-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:19:36.488251 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-675dcc2f-90fe-4692-9b79-e6b95025e3f3 tempest-TestMinimumBasicScenario-420461111 tempest-TestMinimumBasicScenario-420461111-project] [instance: a4e12070-1613-4a12-9f73-f4e7f40fc3f3] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:19:36.502852 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-675dcc2f-90fe-4692-9b79-e6b95025e3f3 tempest-TestMinimumBasicScenario-420461111 tempest-TestMinimumBasicScenario-420461111-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:19:36.504101 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-675dcc2f-90fe-4692-9b79-e6b95025e3f3 tempest-TestMinimumBasicScenario-420461111 tempest-TestMinimumBasicScenario-420461111-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:19:36.506029 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-675dcc2f-90fe-4692-9b79-e6b95025e3f3 tempest-TestMinimumBasicScenario-420461111 tempest-TestMinimumBasicScenario-420461111-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:19:36.507200 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-675dcc2f-90fe-4692-9b79-e6b95025e3f3 tempest-TestMinimumBasicScenario-420461111 tempest-TestMinimumBasicScenario-420461111-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:19:36.645791 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-675dcc2f-90fe-4692-9b79-e6b95025e3f3 tempest-TestMinimumBasicScenario-420461111 tempest-TestMinimumBasicScenario-420461111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906ea7817e7b4ca9a240e2c15220e79b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f6eb1316874ed48d552488e289db7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 16:19:36.655417 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-675dcc2f-90fe-4692-9b79-e6b95025e3f3 tempest-TestMinimumBasicScenario-420461111 tempest-TestMinimumBasicScenario-420461111-project] 10.222.0.64 "GET /compute/v2.1/servers/a4e12070-1613-4a12-9f73-f4e7f40fc3f3" status: 200 len: 1317 microversion: 2.1 time: 0.179246 Oct 27 16:19:36.656916 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 977/2034] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 16:19:36 2021] GET /compute/v2.1/servers/a4e12070-1613-4a12-9f73-f4e7f40fc3f3 => generated 1317 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 16:19:37.688943 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-82834416-07b1-4e0d-8027-454bf00fb180 tempest-TestMinimumBasicScenario-420461111 tempest-TestMinimumBasicScenario-420461111-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:19:37.690232 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-82834416-07b1-4e0d-8027-454bf00fb180 tempest-TestMinimumBasicScenario-420461111 tempest-TestMinimumBasicScenario-420461111-project] [instance: a4e12070-1613-4a12-9f73-f4e7f40fc3f3] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:19:37.701976 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-82834416-07b1-4e0d-8027-454bf00fb180 tempest-TestMinimumBasicScenario-420461111 tempest-TestMinimumBasicScenario-420461111-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:19:37.702474 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-82834416-07b1-4e0d-8027-454bf00fb180 tempest-TestMinimumBasicScenario-420461111 tempest-TestMinimumBasicScenario-420461111-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:19:37.703328 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-82834416-07b1-4e0d-8027-454bf00fb180 tempest-TestMinimumBasicScenario-420461111 tempest-TestMinimumBasicScenario-420461111-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:19:37.704513 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-82834416-07b1-4e0d-8027-454bf00fb180 tempest-TestMinimumBasicScenario-420461111 tempest-TestMinimumBasicScenario-420461111-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:19:37.914671 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-82834416-07b1-4e0d-8027-454bf00fb180 tempest-TestMinimumBasicScenario-420461111 tempest-TestMinimumBasicScenario-420461111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906ea7817e7b4ca9a240e2c15220e79b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f6eb1316874ed48d552488e289db7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 16:19:37.924009 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-82834416-07b1-4e0d-8027-454bf00fb180 tempest-TestMinimumBasicScenario-420461111 tempest-TestMinimumBasicScenario-420461111-project] 10.222.0.64 "GET /compute/v2.1/servers/a4e12070-1613-4a12-9f73-f4e7f40fc3f3" status: 200 len: 1359 microversion: 2.1 time: 0.240890 Oct 27 16:19:37.924611 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 1058/2035] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 16:19:37 2021] GET /compute/v2.1/servers/a4e12070-1613-4a12-9f73-f4e7f40fc3f3 => generated 1359 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 16:19:38.668941 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-2d9469c9-61cc-4666-8fe0-30a8efbf0487 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:19:38.671057 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-2d9469c9-61cc-4666-8fe0-30a8efbf0487 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] [instance: 70be9dd7-1f43-4843-be62-288d53f57c81] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:19:38.684475 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-2d9469c9-61cc-4666-8fe0-30a8efbf0487 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:19:38.685601 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-2d9469c9-61cc-4666-8fe0-30a8efbf0487 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:19:38.687341 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-2d9469c9-61cc-4666-8fe0-30a8efbf0487 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:19:38.689402 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-2d9469c9-61cc-4666-8fe0-30a8efbf0487 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:19:38.834203 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.objects.instance [None req-2d9469c9-61cc-4666-8fe0-30a8efbf0487 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lazy-loading 'services' on Instance uuid 70be9dd7-1f43-4843-be62-288d53f57c81 {{(pid=122225) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 27 16:19:38.952007 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-15424e51-ea75-4791-b022-e5ca62bb71e9 tempest-TestMinimumBasicScenario-420461111 tempest-TestMinimumBasicScenario-420461111-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:19:38.953137 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-15424e51-ea75-4791-b022-e5ca62bb71e9 tempest-TestMinimumBasicScenario-420461111 tempest-TestMinimumBasicScenario-420461111-project] [instance: a4e12070-1613-4a12-9f73-f4e7f40fc3f3] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:19:38.965856 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-15424e51-ea75-4791-b022-e5ca62bb71e9 tempest-TestMinimumBasicScenario-420461111 tempest-TestMinimumBasicScenario-420461111-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:19:38.967191 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-15424e51-ea75-4791-b022-e5ca62bb71e9 tempest-TestMinimumBasicScenario-420461111 tempest-TestMinimumBasicScenario-420461111-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:19:38.969071 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-15424e51-ea75-4791-b022-e5ca62bb71e9 tempest-TestMinimumBasicScenario-420461111 tempest-TestMinimumBasicScenario-420461111-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:19:38.972358 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-15424e51-ea75-4791-b022-e5ca62bb71e9 tempest-TestMinimumBasicScenario-420461111 tempest-TestMinimumBasicScenario-420461111-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:19:38.990509 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-2d9469c9-61cc-4666-8fe0-30a8efbf0487 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] 10.222.0.64 "DELETE /compute/v2.1/servers/70be9dd7-1f43-4843-be62-288d53f57c81/os-volume_attachments/7e17fc0c-99d4-4b31-8f82-e5c272421890" status: 202 len: 0 microversion: 2.1 time: 0.329217 Oct 27 16:19:38.991540 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 978/2036] 10.222.0.64 () {58 vars in 1415 bytes} [Wed Oct 27 16:19:38 2021] DELETE /compute/v2.1/servers/70be9dd7-1f43-4843-be62-288d53f57c81/os-volume_attachments/7e17fc0c-99d4-4b31-8f82-e5c272421890 => generated 0 bytes in 331 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 16:19:39.213165 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-15424e51-ea75-4791-b022-e5ca62bb71e9 tempest-TestMinimumBasicScenario-420461111 tempest-TestMinimumBasicScenario-420461111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906ea7817e7b4ca9a240e2c15220e79b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f6eb1316874ed48d552488e289db7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 16:19:39.221697 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-15424e51-ea75-4791-b022-e5ca62bb71e9 tempest-TestMinimumBasicScenario-420461111 tempest-TestMinimumBasicScenario-420461111-project] 10.222.0.64 "GET /compute/v2.1/servers/a4e12070-1613-4a12-9f73-f4e7f40fc3f3" status: 200 len: 1359 microversion: 2.1 time: 0.280122 Oct 27 16:19:39.222293 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 1059/2037] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 16:19:38 2021] GET /compute/v2.1/servers/a4e12070-1613-4a12-9f73-f4e7f40fc3f3 => generated 1359 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 16:19:40.245002 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-97ae8a0b-422e-435f-8e02-194c161942a0 tempest-TestMinimumBasicScenario-420461111 tempest-TestMinimumBasicScenario-420461111-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:19:40.246278 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-97ae8a0b-422e-435f-8e02-194c161942a0 tempest-TestMinimumBasicScenario-420461111 tempest-TestMinimumBasicScenario-420461111-project] [instance: a4e12070-1613-4a12-9f73-f4e7f40fc3f3] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:19:40.261206 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-97ae8a0b-422e-435f-8e02-194c161942a0 tempest-TestMinimumBasicScenario-420461111 tempest-TestMinimumBasicScenario-420461111-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:19:40.262132 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-97ae8a0b-422e-435f-8e02-194c161942a0 tempest-TestMinimumBasicScenario-420461111 tempest-TestMinimumBasicScenario-420461111-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:19:40.263732 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-97ae8a0b-422e-435f-8e02-194c161942a0 tempest-TestMinimumBasicScenario-420461111 tempest-TestMinimumBasicScenario-420461111-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:19:40.264707 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-97ae8a0b-422e-435f-8e02-194c161942a0 tempest-TestMinimumBasicScenario-420461111 tempest-TestMinimumBasicScenario-420461111-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:19:40.456100 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-97ae8a0b-422e-435f-8e02-194c161942a0 tempest-TestMinimumBasicScenario-420461111 tempest-TestMinimumBasicScenario-420461111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906ea7817e7b4ca9a240e2c15220e79b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f6eb1316874ed48d552488e289db7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 16:19:40.473166 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-97ae8a0b-422e-435f-8e02-194c161942a0 tempest-TestMinimumBasicScenario-420461111 tempest-TestMinimumBasicScenario-420461111-project] 10.222.0.64 "GET /compute/v2.1/servers/a4e12070-1613-4a12-9f73-f4e7f40fc3f3" status: 200 len: 1359 microversion: 2.1 time: 0.235964 Oct 27 16:19:40.486680 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 979/2038] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 16:19:40 2021] GET /compute/v2.1/servers/a4e12070-1613-4a12-9f73-f4e7f40fc3f3 => generated 1359 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 16:19:41.505288 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-0a3b223b-f00c-413b-9bc1-ab9aa701e12d tempest-TestMinimumBasicScenario-420461111 tempest-TestMinimumBasicScenario-420461111-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:19:41.507715 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-0a3b223b-f00c-413b-9bc1-ab9aa701e12d tempest-TestMinimumBasicScenario-420461111 tempest-TestMinimumBasicScenario-420461111-project] [instance: a4e12070-1613-4a12-9f73-f4e7f40fc3f3] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:19:41.523220 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-0a3b223b-f00c-413b-9bc1-ab9aa701e12d tempest-TestMinimumBasicScenario-420461111 tempest-TestMinimumBasicScenario-420461111-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:19:41.524839 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-0a3b223b-f00c-413b-9bc1-ab9aa701e12d tempest-TestMinimumBasicScenario-420461111 tempest-TestMinimumBasicScenario-420461111-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:19:41.526703 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-0a3b223b-f00c-413b-9bc1-ab9aa701e12d tempest-TestMinimumBasicScenario-420461111 tempest-TestMinimumBasicScenario-420461111-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:19:41.527736 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-0a3b223b-f00c-413b-9bc1-ab9aa701e12d tempest-TestMinimumBasicScenario-420461111 tempest-TestMinimumBasicScenario-420461111-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:19:41.722151 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-0a3b223b-f00c-413b-9bc1-ab9aa701e12d tempest-TestMinimumBasicScenario-420461111 tempest-TestMinimumBasicScenario-420461111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906ea7817e7b4ca9a240e2c15220e79b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f6eb1316874ed48d552488e289db7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 16:19:41.738924 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-0a3b223b-f00c-413b-9bc1-ab9aa701e12d tempest-TestMinimumBasicScenario-420461111 tempest-TestMinimumBasicScenario-420461111-project] 10.222.0.64 "GET /compute/v2.1/servers/a4e12070-1613-4a12-9f73-f4e7f40fc3f3" status: 200 len: 1359 microversion: 2.1 time: 0.242198 Oct 27 16:19:41.742141 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 1060/2039] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 16:19:41 2021] GET /compute/v2.1/servers/a4e12070-1613-4a12-9f73-f4e7f40fc3f3 => generated 1359 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 16:19:42.771736 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-af68ee18-ec50-4ac2-b737-96efe2236434 tempest-TestMinimumBasicScenario-420461111 tempest-TestMinimumBasicScenario-420461111-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:19:42.773109 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-af68ee18-ec50-4ac2-b737-96efe2236434 tempest-TestMinimumBasicScenario-420461111 tempest-TestMinimumBasicScenario-420461111-project] [instance: a4e12070-1613-4a12-9f73-f4e7f40fc3f3] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:19:42.784665 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-af68ee18-ec50-4ac2-b737-96efe2236434 tempest-TestMinimumBasicScenario-420461111 tempest-TestMinimumBasicScenario-420461111-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:19:42.785346 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-af68ee18-ec50-4ac2-b737-96efe2236434 tempest-TestMinimumBasicScenario-420461111 tempest-TestMinimumBasicScenario-420461111-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:19:42.786545 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-af68ee18-ec50-4ac2-b737-96efe2236434 tempest-TestMinimumBasicScenario-420461111 tempest-TestMinimumBasicScenario-420461111-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:19:42.787078 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-af68ee18-ec50-4ac2-b737-96efe2236434 tempest-TestMinimumBasicScenario-420461111 tempest-TestMinimumBasicScenario-420461111-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:19:42.982630 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-af68ee18-ec50-4ac2-b737-96efe2236434 tempest-TestMinimumBasicScenario-420461111 tempest-TestMinimumBasicScenario-420461111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906ea7817e7b4ca9a240e2c15220e79b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f6eb1316874ed48d552488e289db7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 16:19:42.994591 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-af68ee18-ec50-4ac2-b737-96efe2236434 tempest-TestMinimumBasicScenario-420461111 tempest-TestMinimumBasicScenario-420461111-project] 10.222.0.64 "GET /compute/v2.1/servers/a4e12070-1613-4a12-9f73-f4e7f40fc3f3" status: 200 len: 1359 microversion: 2.1 time: 0.230942 Oct 27 16:19:42.995491 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 980/2040] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 16:19:42 2021] GET /compute/v2.1/servers/a4e12070-1613-4a12-9f73-f4e7f40fc3f3 => generated 1359 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 16:19:44.020534 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-afd3fc03-e989-4fda-b1f2-c87563fd88b6 tempest-TestMinimumBasicScenario-420461111 tempest-TestMinimumBasicScenario-420461111-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:19:44.021753 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-afd3fc03-e989-4fda-b1f2-c87563fd88b6 tempest-TestMinimumBasicScenario-420461111 tempest-TestMinimumBasicScenario-420461111-project] [instance: a4e12070-1613-4a12-9f73-f4e7f40fc3f3] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:19:44.029976 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-afd3fc03-e989-4fda-b1f2-c87563fd88b6 tempest-TestMinimumBasicScenario-420461111 tempest-TestMinimumBasicScenario-420461111-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:19:44.030687 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-afd3fc03-e989-4fda-b1f2-c87563fd88b6 tempest-TestMinimumBasicScenario-420461111 tempest-TestMinimumBasicScenario-420461111-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:19:44.032300 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-afd3fc03-e989-4fda-b1f2-c87563fd88b6 tempest-TestMinimumBasicScenario-420461111 tempest-TestMinimumBasicScenario-420461111-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:19:44.033014 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-afd3fc03-e989-4fda-b1f2-c87563fd88b6 tempest-TestMinimumBasicScenario-420461111 tempest-TestMinimumBasicScenario-420461111-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:19:44.219775 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-afd3fc03-e989-4fda-b1f2-c87563fd88b6 tempest-TestMinimumBasicScenario-420461111 tempest-TestMinimumBasicScenario-420461111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906ea7817e7b4ca9a240e2c15220e79b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f6eb1316874ed48d552488e289db7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 16:19:44.228767 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-afd3fc03-e989-4fda-b1f2-c87563fd88b6 tempest-TestMinimumBasicScenario-420461111 tempest-TestMinimumBasicScenario-420461111-project] 10.222.0.64 "GET /compute/v2.1/servers/a4e12070-1613-4a12-9f73-f4e7f40fc3f3" status: 200 len: 1359 microversion: 2.1 time: 0.216020 Oct 27 16:19:44.229746 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 1061/2041] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 16:19:44 2021] GET /compute/v2.1/servers/a4e12070-1613-4a12-9f73-f4e7f40fc3f3 => generated 1359 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 16:19:45.251363 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-a76bab2c-e1bd-4ad5-94b8-b50680e56d7f tempest-TestMinimumBasicScenario-420461111 tempest-TestMinimumBasicScenario-420461111-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:19:45.252688 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-a76bab2c-e1bd-4ad5-94b8-b50680e56d7f tempest-TestMinimumBasicScenario-420461111 tempest-TestMinimumBasicScenario-420461111-project] [instance: a4e12070-1613-4a12-9f73-f4e7f40fc3f3] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:19:45.265460 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-a76bab2c-e1bd-4ad5-94b8-b50680e56d7f tempest-TestMinimumBasicScenario-420461111 tempest-TestMinimumBasicScenario-420461111-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:19:45.266704 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-a76bab2c-e1bd-4ad5-94b8-b50680e56d7f tempest-TestMinimumBasicScenario-420461111 tempest-TestMinimumBasicScenario-420461111-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:19:45.267827 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-a76bab2c-e1bd-4ad5-94b8-b50680e56d7f tempest-TestMinimumBasicScenario-420461111 tempest-TestMinimumBasicScenario-420461111-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:19:45.268490 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-a76bab2c-e1bd-4ad5-94b8-b50680e56d7f tempest-TestMinimumBasicScenario-420461111 tempest-TestMinimumBasicScenario-420461111-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:19:45.471777 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-a76bab2c-e1bd-4ad5-94b8-b50680e56d7f tempest-TestMinimumBasicScenario-420461111 tempest-TestMinimumBasicScenario-420461111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906ea7817e7b4ca9a240e2c15220e79b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f6eb1316874ed48d552488e289db7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 16:19:45.487246 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-a76bab2c-e1bd-4ad5-94b8-b50680e56d7f tempest-TestMinimumBasicScenario-420461111 tempest-TestMinimumBasicScenario-420461111-project] 10.222.0.64 "GET /compute/v2.1/servers/a4e12070-1613-4a12-9f73-f4e7f40fc3f3" status: 200 len: 1359 microversion: 2.1 time: 0.242817 Oct 27 16:19:45.493593 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 981/2042] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 16:19:45 2021] GET /compute/v2.1/servers/a4e12070-1613-4a12-9f73-f4e7f40fc3f3 => generated 1359 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 16:19:46.520181 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-03f31464-c8ba-424a-8c01-4f5dd58df0f3 tempest-TestMinimumBasicScenario-420461111 tempest-TestMinimumBasicScenario-420461111-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:19:46.522955 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-03f31464-c8ba-424a-8c01-4f5dd58df0f3 tempest-TestMinimumBasicScenario-420461111 tempest-TestMinimumBasicScenario-420461111-project] [instance: a4e12070-1613-4a12-9f73-f4e7f40fc3f3] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:19:46.538575 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-03f31464-c8ba-424a-8c01-4f5dd58df0f3 tempest-TestMinimumBasicScenario-420461111 tempest-TestMinimumBasicScenario-420461111-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:19:46.539751 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-03f31464-c8ba-424a-8c01-4f5dd58df0f3 tempest-TestMinimumBasicScenario-420461111 tempest-TestMinimumBasicScenario-420461111-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:19:46.542370 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-03f31464-c8ba-424a-8c01-4f5dd58df0f3 tempest-TestMinimumBasicScenario-420461111 tempest-TestMinimumBasicScenario-420461111-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:19:46.542370 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-03f31464-c8ba-424a-8c01-4f5dd58df0f3 tempest-TestMinimumBasicScenario-420461111 tempest-TestMinimumBasicScenario-420461111-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:19:46.776514 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-03f31464-c8ba-424a-8c01-4f5dd58df0f3 tempest-TestMinimumBasicScenario-420461111 tempest-TestMinimumBasicScenario-420461111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906ea7817e7b4ca9a240e2c15220e79b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f6eb1316874ed48d552488e289db7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 16:19:46.791294 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-03f31464-c8ba-424a-8c01-4f5dd58df0f3 tempest-TestMinimumBasicScenario-420461111 tempest-TestMinimumBasicScenario-420461111-project] 10.222.0.64 "GET /compute/v2.1/servers/a4e12070-1613-4a12-9f73-f4e7f40fc3f3" status: 200 len: 1359 microversion: 2.1 time: 0.279935 Oct 27 16:19:46.792429 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 1062/2043] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 16:19:46 2021] GET /compute/v2.1/servers/a4e12070-1613-4a12-9f73-f4e7f40fc3f3 => generated 1359 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 16:19:47.812260 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-efc069a1-654d-4331-95c4-f6f205d30380 tempest-TestMinimumBasicScenario-420461111 tempest-TestMinimumBasicScenario-420461111-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:19:47.814320 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-efc069a1-654d-4331-95c4-f6f205d30380 tempest-TestMinimumBasicScenario-420461111 tempest-TestMinimumBasicScenario-420461111-project] [instance: a4e12070-1613-4a12-9f73-f4e7f40fc3f3] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:19:47.821581 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-efc069a1-654d-4331-95c4-f6f205d30380 tempest-TestMinimumBasicScenario-420461111 tempest-TestMinimumBasicScenario-420461111-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:19:47.822372 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-efc069a1-654d-4331-95c4-f6f205d30380 tempest-TestMinimumBasicScenario-420461111 tempest-TestMinimumBasicScenario-420461111-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:19:47.824080 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-efc069a1-654d-4331-95c4-f6f205d30380 tempest-TestMinimumBasicScenario-420461111 tempest-TestMinimumBasicScenario-420461111-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:19:47.824868 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-efc069a1-654d-4331-95c4-f6f205d30380 tempest-TestMinimumBasicScenario-420461111 tempest-TestMinimumBasicScenario-420461111-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:19:48.018814 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-efc069a1-654d-4331-95c4-f6f205d30380 tempest-TestMinimumBasicScenario-420461111 tempest-TestMinimumBasicScenario-420461111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906ea7817e7b4ca9a240e2c15220e79b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f6eb1316874ed48d552488e289db7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 16:19:48.030524 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-efc069a1-654d-4331-95c4-f6f205d30380 tempest-TestMinimumBasicScenario-420461111 tempest-TestMinimumBasicScenario-420461111-project] 10.222.0.64 "GET /compute/v2.1/servers/a4e12070-1613-4a12-9f73-f4e7f40fc3f3" status: 200 len: 1359 microversion: 2.1 time: 0.222332 Oct 27 16:19:48.031189 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 982/2044] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 16:19:47 2021] GET /compute/v2.1/servers/a4e12070-1613-4a12-9f73-f4e7f40fc3f3 => generated 1359 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 16:19:49.062639 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-cbbd8f28-b8c3-424a-891c-22f94cc12ec0 tempest-TestMinimumBasicScenario-420461111 tempest-TestMinimumBasicScenario-420461111-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:19:49.065040 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-cbbd8f28-b8c3-424a-891c-22f94cc12ec0 tempest-TestMinimumBasicScenario-420461111 tempest-TestMinimumBasicScenario-420461111-project] [instance: a4e12070-1613-4a12-9f73-f4e7f40fc3f3] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:19:49.080781 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-cbbd8f28-b8c3-424a-891c-22f94cc12ec0 tempest-TestMinimumBasicScenario-420461111 tempest-TestMinimumBasicScenario-420461111-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:19:49.088762 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-cbbd8f28-b8c3-424a-891c-22f94cc12ec0 tempest-TestMinimumBasicScenario-420461111 tempest-TestMinimumBasicScenario-420461111-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:19:49.092841 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-cbbd8f28-b8c3-424a-891c-22f94cc12ec0 tempest-TestMinimumBasicScenario-420461111 tempest-TestMinimumBasicScenario-420461111-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:19:49.092841 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-cbbd8f28-b8c3-424a-891c-22f94cc12ec0 tempest-TestMinimumBasicScenario-420461111 tempest-TestMinimumBasicScenario-420461111-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:19:49.340192 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-cbbd8f28-b8c3-424a-891c-22f94cc12ec0 tempest-TestMinimumBasicScenario-420461111 tempest-TestMinimumBasicScenario-420461111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906ea7817e7b4ca9a240e2c15220e79b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f6eb1316874ed48d552488e289db7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 16:19:49.357524 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-cbbd8f28-b8c3-424a-891c-22f94cc12ec0 tempest-TestMinimumBasicScenario-420461111 tempest-TestMinimumBasicScenario-420461111-project] 10.222.0.64 "GET /compute/v2.1/servers/a4e12070-1613-4a12-9f73-f4e7f40fc3f3" status: 200 len: 1359 microversion: 2.1 time: 0.303454 Oct 27 16:19:49.358693 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 1063/2045] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 16:19:49 2021] GET /compute/v2.1/servers/a4e12070-1613-4a12-9f73-f4e7f40fc3f3 => generated 1359 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 16:19:49.462944 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [req-e726f794-798d-43ad-9718-322a3c629135 req-e7eedde2-c11c-4729-8017-ad60b5cd3dd1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a4e12070-1613-4a12-9f73-f4e7f40fc3f3", "tag": "e1193d94-4bcf-4f1a-9cb1-7c110907babc"}]} {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 16:19:49.467746 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 27 16:19:49.467746 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: warnings.warn(msg) Oct 27 16:19:49.486165 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [req-e726f794-798d-43ad-9718-322a3c629135 req-e7eedde2-c11c-4729-8017-ad60b5cd3dd1 service nova] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:19:49.487013 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [req-e726f794-798d-43ad-9718-322a3c629135 req-e7eedde2-c11c-4729-8017-ad60b5cd3dd1 service nova] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:19:49.513994 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.compute.server_external_events [req-e726f794-798d-43ad-9718-322a3c629135 req-e7eedde2-c11c-4729-8017-ad60b5cd3dd1 service nova] Creating event network-changed:e1193d94-4bcf-4f1a-9cb1-7c110907babc for instance a4e12070-1613-4a12-9f73-f4e7f40fc3f3 on hv-cinder-80070 Oct 27 16:19:49.527270 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [req-e726f794-798d-43ad-9718-322a3c629135 req-e7eedde2-c11c-4729-8017-ad60b5cd3dd1 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071266 Oct 27 16:19:49.528655 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 983/2046] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Oct 27 16:19:49 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 16:19:49.991910 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-41c6dccf-020b-43ce-a159-5fd73a0fb610 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 16:19:50.003080 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-41c6dccf-020b-43ce-a159-5fd73a0fb610 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:19:50.004042 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-41c6dccf-020b-43ce-a159-5fd73a0fb610 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:19:50.135125 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-41c6dccf-020b-43ce-a159-5fd73a0fb610 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] [instance: 70be9dd7-1f43-4843-be62-288d53f57c81] Going to try to stop instance {{(pid=122224) force_stop /opt/stack/nova/nova/compute/api.py:2652}} Oct 27 16:19:50.221101 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-41c6dccf-020b-43ce-a159-5fd73a0fb610 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] 10.222.0.64 "POST /compute/v2.1/servers/70be9dd7-1f43-4843-be62-288d53f57c81/action" status: 202 len: 0 microversion: 2.1 time: 0.236526 Oct 27 16:19:50.226300 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 1064/2047] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Oct 27 16:19:49 2021] POST /compute/v2.1/servers/70be9dd7-1f43-4843-be62-288d53f57c81/action => generated 0 bytes in 240 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 16:19:50.236896 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-7412c5c7-0d33-41e9-8c56-9327b0885e7d tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:19:50.238456 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-7412c5c7-0d33-41e9-8c56-9327b0885e7d tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] [instance: 70be9dd7-1f43-4843-be62-288d53f57c81] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:19:50.250575 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-7412c5c7-0d33-41e9-8c56-9327b0885e7d tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:19:50.251664 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-7412c5c7-0d33-41e9-8c56-9327b0885e7d tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:19:50.253148 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-7412c5c7-0d33-41e9-8c56-9327b0885e7d tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:19:50.254025 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-7412c5c7-0d33-41e9-8c56-9327b0885e7d tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:19:50.388633 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-c0ecbc93-ea4d-4192-8079-33f55dde4dac tempest-TestMinimumBasicScenario-420461111 tempest-TestMinimumBasicScenario-420461111-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:19:50.389898 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-c0ecbc93-ea4d-4192-8079-33f55dde4dac tempest-TestMinimumBasicScenario-420461111 tempest-TestMinimumBasicScenario-420461111-project] [instance: a4e12070-1613-4a12-9f73-f4e7f40fc3f3] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:19:50.401942 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-c0ecbc93-ea4d-4192-8079-33f55dde4dac tempest-TestMinimumBasicScenario-420461111 tempest-TestMinimumBasicScenario-420461111-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:19:50.402754 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-c0ecbc93-ea4d-4192-8079-33f55dde4dac tempest-TestMinimumBasicScenario-420461111 tempest-TestMinimumBasicScenario-420461111-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:19:50.404381 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-c0ecbc93-ea4d-4192-8079-33f55dde4dac tempest-TestMinimumBasicScenario-420461111 tempest-TestMinimumBasicScenario-420461111-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:19:50.405225 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-c0ecbc93-ea4d-4192-8079-33f55dde4dac tempest-TestMinimumBasicScenario-420461111 tempest-TestMinimumBasicScenario-420461111-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:19:50.584140 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-7412c5c7-0d33-41e9-8c56-9327b0885e7d tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd24c0e6b236d435bacfb99467b03254d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac26dbbef464ff198b60547a106ce2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 16:19:50.600992 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-7412c5c7-0d33-41e9-8c56-9327b0885e7d tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] 10.222.0.64 "GET /compute/v2.1/servers/70be9dd7-1f43-4843-be62-288d53f57c81" status: 200 len: 1677 microversion: 2.1 time: 0.372089 Oct 27 16:19:50.602084 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 984/2048] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 16:19:50 2021] GET /compute/v2.1/servers/70be9dd7-1f43-4843-be62-288d53f57c81 => generated 1677 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 16:19:50.626442 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-c0ecbc93-ea4d-4192-8079-33f55dde4dac tempest-TestMinimumBasicScenario-420461111 tempest-TestMinimumBasicScenario-420461111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906ea7817e7b4ca9a240e2c15220e79b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f6eb1316874ed48d552488e289db7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 16:19:50.635979 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-c0ecbc93-ea4d-4192-8079-33f55dde4dac tempest-TestMinimumBasicScenario-420461111 tempest-TestMinimumBasicScenario-420461111-project] 10.222.0.64 "GET /compute/v2.1/servers/a4e12070-1613-4a12-9f73-f4e7f40fc3f3" status: 200 len: 1359 microversion: 2.1 time: 0.254319 Oct 27 16:19:50.636703 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 1065/2049] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 16:19:50 2021] GET /compute/v2.1/servers/a4e12070-1613-4a12-9f73-f4e7f40fc3f3 => generated 1359 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 16:19:51.631495 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-1cf7eada-a281-48c1-94a9-a058b562409a tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:19:51.632830 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-1cf7eada-a281-48c1-94a9-a058b562409a tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] [instance: 70be9dd7-1f43-4843-be62-288d53f57c81] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:19:51.645287 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-1cf7eada-a281-48c1-94a9-a058b562409a tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:19:51.645988 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-1cf7eada-a281-48c1-94a9-a058b562409a tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:19:51.647353 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-1cf7eada-a281-48c1-94a9-a058b562409a tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:19:51.648134 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-1cf7eada-a281-48c1-94a9-a058b562409a tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:19:51.658720 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-51098718-9d91-4d8b-9c81-aa2a57ed4277 tempest-TestMinimumBasicScenario-420461111 tempest-TestMinimumBasicScenario-420461111-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:19:51.659903 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-51098718-9d91-4d8b-9c81-aa2a57ed4277 tempest-TestMinimumBasicScenario-420461111 tempest-TestMinimumBasicScenario-420461111-project] [instance: a4e12070-1613-4a12-9f73-f4e7f40fc3f3] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:19:51.672225 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-51098718-9d91-4d8b-9c81-aa2a57ed4277 tempest-TestMinimumBasicScenario-420461111 tempest-TestMinimumBasicScenario-420461111-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:19:51.673214 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-51098718-9d91-4d8b-9c81-aa2a57ed4277 tempest-TestMinimumBasicScenario-420461111 tempest-TestMinimumBasicScenario-420461111-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:19:51.674722 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-51098718-9d91-4d8b-9c81-aa2a57ed4277 tempest-TestMinimumBasicScenario-420461111 tempest-TestMinimumBasicScenario-420461111-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:19:51.675498 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-51098718-9d91-4d8b-9c81-aa2a57ed4277 tempest-TestMinimumBasicScenario-420461111 tempest-TestMinimumBasicScenario-420461111-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:19:51.873197 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-1cf7eada-a281-48c1-94a9-a058b562409a tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd24c0e6b236d435bacfb99467b03254d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac26dbbef464ff198b60547a106ce2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 16:19:51.887303 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-1cf7eada-a281-48c1-94a9-a058b562409a tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] 10.222.0.64 "GET /compute/v2.1/servers/70be9dd7-1f43-4843-be62-288d53f57c81" status: 200 len: 1677 microversion: 2.1 time: 0.263444 Oct 27 16:19:51.888562 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 985/2050] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 16:19:51 2021] GET /compute/v2.1/servers/70be9dd7-1f43-4843-be62-288d53f57c81 => generated 1677 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 16:19:51.896251 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-51098718-9d91-4d8b-9c81-aa2a57ed4277 tempest-TestMinimumBasicScenario-420461111 tempest-TestMinimumBasicScenario-420461111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906ea7817e7b4ca9a240e2c15220e79b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f6eb1316874ed48d552488e289db7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 16:19:51.909074 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-51098718-9d91-4d8b-9c81-aa2a57ed4277 tempest-TestMinimumBasicScenario-420461111 tempest-TestMinimumBasicScenario-420461111-project] 10.222.0.64 "GET /compute/v2.1/servers/a4e12070-1613-4a12-9f73-f4e7f40fc3f3" status: 200 len: 1359 microversion: 2.1 time: 0.257960 Oct 27 16:19:51.909962 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 1066/2051] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 16:19:51 2021] GET /compute/v2.1/servers/a4e12070-1613-4a12-9f73-f4e7f40fc3f3 => generated 1359 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 16:19:52.915752 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-14a4a46b-6945-44fa-a4f4-d2d0ed8ec86a tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:19:52.917051 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-14a4a46b-6945-44fa-a4f4-d2d0ed8ec86a tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] [instance: 70be9dd7-1f43-4843-be62-288d53f57c81] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:19:52.929705 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-14a4a46b-6945-44fa-a4f4-d2d0ed8ec86a tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:19:52.930542 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-14a4a46b-6945-44fa-a4f4-d2d0ed8ec86a tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:19:52.932027 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-14a4a46b-6945-44fa-a4f4-d2d0ed8ec86a tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:19:52.932820 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-14a4a46b-6945-44fa-a4f4-d2d0ed8ec86a tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:19:52.933055 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-ca3a56b2-a1e6-48fe-9a72-c91060ffb321 tempest-TestMinimumBasicScenario-420461111 tempest-TestMinimumBasicScenario-420461111-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:19:52.933846 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-ca3a56b2-a1e6-48fe-9a72-c91060ffb321 tempest-TestMinimumBasicScenario-420461111 tempest-TestMinimumBasicScenario-420461111-project] [instance: a4e12070-1613-4a12-9f73-f4e7f40fc3f3] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:19:52.942310 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-ca3a56b2-a1e6-48fe-9a72-c91060ffb321 tempest-TestMinimumBasicScenario-420461111 tempest-TestMinimumBasicScenario-420461111-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:19:52.942851 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-ca3a56b2-a1e6-48fe-9a72-c91060ffb321 tempest-TestMinimumBasicScenario-420461111 tempest-TestMinimumBasicScenario-420461111-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:19:52.944000 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-ca3a56b2-a1e6-48fe-9a72-c91060ffb321 tempest-TestMinimumBasicScenario-420461111 tempest-TestMinimumBasicScenario-420461111-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:19:52.944524 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-ca3a56b2-a1e6-48fe-9a72-c91060ffb321 tempest-TestMinimumBasicScenario-420461111 tempest-TestMinimumBasicScenario-420461111-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:19:53.120529 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-14a4a46b-6945-44fa-a4f4-d2d0ed8ec86a tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd24c0e6b236d435bacfb99467b03254d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac26dbbef464ff198b60547a106ce2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 16:19:53.129190 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-14a4a46b-6945-44fa-a4f4-d2d0ed8ec86a tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] 10.222.0.64 "GET /compute/v2.1/servers/70be9dd7-1f43-4843-be62-288d53f57c81" status: 200 len: 1677 microversion: 2.1 time: 0.220850 Oct 27 16:19:53.130009 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 986/2052] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 16:19:52 2021] GET /compute/v2.1/servers/70be9dd7-1f43-4843-be62-288d53f57c81 => generated 1677 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 16:19:53.161396 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-ca3a56b2-a1e6-48fe-9a72-c91060ffb321 tempest-TestMinimumBasicScenario-420461111 tempest-TestMinimumBasicScenario-420461111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906ea7817e7b4ca9a240e2c15220e79b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f6eb1316874ed48d552488e289db7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 16:19:53.171093 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-ca3a56b2-a1e6-48fe-9a72-c91060ffb321 tempest-TestMinimumBasicScenario-420461111 tempest-TestMinimumBasicScenario-420461111-project] 10.222.0.64 "GET /compute/v2.1/servers/a4e12070-1613-4a12-9f73-f4e7f40fc3f3" status: 200 len: 1359 microversion: 2.1 time: 0.242610 Oct 27 16:19:53.171688 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 1067/2053] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 16:19:52 2021] GET /compute/v2.1/servers/a4e12070-1613-4a12-9f73-f4e7f40fc3f3 => generated 1359 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 16:19:53.652047 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [req-49e58573-dd74-4ae3-b6e7-01f08f65e131 req-09ba83f2-0e24-42d6-b93e-3bc046090935 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a4e12070-1613-4a12-9f73-f4e7f40fc3f3", "name": "network-vif-plugged", "status": "completed", "tag": "e1193d94-4bcf-4f1a-9cb1-7c110907babc"}]} {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 16:19:53.655372 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 27 16:19:53.655372 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: warnings.warn(msg) Oct 27 16:19:53.669248 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [req-49e58573-dd74-4ae3-b6e7-01f08f65e131 req-09ba83f2-0e24-42d6-b93e-3bc046090935 service nova] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:19:53.670029 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [req-49e58573-dd74-4ae3-b6e7-01f08f65e131 req-09ba83f2-0e24-42d6-b93e-3bc046090935 service nova] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:19:53.693634 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.compute.server_external_events [req-49e58573-dd74-4ae3-b6e7-01f08f65e131 req-09ba83f2-0e24-42d6-b93e-3bc046090935 service nova] Creating event network-vif-plugged:e1193d94-4bcf-4f1a-9cb1-7c110907babc for instance a4e12070-1613-4a12-9f73-f4e7f40fc3f3 on hv-cinder-80070 Oct 27 16:19:53.705564 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [req-49e58573-dd74-4ae3-b6e7-01f08f65e131 req-09ba83f2-0e24-42d6-b93e-3bc046090935 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060183 Oct 27 16:19:53.706566 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 987/2054] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Oct 27 16:19:53 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 16:19:54.153460 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-0dfd063b-41f3-42d4-a33f-fb738a7ad2ca tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:19:54.154556 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-0dfd063b-41f3-42d4-a33f-fb738a7ad2ca tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] [instance: 70be9dd7-1f43-4843-be62-288d53f57c81] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:19:54.168435 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-0dfd063b-41f3-42d4-a33f-fb738a7ad2ca tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:19:54.169274 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-0dfd063b-41f3-42d4-a33f-fb738a7ad2ca tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:19:54.170675 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-0dfd063b-41f3-42d4-a33f-fb738a7ad2ca tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:19:54.171444 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-0dfd063b-41f3-42d4-a33f-fb738a7ad2ca tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:19:54.197386 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-5a34a9a2-f40f-46c4-bef5-80d826ce0a24 tempest-TestMinimumBasicScenario-420461111 tempest-TestMinimumBasicScenario-420461111-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:19:54.198417 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-5a34a9a2-f40f-46c4-bef5-80d826ce0a24 tempest-TestMinimumBasicScenario-420461111 tempest-TestMinimumBasicScenario-420461111-project] [instance: a4e12070-1613-4a12-9f73-f4e7f40fc3f3] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:19:54.211812 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-5a34a9a2-f40f-46c4-bef5-80d826ce0a24 tempest-TestMinimumBasicScenario-420461111 tempest-TestMinimumBasicScenario-420461111-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:19:54.213130 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-5a34a9a2-f40f-46c4-bef5-80d826ce0a24 tempest-TestMinimumBasicScenario-420461111 tempest-TestMinimumBasicScenario-420461111-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:19:54.214616 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-5a34a9a2-f40f-46c4-bef5-80d826ce0a24 tempest-TestMinimumBasicScenario-420461111 tempest-TestMinimumBasicScenario-420461111-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:19:54.215598 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-5a34a9a2-f40f-46c4-bef5-80d826ce0a24 tempest-TestMinimumBasicScenario-420461111 tempest-TestMinimumBasicScenario-420461111-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:19:54.360120 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-0dfd063b-41f3-42d4-a33f-fb738a7ad2ca tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd24c0e6b236d435bacfb99467b03254d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac26dbbef464ff198b60547a106ce2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 16:19:54.374195 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-0dfd063b-41f3-42d4-a33f-fb738a7ad2ca tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] 10.222.0.64 "GET /compute/v2.1/servers/70be9dd7-1f43-4843-be62-288d53f57c81" status: 200 len: 1677 microversion: 2.1 time: 0.227557 Oct 27 16:19:54.375353 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 1068/2055] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 16:19:54 2021] GET /compute/v2.1/servers/70be9dd7-1f43-4843-be62-288d53f57c81 => generated 1677 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 16:19:54.445441 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-5a34a9a2-f40f-46c4-bef5-80d826ce0a24 tempest-TestMinimumBasicScenario-420461111 tempest-TestMinimumBasicScenario-420461111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906ea7817e7b4ca9a240e2c15220e79b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f6eb1316874ed48d552488e289db7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 16:19:54.454288 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-5a34a9a2-f40f-46c4-bef5-80d826ce0a24 tempest-TestMinimumBasicScenario-420461111 tempest-TestMinimumBasicScenario-420461111-project] 10.222.0.64 "GET /compute/v2.1/servers/a4e12070-1613-4a12-9f73-f4e7f40fc3f3" status: 200 len: 1359 microversion: 2.1 time: 0.267368 Oct 27 16:19:54.454952 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 988/2056] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 16:19:54 2021] GET /compute/v2.1/servers/a4e12070-1613-4a12-9f73-f4e7f40fc3f3 => generated 1359 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 16:19:55.397673 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-a3785c1b-149a-40bb-bca4-91625d72bd5a tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:19:55.398839 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-a3785c1b-149a-40bb-bca4-91625d72bd5a tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] [instance: 70be9dd7-1f43-4843-be62-288d53f57c81] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:19:55.411272 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-a3785c1b-149a-40bb-bca4-91625d72bd5a tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:19:55.412118 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-a3785c1b-149a-40bb-bca4-91625d72bd5a tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:19:55.413554 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-a3785c1b-149a-40bb-bca4-91625d72bd5a tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:19:55.414299 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-a3785c1b-149a-40bb-bca4-91625d72bd5a tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:19:55.472398 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-b28e5ebc-c066-43eb-bd5f-db4eb56ed04e tempest-TestMinimumBasicScenario-420461111 tempest-TestMinimumBasicScenario-420461111-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:19:55.473398 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-b28e5ebc-c066-43eb-bd5f-db4eb56ed04e tempest-TestMinimumBasicScenario-420461111 tempest-TestMinimumBasicScenario-420461111-project] [instance: a4e12070-1613-4a12-9f73-f4e7f40fc3f3] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:19:55.481434 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-b28e5ebc-c066-43eb-bd5f-db4eb56ed04e tempest-TestMinimumBasicScenario-420461111 tempest-TestMinimumBasicScenario-420461111-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:19:55.482091 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-b28e5ebc-c066-43eb-bd5f-db4eb56ed04e tempest-TestMinimumBasicScenario-420461111 tempest-TestMinimumBasicScenario-420461111-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:19:55.483256 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-b28e5ebc-c066-43eb-bd5f-db4eb56ed04e tempest-TestMinimumBasicScenario-420461111 tempest-TestMinimumBasicScenario-420461111-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:19:55.483743 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-b28e5ebc-c066-43eb-bd5f-db4eb56ed04e tempest-TestMinimumBasicScenario-420461111 tempest-TestMinimumBasicScenario-420461111-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:19:55.643358 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-a3785c1b-149a-40bb-bca4-91625d72bd5a tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd24c0e6b236d435bacfb99467b03254d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac26dbbef464ff198b60547a106ce2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 16:19:55.657520 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-a3785c1b-149a-40bb-bca4-91625d72bd5a tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] 10.222.0.64 "GET /compute/v2.1/servers/70be9dd7-1f43-4843-be62-288d53f57c81" status: 200 len: 1677 microversion: 2.1 time: 0.266627 Oct 27 16:19:55.658629 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 1069/2057] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 16:19:55 2021] GET /compute/v2.1/servers/70be9dd7-1f43-4843-be62-288d53f57c81 => generated 1677 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 16:19:55.659043 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-b28e5ebc-c066-43eb-bd5f-db4eb56ed04e tempest-TestMinimumBasicScenario-420461111 tempest-TestMinimumBasicScenario-420461111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906ea7817e7b4ca9a240e2c15220e79b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f6eb1316874ed48d552488e289db7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 16:19:55.668018 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-b28e5ebc-c066-43eb-bd5f-db4eb56ed04e tempest-TestMinimumBasicScenario-420461111 tempest-TestMinimumBasicScenario-420461111-project] 10.222.0.64 "GET /compute/v2.1/servers/a4e12070-1613-4a12-9f73-f4e7f40fc3f3" status: 200 len: 1549 microversion: 2.1 time: 0.200386 Oct 27 16:19:55.668729 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 989/2058] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 16:19:55 2021] GET /compute/v2.1/servers/a4e12070-1613-4a12-9f73-f4e7f40fc3f3 => generated 1549 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 16:19:55.689560 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-187a8911-1efa-42ae-bde3-9edadfb3dae5 tempest-TestMinimumBasicScenario-420461111 tempest-TestMinimumBasicScenario-420461111-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:19:55.690705 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-187a8911-1efa-42ae-bde3-9edadfb3dae5 tempest-TestMinimumBasicScenario-420461111 tempest-TestMinimumBasicScenario-420461111-project] [instance: a4e12070-1613-4a12-9f73-f4e7f40fc3f3] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:19:55.701887 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-187a8911-1efa-42ae-bde3-9edadfb3dae5 tempest-TestMinimumBasicScenario-420461111 tempest-TestMinimumBasicScenario-420461111-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:19:55.702882 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-187a8911-1efa-42ae-bde3-9edadfb3dae5 tempest-TestMinimumBasicScenario-420461111 tempest-TestMinimumBasicScenario-420461111-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:19:55.704923 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-187a8911-1efa-42ae-bde3-9edadfb3dae5 tempest-TestMinimumBasicScenario-420461111 tempest-TestMinimumBasicScenario-420461111-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:19:55.705704 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-187a8911-1efa-42ae-bde3-9edadfb3dae5 tempest-TestMinimumBasicScenario-420461111 tempest-TestMinimumBasicScenario-420461111-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:19:55.913026 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-187a8911-1efa-42ae-bde3-9edadfb3dae5 tempest-TestMinimumBasicScenario-420461111 tempest-TestMinimumBasicScenario-420461111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906ea7817e7b4ca9a240e2c15220e79b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f6eb1316874ed48d552488e289db7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 16:19:55.922211 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-187a8911-1efa-42ae-bde3-9edadfb3dae5 tempest-TestMinimumBasicScenario-420461111 tempest-TestMinimumBasicScenario-420461111-project] 10.222.0.64 "GET /compute/v2.1/servers/a4e12070-1613-4a12-9f73-f4e7f40fc3f3" status: 200 len: 1549 microversion: 2.1 time: 0.239680 Oct 27 16:19:55.922856 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 1070/2059] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 16:19:55 2021] GET /compute/v2.1/servers/a4e12070-1613-4a12-9f73-f4e7f40fc3f3 => generated 1549 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 16:19:55.948927 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-0db4c87f-8de4-44f9-8fef-fe4c8b487350 tempest-TestMinimumBasicScenario-420461111 tempest-TestMinimumBasicScenario-420461111-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:19:55.952973 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:servers:allow_all_filters failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 27 16:19:55.952973 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: warnings.warn(msg) Oct 27 16:19:55.954229 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-0db4c87f-8de4-44f9-8fef-fe4c8b487350 tempest-TestMinimumBasicScenario-420461111 tempest-TestMinimumBasicScenario-420461111-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '906ea7817e7b4ca9a240e2c15220e79b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f6eb1316874ed48d552488e289db7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 16:19:55.955127 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-0db4c87f-8de4-44f9-8fef-fe4c8b487350 tempest-TestMinimumBasicScenario-420461111 tempest-TestMinimumBasicScenario-420461111-project] Searching by: {'deleted': False, 'project_id': '07f6eb1316874ed48d552488e289db7e'} {{(pid=122225) get_all /opt/stack/nova/nova/compute/api.py:2905}} Oct 27 16:19:55.963604 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-0db4c87f-8de4-44f9-8fef-fe4c8b487350 tempest-TestMinimumBasicScenario-420461111 tempest-TestMinimumBasicScenario-420461111-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:19:55.964146 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-0db4c87f-8de4-44f9-8fef-fe4c8b487350 tempest-TestMinimumBasicScenario-420461111 tempest-TestMinimumBasicScenario-420461111-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:19:55.965123 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-0db4c87f-8de4-44f9-8fef-fe4c8b487350 tempest-TestMinimumBasicScenario-420461111 tempest-TestMinimumBasicScenario-420461111-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:19:55.965703 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-0db4c87f-8de4-44f9-8fef-fe4c8b487350 tempest-TestMinimumBasicScenario-420461111 tempest-TestMinimumBasicScenario-420461111-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:19:56.072696 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.multi_cell_list [None req-0db4c87f-8de4-44f9-8fef-fe4c8b487350 tempest-TestMinimumBasicScenario-420461111 tempest-TestMinimumBasicScenario-420461111-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122225) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:371}} Oct 27 16:19:56.186165 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-0db4c87f-8de4-44f9-8fef-fe4c8b487350 tempest-TestMinimumBasicScenario-420461111 tempest-TestMinimumBasicScenario-420461111-project] 10.222.0.64 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.241192 Oct 27 16:19:56.186659 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 990/2060] 10.222.0.64 () {58 vars in 1124 bytes} [Wed Oct 27 16:19:55 2021] GET /compute/v2.1/servers => generated 343 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 16:19:56.200835 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-7bd7bfa3-ed82-4231-9888-7a82b101c52f tempest-TestMinimumBasicScenario-420461111 tempest-TestMinimumBasicScenario-420461111-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:19:56.201488 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-7bd7bfa3-ed82-4231-9888-7a82b101c52f tempest-TestMinimumBasicScenario-420461111 tempest-TestMinimumBasicScenario-420461111-project] [instance: a4e12070-1613-4a12-9f73-f4e7f40fc3f3] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:19:56.211588 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-7bd7bfa3-ed82-4231-9888-7a82b101c52f tempest-TestMinimumBasicScenario-420461111 tempest-TestMinimumBasicScenario-420461111-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:19:56.212157 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-7bd7bfa3-ed82-4231-9888-7a82b101c52f tempest-TestMinimumBasicScenario-420461111 tempest-TestMinimumBasicScenario-420461111-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:19:56.213453 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-7bd7bfa3-ed82-4231-9888-7a82b101c52f tempest-TestMinimumBasicScenario-420461111 tempest-TestMinimumBasicScenario-420461111-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:19:56.214172 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-7bd7bfa3-ed82-4231-9888-7a82b101c52f tempest-TestMinimumBasicScenario-420461111 tempest-TestMinimumBasicScenario-420461111-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:19:56.396284 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-7bd7bfa3-ed82-4231-9888-7a82b101c52f tempest-TestMinimumBasicScenario-420461111 tempest-TestMinimumBasicScenario-420461111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906ea7817e7b4ca9a240e2c15220e79b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f6eb1316874ed48d552488e289db7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 16:19:56.406673 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-7bd7bfa3-ed82-4231-9888-7a82b101c52f tempest-TestMinimumBasicScenario-420461111 tempest-TestMinimumBasicScenario-420461111-project] 10.222.0.64 "GET /compute/v2.1/servers/a4e12070-1613-4a12-9f73-f4e7f40fc3f3" status: 200 len: 1549 microversion: 2.1 time: 0.210455 Oct 27 16:19:56.407710 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 1071/2061] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 16:19:56 2021] GET /compute/v2.1/servers/a4e12070-1613-4a12-9f73-f4e7f40fc3f3 => generated 1549 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 16:19:56.690611 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-5f987387-fcf8-424e-8f53-9405291ed63c tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:19:56.692136 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-5f987387-fcf8-424e-8f53-9405291ed63c tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] [instance: 70be9dd7-1f43-4843-be62-288d53f57c81] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:19:56.704143 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-5f987387-fcf8-424e-8f53-9405291ed63c tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:19:56.705149 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-5f987387-fcf8-424e-8f53-9405291ed63c tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:19:56.706603 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-5f987387-fcf8-424e-8f53-9405291ed63c tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:19:56.707381 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-5f987387-fcf8-424e-8f53-9405291ed63c tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:19:57.159366 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-5f987387-fcf8-424e-8f53-9405291ed63c tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd24c0e6b236d435bacfb99467b03254d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac26dbbef464ff198b60547a106ce2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 16:19:57.169109 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-5f987387-fcf8-424e-8f53-9405291ed63c tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] 10.222.0.64 "GET /compute/v2.1/servers/70be9dd7-1f43-4843-be62-288d53f57c81" status: 200 len: 1677 microversion: 2.1 time: 0.487896 Oct 27 16:19:57.169919 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 991/2062] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 16:19:56 2021] GET /compute/v2.1/servers/70be9dd7-1f43-4843-be62-288d53f57c81 => generated 1677 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 16:19:58.173239 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-9baf63a6-caf6-4540-8081-fc4bad381820 tempest-TestMinimumBasicScenario-420461111 tempest-TestMinimumBasicScenario-420461111-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "bcdac535-3bb3-4594-a67d-ee2dc9105b51"}} {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 16:19:58.174698 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-9baf63a6-caf6-4540-8081-fc4bad381820 tempest-TestMinimumBasicScenario-420461111 tempest-TestMinimumBasicScenario-420461111-project] [instance: a4e12070-1613-4a12-9f73-f4e7f40fc3f3] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:19:58.182135 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-9baf63a6-caf6-4540-8081-fc4bad381820 tempest-TestMinimumBasicScenario-420461111 tempest-TestMinimumBasicScenario-420461111-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:19:58.182717 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-9baf63a6-caf6-4540-8081-fc4bad381820 tempest-TestMinimumBasicScenario-420461111 tempest-TestMinimumBasicScenario-420461111-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:19:58.183611 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-9baf63a6-caf6-4540-8081-fc4bad381820 tempest-TestMinimumBasicScenario-420461111 tempest-TestMinimumBasicScenario-420461111-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:19:58.184179 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-9baf63a6-caf6-4540-8081-fc4bad381820 tempest-TestMinimumBasicScenario-420461111 tempest-TestMinimumBasicScenario-420461111-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:19:58.198128 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-53da7b52-5b93-432a-a5ac-dfe3a828a0c3 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:19:58.199501 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-53da7b52-5b93-432a-a5ac-dfe3a828a0c3 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] [instance: 70be9dd7-1f43-4843-be62-288d53f57c81] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:19:58.212317 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-53da7b52-5b93-432a-a5ac-dfe3a828a0c3 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:19:58.213325 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-53da7b52-5b93-432a-a5ac-dfe3a828a0c3 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:19:58.214911 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-53da7b52-5b93-432a-a5ac-dfe3a828a0c3 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:19:58.215889 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-53da7b52-5b93-432a-a5ac-dfe3a828a0c3 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:19:58.404898 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-53da7b52-5b93-432a-a5ac-dfe3a828a0c3 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd24c0e6b236d435bacfb99467b03254d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac26dbbef464ff198b60547a106ce2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 16:19:58.415042 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-53da7b52-5b93-432a-a5ac-dfe3a828a0c3 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] 10.222.0.64 "GET /compute/v2.1/servers/70be9dd7-1f43-4843-be62-288d53f57c81" status: 200 len: 1677 microversion: 2.1 time: 0.223950 Oct 27 16:19:58.415749 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 992/2063] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 16:19:58 2021] GET /compute/v2.1/servers/70be9dd7-1f43-4843-be62-288d53f57c81 => generated 1677 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 16:19:58.513994 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-9baf63a6-caf6-4540-8081-fc4bad381820 tempest-TestMinimumBasicScenario-420461111 tempest-TestMinimumBasicScenario-420461111-project] 10.222.0.64 "POST /compute/v2.1/servers/a4e12070-1613-4a12-9f73-f4e7f40fc3f3/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.345202 Oct 27 16:19:58.515094 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 1072/2064] 10.222.0.64 () {60 vars in 1322 bytes} [Wed Oct 27 16:19:58 2021] POST /compute/v2.1/servers/a4e12070-1613-4a12-9f73-f4e7f40fc3f3/os-volume_attachments => generated 194 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 16:19:59.438576 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-f42fec68-abaa-46a7-bae8-d90a063b264f tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:19:59.439247 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-f42fec68-abaa-46a7-bae8-d90a063b264f tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] [instance: 70be9dd7-1f43-4843-be62-288d53f57c81] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:19:59.446092 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-f42fec68-abaa-46a7-bae8-d90a063b264f tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:19:59.446537 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-f42fec68-abaa-46a7-bae8-d90a063b264f tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:19:59.447323 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-f42fec68-abaa-46a7-bae8-d90a063b264f tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:19:59.447785 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-f42fec68-abaa-46a7-bae8-d90a063b264f tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:19:59.599567 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-f42fec68-abaa-46a7-bae8-d90a063b264f tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd24c0e6b236d435bacfb99467b03254d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac26dbbef464ff198b60547a106ce2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 16:19:59.608831 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-f42fec68-abaa-46a7-bae8-d90a063b264f tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] 10.222.0.64 "GET /compute/v2.1/servers/70be9dd7-1f43-4843-be62-288d53f57c81" status: 200 len: 1677 microversion: 2.1 time: 0.174922 Oct 27 16:19:59.610367 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 993/2065] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 16:19:59 2021] GET /compute/v2.1/servers/70be9dd7-1f43-4843-be62-288d53f57c81 => generated 1677 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 16:20:00.630619 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-8efb3ee4-945c-4871-ab7f-603d8db82787 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:20:00.631753 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-8efb3ee4-945c-4871-ab7f-603d8db82787 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] [instance: 70be9dd7-1f43-4843-be62-288d53f57c81] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:20:00.638589 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-8efb3ee4-945c-4871-ab7f-603d8db82787 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:20:00.639079 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-8efb3ee4-945c-4871-ab7f-603d8db82787 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:20:00.639980 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-8efb3ee4-945c-4871-ab7f-603d8db82787 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:20:00.641031 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-8efb3ee4-945c-4871-ab7f-603d8db82787 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:20:00.867203 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-8efb3ee4-945c-4871-ab7f-603d8db82787 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd24c0e6b236d435bacfb99467b03254d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac26dbbef464ff198b60547a106ce2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 16:20:00.881425 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-8efb3ee4-945c-4871-ab7f-603d8db82787 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] 10.222.0.64 "GET /compute/v2.1/servers/70be9dd7-1f43-4843-be62-288d53f57c81" status: 200 len: 1654 microversion: 2.1 time: 0.255450 Oct 27 16:20:00.882416 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 1073/2066] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 16:20:00 2021] GET /compute/v2.1/servers/70be9dd7-1f43-4843-be62-288d53f57c81 => generated 1654 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 16:20:00.899503 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-48502f14-c877-48af-9dcd-8e727b34c3d8 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 16:20:00.908053 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-48502f14-c877-48af-9dcd-8e727b34c3d8 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:20:00.908516 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-48502f14-c877-48af-9dcd-8e727b34c3d8 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:20:00.940207 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-48502f14-c877-48af-9dcd-8e727b34c3d8 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] [instance: 70be9dd7-1f43-4843-be62-288d53f57c81] Going to try to start instance {{(pid=122225) start /opt/stack/nova/nova/compute/api.py:2675}} Oct 27 16:20:01.003631 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-48502f14-c877-48af-9dcd-8e727b34c3d8 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] 10.222.0.64 "POST /compute/v2.1/servers/70be9dd7-1f43-4843-be62-288d53f57c81/action" status: 202 len: 0 microversion: 2.1 time: 0.107568 Oct 27 16:20:01.004615 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 994/2067] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Oct 27 16:20:00 2021] POST /compute/v2.1/servers/70be9dd7-1f43-4843-be62-288d53f57c81/action => generated 0 bytes in 110 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 16:20:01.019347 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-93877cc2-b7e2-42a3-948c-6e0c1f5980b7 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:20:01.020058 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-93877cc2-b7e2-42a3-948c-6e0c1f5980b7 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] [instance: 70be9dd7-1f43-4843-be62-288d53f57c81] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:20:01.026352 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-93877cc2-b7e2-42a3-948c-6e0c1f5980b7 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:20:01.026800 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-93877cc2-b7e2-42a3-948c-6e0c1f5980b7 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:20:01.027622 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-93877cc2-b7e2-42a3-948c-6e0c1f5980b7 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:20:01.028089 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-93877cc2-b7e2-42a3-948c-6e0c1f5980b7 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:20:01.227092 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-93877cc2-b7e2-42a3-948c-6e0c1f5980b7 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd24c0e6b236d435bacfb99467b03254d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac26dbbef464ff198b60547a106ce2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 16:20:01.238725 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-93877cc2-b7e2-42a3-948c-6e0c1f5980b7 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] 10.222.0.64 "GET /compute/v2.1/servers/70be9dd7-1f43-4843-be62-288d53f57c81" status: 200 len: 1663 microversion: 2.1 time: 0.226895 Oct 27 16:20:01.238725 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 1074/2068] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 16:20:01 2021] GET /compute/v2.1/servers/70be9dd7-1f43-4843-be62-288d53f57c81 => generated 1663 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 16:20:02.268049 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-b010ecf8-0a55-4a0a-91e4-03308b493931 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:20:02.268756 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-b010ecf8-0a55-4a0a-91e4-03308b493931 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] [instance: 70be9dd7-1f43-4843-be62-288d53f57c81] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:20:02.275390 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-b010ecf8-0a55-4a0a-91e4-03308b493931 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:20:02.275913 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-b010ecf8-0a55-4a0a-91e4-03308b493931 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:20:02.276873 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-b010ecf8-0a55-4a0a-91e4-03308b493931 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:20:02.277495 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-b010ecf8-0a55-4a0a-91e4-03308b493931 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:20:02.457405 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-b010ecf8-0a55-4a0a-91e4-03308b493931 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd24c0e6b236d435bacfb99467b03254d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac26dbbef464ff198b60547a106ce2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 16:20:02.466377 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-b010ecf8-0a55-4a0a-91e4-03308b493931 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] 10.222.0.64 "GET /compute/v2.1/servers/70be9dd7-1f43-4843-be62-288d53f57c81" status: 200 len: 1663 microversion: 2.1 time: 0.203777 Oct 27 16:20:02.467136 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 995/2069] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 16:20:02 2021] GET /compute/v2.1/servers/70be9dd7-1f43-4843-be62-288d53f57c81 => generated 1663 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 16:20:03.489071 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-1a281418-f2c4-4f2d-84bb-4c2a94895505 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:20:03.490217 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-1a281418-f2c4-4f2d-84bb-4c2a94895505 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] [instance: 70be9dd7-1f43-4843-be62-288d53f57c81] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:20:03.501718 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-1a281418-f2c4-4f2d-84bb-4c2a94895505 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:20:03.502528 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-1a281418-f2c4-4f2d-84bb-4c2a94895505 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:20:03.503963 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-1a281418-f2c4-4f2d-84bb-4c2a94895505 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:20:03.504760 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-1a281418-f2c4-4f2d-84bb-4c2a94895505 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:20:03.684677 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-1a281418-f2c4-4f2d-84bb-4c2a94895505 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd24c0e6b236d435bacfb99467b03254d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac26dbbef464ff198b60547a106ce2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 16:20:03.696399 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-1a281418-f2c4-4f2d-84bb-4c2a94895505 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] 10.222.0.64 "GET /compute/v2.1/servers/70be9dd7-1f43-4843-be62-288d53f57c81" status: 200 len: 1667 microversion: 2.1 time: 0.214860 Oct 27 16:20:03.697445 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 1075/2070] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 16:20:03 2021] GET /compute/v2.1/servers/70be9dd7-1f43-4843-be62-288d53f57c81 => generated 1667 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 16:20:05.157547 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-a6ef0570-d765-43ec-9aa5-70c8afb83288 tempest-TestMinimumBasicScenario-420461111 tempest-TestMinimumBasicScenario-420461111-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:20:05.158162 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-a6ef0570-d765-43ec-9aa5-70c8afb83288 tempest-TestMinimumBasicScenario-420461111 tempest-TestMinimumBasicScenario-420461111-project] [instance: a4e12070-1613-4a12-9f73-f4e7f40fc3f3] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:20:05.165048 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-a6ef0570-d765-43ec-9aa5-70c8afb83288 tempest-TestMinimumBasicScenario-420461111 tempest-TestMinimumBasicScenario-420461111-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:20:05.165493 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-a6ef0570-d765-43ec-9aa5-70c8afb83288 tempest-TestMinimumBasicScenario-420461111 tempest-TestMinimumBasicScenario-420461111-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:20:05.166278 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-a6ef0570-d765-43ec-9aa5-70c8afb83288 tempest-TestMinimumBasicScenario-420461111 tempest-TestMinimumBasicScenario-420461111-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:20:05.166712 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-a6ef0570-d765-43ec-9aa5-70c8afb83288 tempest-TestMinimumBasicScenario-420461111 tempest-TestMinimumBasicScenario-420461111-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:20:05.333606 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-a6ef0570-d765-43ec-9aa5-70c8afb83288 tempest-TestMinimumBasicScenario-420461111 tempest-TestMinimumBasicScenario-420461111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906ea7817e7b4ca9a240e2c15220e79b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f6eb1316874ed48d552488e289db7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 16:20:05.342653 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-a6ef0570-d765-43ec-9aa5-70c8afb83288 tempest-TestMinimumBasicScenario-420461111 tempest-TestMinimumBasicScenario-420461111-project] 10.222.0.64 "GET /compute/v2.1/servers/a4e12070-1613-4a12-9f73-f4e7f40fc3f3" status: 200 len: 1595 microversion: 2.1 time: 0.189532 Oct 27 16:20:05.343315 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 996/2071] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 16:20:05 2021] GET /compute/v2.1/servers/a4e12070-1613-4a12-9f73-f4e7f40fc3f3 => generated 1595 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 16:20:07.740351 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [req-883bc8c0-7ebc-4793-90d3-90f86fdcc8ce req-4531cce0-d96f-49dc-9630-da8c18ae51a2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a4e12070-1613-4a12-9f73-f4e7f40fc3f3", "tag": "e1193d94-4bcf-4f1a-9cb1-7c110907babc"}]} {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 16:20:07.741991 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 27 16:20:07.741991 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: warnings.warn(msg) Oct 27 16:20:07.750815 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [req-883bc8c0-7ebc-4793-90d3-90f86fdcc8ce req-4531cce0-d96f-49dc-9630-da8c18ae51a2 service nova] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:20:07.751261 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [req-883bc8c0-7ebc-4793-90d3-90f86fdcc8ce req-4531cce0-d96f-49dc-9630-da8c18ae51a2 service nova] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:20:07.764240 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.compute.server_external_events [req-883bc8c0-7ebc-4793-90d3-90f86fdcc8ce req-4531cce0-d96f-49dc-9630-da8c18ae51a2 service nova] Creating event network-changed:e1193d94-4bcf-4f1a-9cb1-7c110907babc for instance a4e12070-1613-4a12-9f73-f4e7f40fc3f3 on hv-cinder-80070 Oct 27 16:20:07.771873 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [req-883bc8c0-7ebc-4793-90d3-90f86fdcc8ce req-4531cce0-d96f-49dc-9630-da8c18ae51a2 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034288 Oct 27 16:20:07.773530 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 1076/2072] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Oct 27 16:20:07 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 16:20:09.236032 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-7434d1a7-e051-4bd7-a33b-04b9c13f562b tempest-TestMinimumBasicScenario-420461111 tempest-TestMinimumBasicScenario-420461111-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-2028911144"}} {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 16:20:09.236925 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-7434d1a7-e051-4bd7-a33b-04b9c13f562b tempest-TestMinimumBasicScenario-420461111 tempest-TestMinimumBasicScenario-420461111-project] [instance: a4e12070-1613-4a12-9f73-f4e7f40fc3f3] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:20:09.244533 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-7434d1a7-e051-4bd7-a33b-04b9c13f562b tempest-TestMinimumBasicScenario-420461111 tempest-TestMinimumBasicScenario-420461111-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:20:09.245123 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-7434d1a7-e051-4bd7-a33b-04b9c13f562b tempest-TestMinimumBasicScenario-420461111 tempest-TestMinimumBasicScenario-420461111-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:20:09.246040 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-7434d1a7-e051-4bd7-a33b-04b9c13f562b tempest-TestMinimumBasicScenario-420461111 tempest-TestMinimumBasicScenario-420461111-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:20:09.246525 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-7434d1a7-e051-4bd7-a33b-04b9c13f562b tempest-TestMinimumBasicScenario-420461111 tempest-TestMinimumBasicScenario-420461111-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:20:09.415982 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.network.security_group_api [None req-7434d1a7-e051-4bd7-a33b-04b9c13f562b tempest-TestMinimumBasicScenario-420461111 tempest-TestMinimumBasicScenario-420461111-project] Adding security group 0587eee0-f784-4606-8277-0a6db0496b0f to port e1193d94-4bcf-4f1a-9cb1-7c110907babc Oct 27 16:20:09.896792 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-7434d1a7-e051-4bd7-a33b-04b9c13f562b tempest-TestMinimumBasicScenario-420461111 tempest-TestMinimumBasicScenario-420461111-project] 10.222.0.64 "POST /compute/v2.1/servers/a4e12070-1613-4a12-9f73-f4e7f40fc3f3/action" status: 202 len: 0 microversion: 2.1 time: 0.664900 Oct 27 16:20:09.897532 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 997/2073] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Oct 27 16:20:09 2021] POST /compute/v2.1/servers/a4e12070-1613-4a12-9f73-f4e7f40fc3f3/action => generated 0 bytes in 667 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 27 16:20:09.908544 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-694553dc-f7bc-4fcc-a7e7-0473d8e8c42f tempest-TestMinimumBasicScenario-420461111 tempest-TestMinimumBasicScenario-420461111-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:20:09.918957 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [req-9540829e-ae5c-46ec-a195-f5a77171e161 req-202dd2c1-601d-40b7-87f6-948d63c10675 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a4e12070-1613-4a12-9f73-f4e7f40fc3f3", "tag": "e1193d94-4bcf-4f1a-9cb1-7c110907babc"}]} {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 16:20:09.920318 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-694553dc-f7bc-4fcc-a7e7-0473d8e8c42f tempest-TestMinimumBasicScenario-420461111 tempest-TestMinimumBasicScenario-420461111-project] [instance: a4e12070-1613-4a12-9f73-f4e7f40fc3f3] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:20:09.927222 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 27 16:20:09.927222 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: warnings.warn(msg) Oct 27 16:20:09.935508 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-694553dc-f7bc-4fcc-a7e7-0473d8e8c42f tempest-TestMinimumBasicScenario-420461111 tempest-TestMinimumBasicScenario-420461111-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:20:09.938881 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-694553dc-f7bc-4fcc-a7e7-0473d8e8c42f tempest-TestMinimumBasicScenario-420461111 tempest-TestMinimumBasicScenario-420461111-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:20:09.940068 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-694553dc-f7bc-4fcc-a7e7-0473d8e8c42f tempest-TestMinimumBasicScenario-420461111 tempest-TestMinimumBasicScenario-420461111-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:20:09.940518 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-694553dc-f7bc-4fcc-a7e7-0473d8e8c42f tempest-TestMinimumBasicScenario-420461111 tempest-TestMinimumBasicScenario-420461111-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:20:09.945289 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [req-9540829e-ae5c-46ec-a195-f5a77171e161 req-202dd2c1-601d-40b7-87f6-948d63c10675 service nova] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:20:09.945726 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [req-9540829e-ae5c-46ec-a195-f5a77171e161 req-202dd2c1-601d-40b7-87f6-948d63c10675 service nova] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:20:09.973178 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.compute.server_external_events [req-9540829e-ae5c-46ec-a195-f5a77171e161 req-202dd2c1-601d-40b7-87f6-948d63c10675 service nova] Creating event network-changed:e1193d94-4bcf-4f1a-9cb1-7c110907babc for instance a4e12070-1613-4a12-9f73-f4e7f40fc3f3 on hv-cinder-80070 Oct 27 16:20:09.981761 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [req-9540829e-ae5c-46ec-a195-f5a77171e161 req-202dd2c1-601d-40b7-87f6-948d63c10675 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070997 Oct 27 16:20:09.982351 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 998/2074] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Oct 27 16:20:09 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 16:20:10.173102 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-694553dc-f7bc-4fcc-a7e7-0473d8e8c42f tempest-TestMinimumBasicScenario-420461111 tempest-TestMinimumBasicScenario-420461111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906ea7817e7b4ca9a240e2c15220e79b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f6eb1316874ed48d552488e289db7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 16:20:10.187691 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-694553dc-f7bc-4fcc-a7e7-0473d8e8c42f tempest-TestMinimumBasicScenario-420461111 tempest-TestMinimumBasicScenario-420461111-project] 10.222.0.64 "GET /compute/v2.1/servers/a4e12070-1613-4a12-9f73-f4e7f40fc3f3" status: 200 len: 1761 microversion: 2.1 time: 0.283169 Oct 27 16:20:10.189026 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 1077/2075] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 16:20:09 2021] GET /compute/v2.1/servers/a4e12070-1613-4a12-9f73-f4e7f40fc3f3 => generated 1761 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 16:20:32.654638 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-98077fb2-9deb-42ae-8e8f-42661b85cba7 tempest-TestMinimumBasicScenario-420461111 tempest-TestMinimumBasicScenario-420461111-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 16:20:32.656768 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-98077fb2-9deb-42ae-8e8f-42661b85cba7 tempest-TestMinimumBasicScenario-420461111 tempest-TestMinimumBasicScenario-420461111-project] [instance: a4e12070-1613-4a12-9f73-f4e7f40fc3f3] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:20:32.667902 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-98077fb2-9deb-42ae-8e8f-42661b85cba7 tempest-TestMinimumBasicScenario-420461111 tempest-TestMinimumBasicScenario-420461111-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:20:32.668673 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-98077fb2-9deb-42ae-8e8f-42661b85cba7 tempest-TestMinimumBasicScenario-420461111 tempest-TestMinimumBasicScenario-420461111-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:20:32.670021 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-98077fb2-9deb-42ae-8e8f-42661b85cba7 tempest-TestMinimumBasicScenario-420461111 tempest-TestMinimumBasicScenario-420461111-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:20:32.671419 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-98077fb2-9deb-42ae-8e8f-42661b85cba7 tempest-TestMinimumBasicScenario-420461111 tempest-TestMinimumBasicScenario-420461111-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:20:32.800442 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-98077fb2-9deb-42ae-8e8f-42661b85cba7 tempest-TestMinimumBasicScenario-420461111 tempest-TestMinimumBasicScenario-420461111-project] 10.222.0.64 "POST /compute/v2.1/servers/a4e12070-1613-4a12-9f73-f4e7f40fc3f3/action" status: 202 len: 0 microversion: 2.1 time: 0.154501 Oct 27 16:20:32.801518 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 999/2076] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Oct 27 16:20:32 2021] POST /compute/v2.1/servers/a4e12070-1613-4a12-9f73-f4e7f40fc3f3/action => generated 0 bytes in 157 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 16:20:32.816291 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-69260648-247e-439e-bb2f-b875e6c5718e tempest-TestMinimumBasicScenario-420461111 tempest-TestMinimumBasicScenario-420461111-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:20:32.817429 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-69260648-247e-439e-bb2f-b875e6c5718e tempest-TestMinimumBasicScenario-420461111 tempest-TestMinimumBasicScenario-420461111-project] [instance: a4e12070-1613-4a12-9f73-f4e7f40fc3f3] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:20:32.829691 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-69260648-247e-439e-bb2f-b875e6c5718e tempest-TestMinimumBasicScenario-420461111 tempest-TestMinimumBasicScenario-420461111-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:20:32.830394 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-69260648-247e-439e-bb2f-b875e6c5718e tempest-TestMinimumBasicScenario-420461111 tempest-TestMinimumBasicScenario-420461111-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:20:32.831658 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-69260648-247e-439e-bb2f-b875e6c5718e tempest-TestMinimumBasicScenario-420461111 tempest-TestMinimumBasicScenario-420461111-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:20:32.832289 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-69260648-247e-439e-bb2f-b875e6c5718e tempest-TestMinimumBasicScenario-420461111 tempest-TestMinimumBasicScenario-420461111-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:20:33.007182 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-69260648-247e-439e-bb2f-b875e6c5718e tempest-TestMinimumBasicScenario-420461111 tempest-TestMinimumBasicScenario-420461111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906ea7817e7b4ca9a240e2c15220e79b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f6eb1316874ed48d552488e289db7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 16:20:33.017141 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-69260648-247e-439e-bb2f-b875e6c5718e tempest-TestMinimumBasicScenario-420461111 tempest-TestMinimumBasicScenario-420461111-project] 10.222.0.64 "GET /compute/v2.1/servers/a4e12070-1613-4a12-9f73-f4e7f40fc3f3" status: 200 len: 1753 microversion: 2.1 time: 0.208471 Oct 27 16:20:33.017839 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 1078/2077] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 16:20:32 2021] GET /compute/v2.1/servers/a4e12070-1613-4a12-9f73-f4e7f40fc3f3 => generated 1753 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 16:20:34.038792 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-f650f9ec-fc1f-4f6c-8967-b28dc1004c07 tempest-TestMinimumBasicScenario-420461111 tempest-TestMinimumBasicScenario-420461111-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:20:34.039585 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-f650f9ec-fc1f-4f6c-8967-b28dc1004c07 tempest-TestMinimumBasicScenario-420461111 tempest-TestMinimumBasicScenario-420461111-project] [instance: a4e12070-1613-4a12-9f73-f4e7f40fc3f3] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:20:34.048958 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-f650f9ec-fc1f-4f6c-8967-b28dc1004c07 tempest-TestMinimumBasicScenario-420461111 tempest-TestMinimumBasicScenario-420461111-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:20:34.049411 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-f650f9ec-fc1f-4f6c-8967-b28dc1004c07 tempest-TestMinimumBasicScenario-420461111 tempest-TestMinimumBasicScenario-420461111-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:20:34.050251 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-f650f9ec-fc1f-4f6c-8967-b28dc1004c07 tempest-TestMinimumBasicScenario-420461111 tempest-TestMinimumBasicScenario-420461111-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:20:34.050789 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-f650f9ec-fc1f-4f6c-8967-b28dc1004c07 tempest-TestMinimumBasicScenario-420461111 tempest-TestMinimumBasicScenario-420461111-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:20:34.284905 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-f650f9ec-fc1f-4f6c-8967-b28dc1004c07 tempest-TestMinimumBasicScenario-420461111 tempest-TestMinimumBasicScenario-420461111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906ea7817e7b4ca9a240e2c15220e79b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f6eb1316874ed48d552488e289db7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 16:20:34.300668 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-f650f9ec-fc1f-4f6c-8967-b28dc1004c07 tempest-TestMinimumBasicScenario-420461111 tempest-TestMinimumBasicScenario-420461111-project] 10.222.0.64 "GET /compute/v2.1/servers/a4e12070-1613-4a12-9f73-f4e7f40fc3f3" status: 200 len: 1758 microversion: 2.1 time: 0.266788 Oct 27 16:20:34.301995 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 1000/2078] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 16:20:34 2021] GET /compute/v2.1/servers/a4e12070-1613-4a12-9f73-f4e7f40fc3f3 => generated 1758 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 16:20:35.333572 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-7cbfd8b5-f118-4644-89fa-8e1ea84f90b0 tempest-TestMinimumBasicScenario-420461111 tempest-TestMinimumBasicScenario-420461111-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:20:35.334705 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-7cbfd8b5-f118-4644-89fa-8e1ea84f90b0 tempest-TestMinimumBasicScenario-420461111 tempest-TestMinimumBasicScenario-420461111-project] [instance: a4e12070-1613-4a12-9f73-f4e7f40fc3f3] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:20:35.346196 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-7cbfd8b5-f118-4644-89fa-8e1ea84f90b0 tempest-TestMinimumBasicScenario-420461111 tempest-TestMinimumBasicScenario-420461111-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:20:35.346946 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-7cbfd8b5-f118-4644-89fa-8e1ea84f90b0 tempest-TestMinimumBasicScenario-420461111 tempest-TestMinimumBasicScenario-420461111-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:20:35.348386 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-7cbfd8b5-f118-4644-89fa-8e1ea84f90b0 tempest-TestMinimumBasicScenario-420461111 tempest-TestMinimumBasicScenario-420461111-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:20:35.349152 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-7cbfd8b5-f118-4644-89fa-8e1ea84f90b0 tempest-TestMinimumBasicScenario-420461111 tempest-TestMinimumBasicScenario-420461111-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:20:35.532040 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-7cbfd8b5-f118-4644-89fa-8e1ea84f90b0 tempest-TestMinimumBasicScenario-420461111 tempest-TestMinimumBasicScenario-420461111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906ea7817e7b4ca9a240e2c15220e79b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f6eb1316874ed48d552488e289db7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 16:20:35.547231 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-7cbfd8b5-f118-4644-89fa-8e1ea84f90b0 tempest-TestMinimumBasicScenario-420461111 tempest-TestMinimumBasicScenario-420461111-project] 10.222.0.64 "GET /compute/v2.1/servers/a4e12070-1613-4a12-9f73-f4e7f40fc3f3" status: 200 len: 1758 microversion: 2.1 time: 0.220425 Oct 27 16:20:35.548355 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 1079/2079] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 16:20:35 2021] GET /compute/v2.1/servers/a4e12070-1613-4a12-9f73-f4e7f40fc3f3 => generated 1758 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 16:20:36.588162 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-eecd79ac-1c81-4ed9-9f4a-db3f92b0d6ab tempest-TestMinimumBasicScenario-420461111 tempest-TestMinimumBasicScenario-420461111-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:20:36.589352 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-eecd79ac-1c81-4ed9-9f4a-db3f92b0d6ab tempest-TestMinimumBasicScenario-420461111 tempest-TestMinimumBasicScenario-420461111-project] [instance: a4e12070-1613-4a12-9f73-f4e7f40fc3f3] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:20:36.601700 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-eecd79ac-1c81-4ed9-9f4a-db3f92b0d6ab tempest-TestMinimumBasicScenario-420461111 tempest-TestMinimumBasicScenario-420461111-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:20:36.602742 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-eecd79ac-1c81-4ed9-9f4a-db3f92b0d6ab tempest-TestMinimumBasicScenario-420461111 tempest-TestMinimumBasicScenario-420461111-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:20:36.604380 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-eecd79ac-1c81-4ed9-9f4a-db3f92b0d6ab tempest-TestMinimumBasicScenario-420461111 tempest-TestMinimumBasicScenario-420461111-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:20:36.605220 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-eecd79ac-1c81-4ed9-9f4a-db3f92b0d6ab tempest-TestMinimumBasicScenario-420461111 tempest-TestMinimumBasicScenario-420461111-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:20:36.815768 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-eecd79ac-1c81-4ed9-9f4a-db3f92b0d6ab tempest-TestMinimumBasicScenario-420461111 tempest-TestMinimumBasicScenario-420461111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906ea7817e7b4ca9a240e2c15220e79b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f6eb1316874ed48d552488e289db7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 16:20:36.825473 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-eecd79ac-1c81-4ed9-9f4a-db3f92b0d6ab tempest-TestMinimumBasicScenario-420461111 tempest-TestMinimumBasicScenario-420461111-project] 10.222.0.64 "GET /compute/v2.1/servers/a4e12070-1613-4a12-9f73-f4e7f40fc3f3" status: 200 len: 1758 microversion: 2.1 time: 0.246305 Oct 27 16:20:36.826211 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 1001/2080] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 16:20:36 2021] GET /compute/v2.1/servers/a4e12070-1613-4a12-9f73-f4e7f40fc3f3 => generated 1758 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 16:20:36.942041 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-77f7687b-8167-4963-8acb-8de3eebd0bf1 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:20:36.943985 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-77f7687b-8167-4963-8acb-8de3eebd0bf1 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] [instance: 70be9dd7-1f43-4843-be62-288d53f57c81] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:20:36.957139 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-77f7687b-8167-4963-8acb-8de3eebd0bf1 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:20:36.957947 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-77f7687b-8167-4963-8acb-8de3eebd0bf1 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:20:36.959582 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-77f7687b-8167-4963-8acb-8de3eebd0bf1 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:20:36.960412 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-77f7687b-8167-4963-8acb-8de3eebd0bf1 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:20:37.020943 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-77f7687b-8167-4963-8acb-8de3eebd0bf1 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] 10.222.0.64 "GET /compute/v2.1/servers/70be9dd7-1f43-4843-be62-288d53f57c81/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.087595 Oct 27 16:20:37.022012 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 1080/2081] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Oct 27 16:20:36 2021] GET /compute/v2.1/servers/70be9dd7-1f43-4843-be62-288d53f57c81/os-volume_attachments => generated 25 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 27 16:20:37.102827 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-82483e84-9937-4f50-a53a-06e814d0109d tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:20:37.103717 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-82483e84-9937-4f50-a53a-06e814d0109d tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] [instance: 70be9dd7-1f43-4843-be62-288d53f57c81] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:20:37.115331 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-82483e84-9937-4f50-a53a-06e814d0109d tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:20:37.116081 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-82483e84-9937-4f50-a53a-06e814d0109d tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:20:37.117503 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-82483e84-9937-4f50-a53a-06e814d0109d tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:20:37.118329 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-82483e84-9937-4f50-a53a-06e814d0109d tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:20:37.170574 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-82483e84-9937-4f50-a53a-06e814d0109d tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] [instance: 70be9dd7-1f43-4843-be62-288d53f57c81] Going to try to terminate instance {{(pid=122225) delete /opt/stack/nova/nova/compute/api.py:2612}} Oct 27 16:20:37.295044 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-82483e84-9937-4f50-a53a-06e814d0109d tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] 10.222.0.64 "DELETE /compute/v2.1/servers/70be9dd7-1f43-4843-be62-288d53f57c81" status: 204 len: 0 microversion: 2.1 time: 0.199122 Oct 27 16:20:37.296612 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 1002/2082] 10.222.0.64 () {58 vars in 1238 bytes} [Wed Oct 27 16:20:37 2021] DELETE /compute/v2.1/servers/70be9dd7-1f43-4843-be62-288d53f57c81 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 16:20:37.309169 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-c43c53a6-21b0-4b19-8a21-1b190abdf517 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:20:37.310255 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-c43c53a6-21b0-4b19-8a21-1b190abdf517 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] [instance: 70be9dd7-1f43-4843-be62-288d53f57c81] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:20:37.321086 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-c43c53a6-21b0-4b19-8a21-1b190abdf517 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:20:37.321777 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-c43c53a6-21b0-4b19-8a21-1b190abdf517 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:20:37.323468 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-c43c53a6-21b0-4b19-8a21-1b190abdf517 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:20:37.324306 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-c43c53a6-21b0-4b19-8a21-1b190abdf517 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:20:37.490846 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-c43c53a6-21b0-4b19-8a21-1b190abdf517 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd24c0e6b236d435bacfb99467b03254d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac26dbbef464ff198b60547a106ce2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 16:20:37.500225 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-c43c53a6-21b0-4b19-8a21-1b190abdf517 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] 10.222.0.64 "GET /compute/v2.1/servers/70be9dd7-1f43-4843-be62-288d53f57c81" status: 200 len: 1673 microversion: 2.1 time: 0.198651 Oct 27 16:20:37.500833 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 1081/2083] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 16:20:37 2021] GET /compute/v2.1/servers/70be9dd7-1f43-4843-be62-288d53f57c81 => generated 1673 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 16:20:37.846579 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-da725610-5af4-4cc7-9e43-f9d921466794 tempest-TestMinimumBasicScenario-420461111 tempest-TestMinimumBasicScenario-420461111-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:20:37.847648 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-da725610-5af4-4cc7-9e43-f9d921466794 tempest-TestMinimumBasicScenario-420461111 tempest-TestMinimumBasicScenario-420461111-project] [instance: a4e12070-1613-4a12-9f73-f4e7f40fc3f3] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:20:37.855013 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-da725610-5af4-4cc7-9e43-f9d921466794 tempest-TestMinimumBasicScenario-420461111 tempest-TestMinimumBasicScenario-420461111-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:20:37.855502 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-da725610-5af4-4cc7-9e43-f9d921466794 tempest-TestMinimumBasicScenario-420461111 tempest-TestMinimumBasicScenario-420461111-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:20:37.856379 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-da725610-5af4-4cc7-9e43-f9d921466794 tempest-TestMinimumBasicScenario-420461111 tempest-TestMinimumBasicScenario-420461111-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:20:37.856857 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-da725610-5af4-4cc7-9e43-f9d921466794 tempest-TestMinimumBasicScenario-420461111 tempest-TestMinimumBasicScenario-420461111-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:20:38.028687 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-da725610-5af4-4cc7-9e43-f9d921466794 tempest-TestMinimumBasicScenario-420461111 tempest-TestMinimumBasicScenario-420461111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906ea7817e7b4ca9a240e2c15220e79b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f6eb1316874ed48d552488e289db7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 16:20:38.040285 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-da725610-5af4-4cc7-9e43-f9d921466794 tempest-TestMinimumBasicScenario-420461111 tempest-TestMinimumBasicScenario-420461111-project] 10.222.0.64 "GET /compute/v2.1/servers/a4e12070-1613-4a12-9f73-f4e7f40fc3f3" status: 200 len: 1758 microversion: 2.1 time: 0.198966 Oct 27 16:20:38.041222 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 1003/2084] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 16:20:37 2021] GET /compute/v2.1/servers/a4e12070-1613-4a12-9f73-f4e7f40fc3f3 => generated 1758 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 16:20:38.519138 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-3f9503ff-5142-4f01-8034-9b20a2e41cc1 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:20:38.520204 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-3f9503ff-5142-4f01-8034-9b20a2e41cc1 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] [instance: 70be9dd7-1f43-4843-be62-288d53f57c81] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:20:38.531043 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-3f9503ff-5142-4f01-8034-9b20a2e41cc1 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:20:38.531504 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-3f9503ff-5142-4f01-8034-9b20a2e41cc1 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:20:38.532395 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-3f9503ff-5142-4f01-8034-9b20a2e41cc1 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:20:38.532845 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-3f9503ff-5142-4f01-8034-9b20a2e41cc1 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:20:38.694842 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-3f9503ff-5142-4f01-8034-9b20a2e41cc1 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd24c0e6b236d435bacfb99467b03254d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac26dbbef464ff198b60547a106ce2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 16:20:38.717475 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-3f9503ff-5142-4f01-8034-9b20a2e41cc1 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] 10.222.0.64 "GET /compute/v2.1/servers/70be9dd7-1f43-4843-be62-288d53f57c81" status: 200 len: 1673 microversion: 2.1 time: 0.202245 Oct 27 16:20:38.720501 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 1082/2085] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 16:20:38 2021] GET /compute/v2.1/servers/70be9dd7-1f43-4843-be62-288d53f57c81 => generated 1673 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 16:20:39.062318 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-54319090-fae0-4039-9ef8-045afd703e61 tempest-TestMinimumBasicScenario-420461111 tempest-TestMinimumBasicScenario-420461111-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:20:39.063362 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-54319090-fae0-4039-9ef8-045afd703e61 tempest-TestMinimumBasicScenario-420461111 tempest-TestMinimumBasicScenario-420461111-project] [instance: a4e12070-1613-4a12-9f73-f4e7f40fc3f3] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:20:39.078786 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-54319090-fae0-4039-9ef8-045afd703e61 tempest-TestMinimumBasicScenario-420461111 tempest-TestMinimumBasicScenario-420461111-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:20:39.079760 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-54319090-fae0-4039-9ef8-045afd703e61 tempest-TestMinimumBasicScenario-420461111 tempest-TestMinimumBasicScenario-420461111-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:20:39.080961 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-54319090-fae0-4039-9ef8-045afd703e61 tempest-TestMinimumBasicScenario-420461111 tempest-TestMinimumBasicScenario-420461111-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:20:39.081568 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-54319090-fae0-4039-9ef8-045afd703e61 tempest-TestMinimumBasicScenario-420461111 tempest-TestMinimumBasicScenario-420461111-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:20:39.326564 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-54319090-fae0-4039-9ef8-045afd703e61 tempest-TestMinimumBasicScenario-420461111 tempest-TestMinimumBasicScenario-420461111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906ea7817e7b4ca9a240e2c15220e79b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f6eb1316874ed48d552488e289db7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 16:20:39.341112 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-54319090-fae0-4039-9ef8-045afd703e61 tempest-TestMinimumBasicScenario-420461111 tempest-TestMinimumBasicScenario-420461111-project] 10.222.0.64 "GET /compute/v2.1/servers/a4e12070-1613-4a12-9f73-f4e7f40fc3f3" status: 200 len: 1758 microversion: 2.1 time: 0.283164 Oct 27 16:20:39.343531 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 1004/2086] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 16:20:39 2021] GET /compute/v2.1/servers/a4e12070-1613-4a12-9f73-f4e7f40fc3f3 => generated 1758 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 16:20:39.749472 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-416e9454-e5bb-485d-a685-b021852d1f85 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:20:39.750935 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-416e9454-e5bb-485d-a685-b021852d1f85 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] [instance: 70be9dd7-1f43-4843-be62-288d53f57c81] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:20:39.758468 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-416e9454-e5bb-485d-a685-b021852d1f85 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:20:39.758840 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-416e9454-e5bb-485d-a685-b021852d1f85 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:20:39.759669 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-416e9454-e5bb-485d-a685-b021852d1f85 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:20:39.760138 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-416e9454-e5bb-485d-a685-b021852d1f85 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:20:39.949172 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-416e9454-e5bb-485d-a685-b021852d1f85 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd24c0e6b236d435bacfb99467b03254d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac26dbbef464ff198b60547a106ce2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 16:20:39.965407 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-416e9454-e5bb-485d-a685-b021852d1f85 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] 10.222.0.64 "GET /compute/v2.1/servers/70be9dd7-1f43-4843-be62-288d53f57c81" status: 200 len: 1673 microversion: 2.1 time: 0.221391 Oct 27 16:20:39.966695 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 1083/2087] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 16:20:39 2021] GET /compute/v2.1/servers/70be9dd7-1f43-4843-be62-288d53f57c81 => generated 1673 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 16:20:40.365368 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-82e420c6-429d-4676-a293-cbec1edbb281 tempest-TestMinimumBasicScenario-420461111 tempest-TestMinimumBasicScenario-420461111-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:20:40.366369 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-82e420c6-429d-4676-a293-cbec1edbb281 tempest-TestMinimumBasicScenario-420461111 tempest-TestMinimumBasicScenario-420461111-project] [instance: a4e12070-1613-4a12-9f73-f4e7f40fc3f3] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:20:40.374282 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-82e420c6-429d-4676-a293-cbec1edbb281 tempest-TestMinimumBasicScenario-420461111 tempest-TestMinimumBasicScenario-420461111-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:20:40.374954 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-82e420c6-429d-4676-a293-cbec1edbb281 tempest-TestMinimumBasicScenario-420461111 tempest-TestMinimumBasicScenario-420461111-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:20:40.376010 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-82e420c6-429d-4676-a293-cbec1edbb281 tempest-TestMinimumBasicScenario-420461111 tempest-TestMinimumBasicScenario-420461111-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:20:40.376548 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-82e420c6-429d-4676-a293-cbec1edbb281 tempest-TestMinimumBasicScenario-420461111 tempest-TestMinimumBasicScenario-420461111-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:20:40.681496 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-82e420c6-429d-4676-a293-cbec1edbb281 tempest-TestMinimumBasicScenario-420461111 tempest-TestMinimumBasicScenario-420461111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906ea7817e7b4ca9a240e2c15220e79b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f6eb1316874ed48d552488e289db7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 16:20:40.707276 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-82e420c6-429d-4676-a293-cbec1edbb281 tempest-TestMinimumBasicScenario-420461111 tempest-TestMinimumBasicScenario-420461111-project] 10.222.0.64 "GET /compute/v2.1/servers/a4e12070-1613-4a12-9f73-f4e7f40fc3f3" status: 200 len: 1758 microversion: 2.1 time: 0.344968 Oct 27 16:20:40.708454 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 1005/2088] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 16:20:40 2021] GET /compute/v2.1/servers/a4e12070-1613-4a12-9f73-f4e7f40fc3f3 => generated 1758 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 16:20:40.814624 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [req-782433ed-340a-4fb8-a3b2-5d4be0826498 req-ce42aa84-2e41-40db-891e-72422ce9936d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "70be9dd7-1f43-4843-be62-288d53f57c81", "name": "network-vif-deleted", "tag": "9092995e-af0c-485d-a42c-1090313651e1"}]} {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 16:20:40.820422 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 27 16:20:40.820422 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: warnings.warn(msg) Oct 27 16:20:40.836263 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [req-782433ed-340a-4fb8-a3b2-5d4be0826498 req-ce42aa84-2e41-40db-891e-72422ce9936d service nova] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:20:40.837748 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [req-782433ed-340a-4fb8-a3b2-5d4be0826498 req-ce42aa84-2e41-40db-891e-72422ce9936d service nova] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:20:40.866857 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.compute.server_external_events [req-782433ed-340a-4fb8-a3b2-5d4be0826498 req-ce42aa84-2e41-40db-891e-72422ce9936d service nova] Creating event network-vif-deleted:9092995e-af0c-485d-a42c-1090313651e1 for instance 70be9dd7-1f43-4843-be62-288d53f57c81 on hv-cinder-80070 Oct 27 16:20:40.878790 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [req-782433ed-340a-4fb8-a3b2-5d4be0826498 req-ce42aa84-2e41-40db-891e-72422ce9936d service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079941 Oct 27 16:20:40.880433 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 1084/2089] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Oct 27 16:20:40 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 16:20:41.000254 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-71c27a2f-8f96-4dfb-ad5e-5966f2674087 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:20:41.002149 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-71c27a2f-8f96-4dfb-ad5e-5966f2674087 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] [instance: 70be9dd7-1f43-4843-be62-288d53f57c81] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:20:41.014204 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-71c27a2f-8f96-4dfb-ad5e-5966f2674087 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:20:41.015491 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-71c27a2f-8f96-4dfb-ad5e-5966f2674087 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:20:41.017395 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-71c27a2f-8f96-4dfb-ad5e-5966f2674087 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:20:41.018333 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-71c27a2f-8f96-4dfb-ad5e-5966f2674087 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:20:41.080349 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-71c27a2f-8f96-4dfb-ad5e-5966f2674087 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:20:41.081047 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-71c27a2f-8f96-4dfb-ad5e-5966f2674087 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:20:41.081863 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.objects.instance [None req-71c27a2f-8f96-4dfb-ad5e-5966f2674087 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lazy-loading 'fault' on Instance uuid 70be9dd7-1f43-4843-be62-288d53f57c81 {{(pid=122225) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 27 16:20:41.154078 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-71c27a2f-8f96-4dfb-ad5e-5966f2674087 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd24c0e6b236d435bacfb99467b03254d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac26dbbef464ff198b60547a106ce2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 16:20:41.167194 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-71c27a2f-8f96-4dfb-ad5e-5966f2674087 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] 10.222.0.64 "GET /compute/v2.1/servers/70be9dd7-1f43-4843-be62-288d53f57c81" status: 200 len: 1327 microversion: 2.1 time: 0.176061 Oct 27 16:20:41.168378 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 1006/2090] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 16:20:40 2021] GET /compute/v2.1/servers/70be9dd7-1f43-4843-be62-288d53f57c81 => generated 1327 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 16:20:41.737084 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-11264e9e-1493-4164-93bb-2c59304ee9be tempest-TestMinimumBasicScenario-420461111 tempest-TestMinimumBasicScenario-420461111-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:20:41.737997 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-11264e9e-1493-4164-93bb-2c59304ee9be tempest-TestMinimumBasicScenario-420461111 tempest-TestMinimumBasicScenario-420461111-project] [instance: a4e12070-1613-4a12-9f73-f4e7f40fc3f3] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:20:41.745041 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-11264e9e-1493-4164-93bb-2c59304ee9be tempest-TestMinimumBasicScenario-420461111 tempest-TestMinimumBasicScenario-420461111-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:20:41.745646 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-11264e9e-1493-4164-93bb-2c59304ee9be tempest-TestMinimumBasicScenario-420461111 tempest-TestMinimumBasicScenario-420461111-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:20:41.746482 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-11264e9e-1493-4164-93bb-2c59304ee9be tempest-TestMinimumBasicScenario-420461111 tempest-TestMinimumBasicScenario-420461111-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:20:41.746921 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-11264e9e-1493-4164-93bb-2c59304ee9be tempest-TestMinimumBasicScenario-420461111 tempest-TestMinimumBasicScenario-420461111-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:20:41.931538 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-11264e9e-1493-4164-93bb-2c59304ee9be tempest-TestMinimumBasicScenario-420461111 tempest-TestMinimumBasicScenario-420461111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906ea7817e7b4ca9a240e2c15220e79b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f6eb1316874ed48d552488e289db7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 16:20:41.948249 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-11264e9e-1493-4164-93bb-2c59304ee9be tempest-TestMinimumBasicScenario-420461111 tempest-TestMinimumBasicScenario-420461111-project] 10.222.0.64 "GET /compute/v2.1/servers/a4e12070-1613-4a12-9f73-f4e7f40fc3f3" status: 200 len: 1758 microversion: 2.1 time: 0.216172 Oct 27 16:20:41.949278 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 1085/2091] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 16:20:41 2021] GET /compute/v2.1/servers/a4e12070-1613-4a12-9f73-f4e7f40fc3f3 => generated 1758 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 16:20:42.195648 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-25bddf32-2986-4e1a-b677-4a217b87f52b tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:20:42.196533 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-25bddf32-2986-4e1a-b677-4a217b87f52b tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] [instance: 70be9dd7-1f43-4843-be62-288d53f57c81] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:20:42.205627 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-25bddf32-2986-4e1a-b677-4a217b87f52b tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:20:42.206193 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-25bddf32-2986-4e1a-b677-4a217b87f52b tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:20:42.207259 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-25bddf32-2986-4e1a-b677-4a217b87f52b tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:20:42.207763 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-25bddf32-2986-4e1a-b677-4a217b87f52b tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:20:42.226511 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.wsgi [None req-25bddf32-2986-4e1a-b677-4a217b87f52b tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] HTTP exception thrown: Instance 70be9dd7-1f43-4843-be62-288d53f57c81 could not be found. Oct 27 16:20:42.227294 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-25bddf32-2986-4e1a-b677-4a217b87f52b tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Returning 404 to user: Instance 70be9dd7-1f43-4843-be62-288d53f57c81 could not be found. {{(pid=122225) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 27 16:20:42.228294 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-25bddf32-2986-4e1a-b677-4a217b87f52b tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] 10.222.0.64 "GET /compute/v2.1/servers/70be9dd7-1f43-4843-be62-288d53f57c81" status: 404 len: 111 microversion: 2.1 time: 0.036723 Oct 27 16:20:42.229021 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 1007/2092] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 16:20:42 2021] GET /compute/v2.1/servers/70be9dd7-1f43-4843-be62-288d53f57c81 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 16:20:42.241365 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-65204bba-8b6e-484b-aec2-5900052abd89 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Calling method '.version_select at 0x7fbc05cc0430>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:20:42.268939 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-65204bba-8b6e-484b-aec2-5900052abd89 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] 10.222.0.64 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-360934905" status: 202 len: 0 microversion: 2.1 time: 0.031484 Oct 27 16:20:42.270034 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 1086/2093] 10.222.0.64 () {58 vars in 1217 bytes} [Wed Oct 27 16:20:42 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-360934905 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 16:20:42.977321 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-f8566409-c700-4a25-8b12-9a73e5b2e105 tempest-TestMinimumBasicScenario-420461111 tempest-TestMinimumBasicScenario-420461111-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:20:42.978091 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-f8566409-c700-4a25-8b12-9a73e5b2e105 tempest-TestMinimumBasicScenario-420461111 tempest-TestMinimumBasicScenario-420461111-project] [instance: a4e12070-1613-4a12-9f73-f4e7f40fc3f3] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:20:42.986067 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-f8566409-c700-4a25-8b12-9a73e5b2e105 tempest-TestMinimumBasicScenario-420461111 tempest-TestMinimumBasicScenario-420461111-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:20:42.986763 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-f8566409-c700-4a25-8b12-9a73e5b2e105 tempest-TestMinimumBasicScenario-420461111 tempest-TestMinimumBasicScenario-420461111-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:20:42.987824 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-f8566409-c700-4a25-8b12-9a73e5b2e105 tempest-TestMinimumBasicScenario-420461111 tempest-TestMinimumBasicScenario-420461111-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:20:42.988393 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-f8566409-c700-4a25-8b12-9a73e5b2e105 tempest-TestMinimumBasicScenario-420461111 tempest-TestMinimumBasicScenario-420461111-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:20:43.210293 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-f8566409-c700-4a25-8b12-9a73e5b2e105 tempest-TestMinimumBasicScenario-420461111 tempest-TestMinimumBasicScenario-420461111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906ea7817e7b4ca9a240e2c15220e79b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f6eb1316874ed48d552488e289db7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 16:20:43.233602 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-f8566409-c700-4a25-8b12-9a73e5b2e105 tempest-TestMinimumBasicScenario-420461111 tempest-TestMinimumBasicScenario-420461111-project] 10.222.0.64 "GET /compute/v2.1/servers/a4e12070-1613-4a12-9f73-f4e7f40fc3f3" status: 200 len: 1758 microversion: 2.1 time: 0.260408 Oct 27 16:20:43.234409 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 1008/2094] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 16:20:42 2021] GET /compute/v2.1/servers/a4e12070-1613-4a12-9f73-f4e7f40fc3f3 => generated 1758 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 16:20:43.463773 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-3e57a272-ac06-4ab9-9c00-cf9665e472b1 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Action: 'create', calling method: .version_select at 0x7fbc05de99d0>, body: {"keypair": {"name": "tempest-keypair-1779637703"}} {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 16:20:43.502130 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.quota [None req-3e57a272-ac06-4ab9-9c00-cf9665e472b1 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Getting quotas for project 0ac26dbbef464ff198b60547a106ce2a. Resources: {'key_pairs'} {{(pid=122224) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 27 16:20:43.509139 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.quota [None req-3e57a272-ac06-4ab9-9c00-cf9665e472b1 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Getting quotas for user d24c0e6b236d435bacfb99467b03254d and project 0ac26dbbef464ff198b60547a106ce2a. Resources: {'key_pairs'} {{(pid=122224) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 27 16:20:43.706524 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.quota [None req-3e57a272-ac06-4ab9-9c00-cf9665e472b1 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Getting quotas for project 0ac26dbbef464ff198b60547a106ce2a. Resources: {'key_pairs'} {{(pid=122224) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 27 16:20:43.711655 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.quota [None req-3e57a272-ac06-4ab9-9c00-cf9665e472b1 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Getting quotas for user d24c0e6b236d435bacfb99467b03254d and project 0ac26dbbef464ff198b60547a106ce2a. Resources: {'key_pairs'} {{(pid=122224) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 27 16:20:43.728124 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-3e57a272-ac06-4ab9-9c00-cf9665e472b1 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] 10.222.0.64 "POST /compute/v2.1/os-keypairs" status: 200 len: 2305 microversion: 2.1 time: 0.272147 Oct 27 16:20:43.728738 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 1087/2095] 10.222.0.64 () {60 vars in 1157 bytes} [Wed Oct 27 16:20:43 2021] POST /compute/v2.1/os-keypairs => generated 2305 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 16:20:44.252966 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-605ce339-aab4-4bce-900f-132ade7ea082 tempest-TestMinimumBasicScenario-420461111 tempest-TestMinimumBasicScenario-420461111-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:20:44.254022 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-605ce339-aab4-4bce-900f-132ade7ea082 tempest-TestMinimumBasicScenario-420461111 tempest-TestMinimumBasicScenario-420461111-project] [instance: a4e12070-1613-4a12-9f73-f4e7f40fc3f3] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:20:44.262789 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-605ce339-aab4-4bce-900f-132ade7ea082 tempest-TestMinimumBasicScenario-420461111 tempest-TestMinimumBasicScenario-420461111-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:20:44.263460 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-605ce339-aab4-4bce-900f-132ade7ea082 tempest-TestMinimumBasicScenario-420461111 tempest-TestMinimumBasicScenario-420461111-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:20:44.265664 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-605ce339-aab4-4bce-900f-132ade7ea082 tempest-TestMinimumBasicScenario-420461111 tempest-TestMinimumBasicScenario-420461111-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:20:44.265928 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-605ce339-aab4-4bce-900f-132ade7ea082 tempest-TestMinimumBasicScenario-420461111 tempest-TestMinimumBasicScenario-420461111-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:20:44.615709 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-605ce339-aab4-4bce-900f-132ade7ea082 tempest-TestMinimumBasicScenario-420461111 tempest-TestMinimumBasicScenario-420461111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906ea7817e7b4ca9a240e2c15220e79b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f6eb1316874ed48d552488e289db7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 16:20:44.624811 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-605ce339-aab4-4bce-900f-132ade7ea082 tempest-TestMinimumBasicScenario-420461111 tempest-TestMinimumBasicScenario-420461111-project] 10.222.0.64 "GET /compute/v2.1/servers/a4e12070-1613-4a12-9f73-f4e7f40fc3f3" status: 200 len: 1758 microversion: 2.1 time: 0.376469 Oct 27 16:20:44.625390 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 1009/2096] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 16:20:44 2021] GET /compute/v2.1/servers/a4e12070-1613-4a12-9f73-f4e7f40fc3f3 => generated 1758 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 16:20:45.653346 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-603a1f6e-3091-476e-b295-0f16398ec48c tempest-TestMinimumBasicScenario-420461111 tempest-TestMinimumBasicScenario-420461111-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:20:45.654680 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-603a1f6e-3091-476e-b295-0f16398ec48c tempest-TestMinimumBasicScenario-420461111 tempest-TestMinimumBasicScenario-420461111-project] [instance: a4e12070-1613-4a12-9f73-f4e7f40fc3f3] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:20:45.666534 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-603a1f6e-3091-476e-b295-0f16398ec48c tempest-TestMinimumBasicScenario-420461111 tempest-TestMinimumBasicScenario-420461111-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:20:45.667360 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-603a1f6e-3091-476e-b295-0f16398ec48c tempest-TestMinimumBasicScenario-420461111 tempest-TestMinimumBasicScenario-420461111-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:20:45.668924 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-603a1f6e-3091-476e-b295-0f16398ec48c tempest-TestMinimumBasicScenario-420461111 tempest-TestMinimumBasicScenario-420461111-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:20:45.669728 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-603a1f6e-3091-476e-b295-0f16398ec48c tempest-TestMinimumBasicScenario-420461111 tempest-TestMinimumBasicScenario-420461111-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:20:45.760976 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-de025fc3-888f-4f56-baf2-f1112567b7b9 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1877323081", "imageRef": "b585ffbc-6a36-48c9-81b3-e26f9bd0fcba", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ad10d048-5630-46ff-a3f3-4c2a7f3aa1a7"}], "security_groups": [{"name": "tempest-securitygroup--1079860977"}], "key_name": "tempest-keypair-1779637703", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 16:20:45.885657 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.network.neutron [None req-de025fc3-888f-4f56-baf2-f1112567b7b9 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] validate_networks() for [('ad10d048-5630-46ff-a3f3-4c2a7f3aa1a7', None, None, None, None, None)] {{(pid=122225) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Oct 27 16:20:45.909036 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-603a1f6e-3091-476e-b295-0f16398ec48c tempest-TestMinimumBasicScenario-420461111 tempest-TestMinimumBasicScenario-420461111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906ea7817e7b4ca9a240e2c15220e79b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f6eb1316874ed48d552488e289db7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 16:20:45.928183 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-603a1f6e-3091-476e-b295-0f16398ec48c tempest-TestMinimumBasicScenario-420461111 tempest-TestMinimumBasicScenario-420461111-project] 10.222.0.64 "GET /compute/v2.1/servers/a4e12070-1613-4a12-9f73-f4e7f40fc3f3" status: 200 len: 1758 microversion: 2.1 time: 0.282362 Oct 27 16:20:45.929266 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 1088/2097] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 16:20:45 2021] GET /compute/v2.1/servers/a4e12070-1613-4a12-9f73-f4e7f40fc3f3 => generated 1758 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 16:20:46.371107 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.virt.hardware [None req-de025fc3-888f-4f56-baf2-f1112567b7b9 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Flavor limits 0:0:0 {{(pid=122225) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 16:20:46.371894 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.virt.hardware [None req-de025fc3-888f-4f56-baf2-f1112567b7b9 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Image limits 0:0:0 {{(pid=122225) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 16:20:46.372800 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.virt.hardware [None req-de025fc3-888f-4f56-baf2-f1112567b7b9 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Flavor pref 0:0:0 {{(pid=122225) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 16:20:46.373529 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.virt.hardware [None req-de025fc3-888f-4f56-baf2-f1112567b7b9 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Image pref 0:0:0 {{(pid=122225) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 16:20:46.374286 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.virt.hardware [None req-de025fc3-888f-4f56-baf2-f1112567b7b9 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122225) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 16:20:46.390747 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-de025fc3-888f-4f56-baf2-f1112567b7b9 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:20:46.391544 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-de025fc3-888f-4f56-baf2-f1112567b7b9 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:20:46.393084 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-de025fc3-888f-4f56-baf2-f1112567b7b9 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:20:46.393889 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-de025fc3-888f-4f56-baf2-f1112567b7b9 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:20:46.428517 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.quota [None req-de025fc3-888f-4f56-baf2-f1112567b7b9 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Getting quotas for project 0ac26dbbef464ff198b60547a106ce2a. Resources: {'ram', 'instances', 'cores'} {{(pid=122225) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 27 16:20:46.436685 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.quota [None req-de025fc3-888f-4f56-baf2-f1112567b7b9 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Getting quotas for user d24c0e6b236d435bacfb99467b03254d and project 0ac26dbbef464ff198b60547a106ce2a. Resources: {'ram', 'instances', 'cores'} {{(pid=122225) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 27 16:20:46.459323 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-de025fc3-888f-4f56-baf2-f1112567b7b9 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Going to run 1 instances... {{(pid=122225) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Oct 27 16:20:46.464191 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-de025fc3-888f-4f56-baf2-f1112567b7b9 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] [instance: a76bfa58-eb74-49eb-84c5-52c49e394195] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b585ffbc-6a36-48c9-81b3-e26f9bd0fcba',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122225) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Oct 27 16:20:46.560615 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-de025fc3-888f-4f56-baf2-f1112567b7b9 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.803627 Oct 27 16:20:46.562268 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 1010/2098] 10.222.0.64 () {60 vars in 1146 bytes} [Wed Oct 27 16:20:45 2021] POST /compute/v2.1/servers => generated 402 bytes in 807 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 27 16:20:46.580668 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-a27db7bf-bfc3-4556-92f7-4177cea7a22b tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:20:46.582417 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-a27db7bf-bfc3-4556-92f7-4177cea7a22b tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] [instance: a76bfa58-eb74-49eb-84c5-52c49e394195] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:20:46.684193 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-a27db7bf-bfc3-4556-92f7-4177cea7a22b tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd24c0e6b236d435bacfb99467b03254d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac26dbbef464ff198b60547a106ce2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 16:20:46.695140 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-a27db7bf-bfc3-4556-92f7-4177cea7a22b tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] 10.222.0.64 "GET /compute/v2.1/servers/a76bfa58-eb74-49eb-84c5-52c49e394195" status: 200 len: 1238 microversion: 2.1 time: 0.122128 Oct 27 16:20:46.695915 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 1089/2099] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 16:20:46 2021] GET /compute/v2.1/servers/a76bfa58-eb74-49eb-84c5-52c49e394195 => generated 1238 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 16:20:46.959104 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-92386686-e0c1-4ec0-8952-06024fe002e1 tempest-TestMinimumBasicScenario-420461111 tempest-TestMinimumBasicScenario-420461111-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:20:46.959752 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-92386686-e0c1-4ec0-8952-06024fe002e1 tempest-TestMinimumBasicScenario-420461111 tempest-TestMinimumBasicScenario-420461111-project] [instance: a4e12070-1613-4a12-9f73-f4e7f40fc3f3] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:20:46.966045 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-92386686-e0c1-4ec0-8952-06024fe002e1 tempest-TestMinimumBasicScenario-420461111 tempest-TestMinimumBasicScenario-420461111-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:20:46.966497 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-92386686-e0c1-4ec0-8952-06024fe002e1 tempest-TestMinimumBasicScenario-420461111 tempest-TestMinimumBasicScenario-420461111-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:20:46.967977 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-92386686-e0c1-4ec0-8952-06024fe002e1 tempest-TestMinimumBasicScenario-420461111 tempest-TestMinimumBasicScenario-420461111-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:20:46.968523 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-92386686-e0c1-4ec0-8952-06024fe002e1 tempest-TestMinimumBasicScenario-420461111 tempest-TestMinimumBasicScenario-420461111-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:20:47.125322 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-92386686-e0c1-4ec0-8952-06024fe002e1 tempest-TestMinimumBasicScenario-420461111 tempest-TestMinimumBasicScenario-420461111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906ea7817e7b4ca9a240e2c15220e79b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f6eb1316874ed48d552488e289db7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 16:20:47.135007 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-92386686-e0c1-4ec0-8952-06024fe002e1 tempest-TestMinimumBasicScenario-420461111 tempest-TestMinimumBasicScenario-420461111-project] 10.222.0.64 "GET /compute/v2.1/servers/a4e12070-1613-4a12-9f73-f4e7f40fc3f3" status: 200 len: 1758 microversion: 2.1 time: 0.181067 Oct 27 16:20:47.135600 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 1011/2100] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 16:20:46 2021] GET /compute/v2.1/servers/a4e12070-1613-4a12-9f73-f4e7f40fc3f3 => generated 1758 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 16:20:47.719929 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-474cee1d-f473-482c-ad8b-c243fafcdc94 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:20:47.721276 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-474cee1d-f473-482c-ad8b-c243fafcdc94 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] [instance: a76bfa58-eb74-49eb-84c5-52c49e394195] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:20:47.733462 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-474cee1d-f473-482c-ad8b-c243fafcdc94 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:20:47.734769 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-474cee1d-f473-482c-ad8b-c243fafcdc94 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:20:47.736454 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-474cee1d-f473-482c-ad8b-c243fafcdc94 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:20:47.737318 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-474cee1d-f473-482c-ad8b-c243fafcdc94 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:20:47.840682 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-474cee1d-f473-482c-ad8b-c243fafcdc94 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd24c0e6b236d435bacfb99467b03254d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac26dbbef464ff198b60547a106ce2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 16:20:47.855658 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-474cee1d-f473-482c-ad8b-c243fafcdc94 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] 10.222.0.64 "GET /compute/v2.1/servers/a76bfa58-eb74-49eb-84c5-52c49e394195" status: 200 len: 1298 microversion: 2.1 time: 0.142294 Oct 27 16:20:47.856308 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 1090/2101] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 16:20:47 2021] GET /compute/v2.1/servers/a76bfa58-eb74-49eb-84c5-52c49e394195 => generated 1298 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 16:20:48.154362 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-ae10424f-0691-40bd-9e39-00c6ca932914 tempest-TestMinimumBasicScenario-420461111 tempest-TestMinimumBasicScenario-420461111-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:20:48.155524 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-ae10424f-0691-40bd-9e39-00c6ca932914 tempest-TestMinimumBasicScenario-420461111 tempest-TestMinimumBasicScenario-420461111-project] [instance: a4e12070-1613-4a12-9f73-f4e7f40fc3f3] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:20:48.162348 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-ae10424f-0691-40bd-9e39-00c6ca932914 tempest-TestMinimumBasicScenario-420461111 tempest-TestMinimumBasicScenario-420461111-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:20:48.162792 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-ae10424f-0691-40bd-9e39-00c6ca932914 tempest-TestMinimumBasicScenario-420461111 tempest-TestMinimumBasicScenario-420461111-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:20:48.163589 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-ae10424f-0691-40bd-9e39-00c6ca932914 tempest-TestMinimumBasicScenario-420461111 tempest-TestMinimumBasicScenario-420461111-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:20:48.164067 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-ae10424f-0691-40bd-9e39-00c6ca932914 tempest-TestMinimumBasicScenario-420461111 tempest-TestMinimumBasicScenario-420461111-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:20:48.473312 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-ae10424f-0691-40bd-9e39-00c6ca932914 tempest-TestMinimumBasicScenario-420461111 tempest-TestMinimumBasicScenario-420461111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906ea7817e7b4ca9a240e2c15220e79b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f6eb1316874ed48d552488e289db7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 16:20:48.482109 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-ae10424f-0691-40bd-9e39-00c6ca932914 tempest-TestMinimumBasicScenario-420461111 tempest-TestMinimumBasicScenario-420461111-project] 10.222.0.64 "GET /compute/v2.1/servers/a4e12070-1613-4a12-9f73-f4e7f40fc3f3" status: 200 len: 1758 microversion: 2.1 time: 0.331399 Oct 27 16:20:48.482957 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 1012/2102] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 16:20:48 2021] GET /compute/v2.1/servers/a4e12070-1613-4a12-9f73-f4e7f40fc3f3 => generated 1758 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 16:20:48.880256 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-9e0b1a26-5553-4055-ad22-5d44db10e312 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:20:48.882278 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-9e0b1a26-5553-4055-ad22-5d44db10e312 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] [instance: a76bfa58-eb74-49eb-84c5-52c49e394195] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:20:48.901639 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-9e0b1a26-5553-4055-ad22-5d44db10e312 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:20:48.902651 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-9e0b1a26-5553-4055-ad22-5d44db10e312 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:20:48.904302 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-9e0b1a26-5553-4055-ad22-5d44db10e312 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:20:48.906017 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-9e0b1a26-5553-4055-ad22-5d44db10e312 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:20:49.113676 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-9e0b1a26-5553-4055-ad22-5d44db10e312 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd24c0e6b236d435bacfb99467b03254d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac26dbbef464ff198b60547a106ce2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 16:20:49.122708 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-9e0b1a26-5553-4055-ad22-5d44db10e312 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] 10.222.0.64 "GET /compute/v2.1/servers/a76bfa58-eb74-49eb-84c5-52c49e394195" status: 200 len: 1364 microversion: 2.1 time: 0.250046 Oct 27 16:20:49.123834 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 1091/2103] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 16:20:48 2021] GET /compute/v2.1/servers/a76bfa58-eb74-49eb-84c5-52c49e394195 => generated 1364 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 16:20:49.505339 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-54bfbcb6-bef8-4ee1-b76e-12d71681175e tempest-TestMinimumBasicScenario-420461111 tempest-TestMinimumBasicScenario-420461111-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:20:49.507174 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-54bfbcb6-bef8-4ee1-b76e-12d71681175e tempest-TestMinimumBasicScenario-420461111 tempest-TestMinimumBasicScenario-420461111-project] [instance: a4e12070-1613-4a12-9f73-f4e7f40fc3f3] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:20:49.519686 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-54bfbcb6-bef8-4ee1-b76e-12d71681175e tempest-TestMinimumBasicScenario-420461111 tempest-TestMinimumBasicScenario-420461111-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:20:49.520439 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-54bfbcb6-bef8-4ee1-b76e-12d71681175e tempest-TestMinimumBasicScenario-420461111 tempest-TestMinimumBasicScenario-420461111-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:20:49.521670 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-54bfbcb6-bef8-4ee1-b76e-12d71681175e tempest-TestMinimumBasicScenario-420461111 tempest-TestMinimumBasicScenario-420461111-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:20:49.522296 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-54bfbcb6-bef8-4ee1-b76e-12d71681175e tempest-TestMinimumBasicScenario-420461111 tempest-TestMinimumBasicScenario-420461111-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:20:49.893827 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [req-9bc5cc2a-a952-4b5e-9d4f-60718a602234 req-2bdac9a4-f93f-4eff-af0d-f325479e9dec service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a76bfa58-eb74-49eb-84c5-52c49e394195", "tag": "87df4a9d-9913-463b-9005-dddacaa1d71a"}]} {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 16:20:49.898590 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 27 16:20:49.898590 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: warnings.warn(msg) Oct 27 16:20:49.911759 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-54bfbcb6-bef8-4ee1-b76e-12d71681175e tempest-TestMinimumBasicScenario-420461111 tempest-TestMinimumBasicScenario-420461111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906ea7817e7b4ca9a240e2c15220e79b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f6eb1316874ed48d552488e289db7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 16:20:49.921473 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [req-9bc5cc2a-a952-4b5e-9d4f-60718a602234 req-2bdac9a4-f93f-4eff-af0d-f325479e9dec service nova] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:20:49.921936 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [req-9bc5cc2a-a952-4b5e-9d4f-60718a602234 req-2bdac9a4-f93f-4eff-af0d-f325479e9dec service nova] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:20:49.925299 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-54bfbcb6-bef8-4ee1-b76e-12d71681175e tempest-TestMinimumBasicScenario-420461111 tempest-TestMinimumBasicScenario-420461111-project] 10.222.0.64 "GET /compute/v2.1/servers/a4e12070-1613-4a12-9f73-f4e7f40fc3f3" status: 200 len: 1758 microversion: 2.1 time: 0.428128 Oct 27 16:20:49.926029 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 1013/2104] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 16:20:49 2021] GET /compute/v2.1/servers/a4e12070-1613-4a12-9f73-f4e7f40fc3f3 => generated 1758 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 16:20:49.940191 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.compute.server_external_events [req-9bc5cc2a-a952-4b5e-9d4f-60718a602234 req-2bdac9a4-f93f-4eff-af0d-f325479e9dec service nova] Creating event network-changed:87df4a9d-9913-463b-9005-dddacaa1d71a for instance a76bfa58-eb74-49eb-84c5-52c49e394195 on hv-cinder-80070 Oct 27 16:20:49.950830 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [req-9bc5cc2a-a952-4b5e-9d4f-60718a602234 req-2bdac9a4-f93f-4eff-af0d-f325479e9dec service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069753 Oct 27 16:20:49.955082 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 1092/2105] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Oct 27 16:20:49 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 16:20:50.148836 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-88ea9815-5148-4ead-87e4-0832e40558e6 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:20:50.149668 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-88ea9815-5148-4ead-87e4-0832e40558e6 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] [instance: a76bfa58-eb74-49eb-84c5-52c49e394195] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:20:50.156982 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-88ea9815-5148-4ead-87e4-0832e40558e6 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:20:50.157425 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-88ea9815-5148-4ead-87e4-0832e40558e6 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:20:50.158264 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-88ea9815-5148-4ead-87e4-0832e40558e6 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:20:50.158703 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-88ea9815-5148-4ead-87e4-0832e40558e6 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:20:50.420051 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-88ea9815-5148-4ead-87e4-0832e40558e6 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd24c0e6b236d435bacfb99467b03254d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac26dbbef464ff198b60547a106ce2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 16:20:50.433643 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-88ea9815-5148-4ead-87e4-0832e40558e6 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] 10.222.0.64 "GET /compute/v2.1/servers/a76bfa58-eb74-49eb-84c5-52c49e394195" status: 200 len: 1364 microversion: 2.1 time: 0.289093 Oct 27 16:20:50.434724 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 1014/2106] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 16:20:50 2021] GET /compute/v2.1/servers/a76bfa58-eb74-49eb-84c5-52c49e394195 => generated 1364 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 16:20:50.956753 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-bdcbbdcc-8ce2-400a-a760-c205dbdaf9b2 tempest-TestMinimumBasicScenario-420461111 tempest-TestMinimumBasicScenario-420461111-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:20:50.957632 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-bdcbbdcc-8ce2-400a-a760-c205dbdaf9b2 tempest-TestMinimumBasicScenario-420461111 tempest-TestMinimumBasicScenario-420461111-project] [instance: a4e12070-1613-4a12-9f73-f4e7f40fc3f3] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:20:50.969591 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-bdcbbdcc-8ce2-400a-a760-c205dbdaf9b2 tempest-TestMinimumBasicScenario-420461111 tempest-TestMinimumBasicScenario-420461111-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:20:50.970417 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-bdcbbdcc-8ce2-400a-a760-c205dbdaf9b2 tempest-TestMinimumBasicScenario-420461111 tempest-TestMinimumBasicScenario-420461111-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:20:50.971902 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-bdcbbdcc-8ce2-400a-a760-c205dbdaf9b2 tempest-TestMinimumBasicScenario-420461111 tempest-TestMinimumBasicScenario-420461111-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:20:50.972710 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-bdcbbdcc-8ce2-400a-a760-c205dbdaf9b2 tempest-TestMinimumBasicScenario-420461111 tempest-TestMinimumBasicScenario-420461111-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:20:51.195629 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-bdcbbdcc-8ce2-400a-a760-c205dbdaf9b2 tempest-TestMinimumBasicScenario-420461111 tempest-TestMinimumBasicScenario-420461111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906ea7817e7b4ca9a240e2c15220e79b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f6eb1316874ed48d552488e289db7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 16:20:51.209765 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-bdcbbdcc-8ce2-400a-a760-c205dbdaf9b2 tempest-TestMinimumBasicScenario-420461111 tempest-TestMinimumBasicScenario-420461111-project] 10.222.0.64 "GET /compute/v2.1/servers/a4e12070-1613-4a12-9f73-f4e7f40fc3f3" status: 200 len: 1758 microversion: 2.1 time: 0.259758 Oct 27 16:20:51.210805 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 1093/2107] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 16:20:50 2021] GET /compute/v2.1/servers/a4e12070-1613-4a12-9f73-f4e7f40fc3f3 => generated 1758 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 16:20:51.461703 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-7f6750af-1030-4779-88a5-be146b7a6bd5 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:20:51.462683 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-7f6750af-1030-4779-88a5-be146b7a6bd5 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] [instance: a76bfa58-eb74-49eb-84c5-52c49e394195] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:20:51.471553 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-7f6750af-1030-4779-88a5-be146b7a6bd5 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:20:51.472071 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-7f6750af-1030-4779-88a5-be146b7a6bd5 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:20:51.472883 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-7f6750af-1030-4779-88a5-be146b7a6bd5 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:20:51.473322 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-7f6750af-1030-4779-88a5-be146b7a6bd5 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:20:51.666114 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-7f6750af-1030-4779-88a5-be146b7a6bd5 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd24c0e6b236d435bacfb99467b03254d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac26dbbef464ff198b60547a106ce2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 16:20:51.675557 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-7f6750af-1030-4779-88a5-be146b7a6bd5 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] 10.222.0.64 "GET /compute/v2.1/servers/a76bfa58-eb74-49eb-84c5-52c49e394195" status: 200 len: 1364 microversion: 2.1 time: 0.218019 Oct 27 16:20:51.676377 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 1015/2108] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 16:20:51 2021] GET /compute/v2.1/servers/a76bfa58-eb74-49eb-84c5-52c49e394195 => generated 1364 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 16:20:52.228025 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-8e9ff7d9-ff78-4a78-82b9-807e8bc03b69 tempest-TestMinimumBasicScenario-420461111 tempest-TestMinimumBasicScenario-420461111-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:20:52.228871 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-8e9ff7d9-ff78-4a78-82b9-807e8bc03b69 tempest-TestMinimumBasicScenario-420461111 tempest-TestMinimumBasicScenario-420461111-project] [instance: a4e12070-1613-4a12-9f73-f4e7f40fc3f3] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:20:52.237205 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-8e9ff7d9-ff78-4a78-82b9-807e8bc03b69 tempest-TestMinimumBasicScenario-420461111 tempest-TestMinimumBasicScenario-420461111-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:20:52.237649 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-8e9ff7d9-ff78-4a78-82b9-807e8bc03b69 tempest-TestMinimumBasicScenario-420461111 tempest-TestMinimumBasicScenario-420461111-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:20:52.238480 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-8e9ff7d9-ff78-4a78-82b9-807e8bc03b69 tempest-TestMinimumBasicScenario-420461111 tempest-TestMinimumBasicScenario-420461111-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:20:52.238918 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-8e9ff7d9-ff78-4a78-82b9-807e8bc03b69 tempest-TestMinimumBasicScenario-420461111 tempest-TestMinimumBasicScenario-420461111-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:20:52.400981 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-8e9ff7d9-ff78-4a78-82b9-807e8bc03b69 tempest-TestMinimumBasicScenario-420461111 tempest-TestMinimumBasicScenario-420461111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906ea7817e7b4ca9a240e2c15220e79b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f6eb1316874ed48d552488e289db7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 16:20:52.416316 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-8e9ff7d9-ff78-4a78-82b9-807e8bc03b69 tempest-TestMinimumBasicScenario-420461111 tempest-TestMinimumBasicScenario-420461111-project] 10.222.0.64 "GET /compute/v2.1/servers/a4e12070-1613-4a12-9f73-f4e7f40fc3f3" status: 200 len: 1758 microversion: 2.1 time: 0.191466 Oct 27 16:20:52.417377 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 1094/2109] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 16:20:52 2021] GET /compute/v2.1/servers/a4e12070-1613-4a12-9f73-f4e7f40fc3f3 => generated 1758 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 16:20:52.693678 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-41fd287f-b6e9-4633-8871-f7be2b4a356b tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:20:52.694325 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-41fd287f-b6e9-4633-8871-f7be2b4a356b tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] [instance: a76bfa58-eb74-49eb-84c5-52c49e394195] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:20:52.701537 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-41fd287f-b6e9-4633-8871-f7be2b4a356b tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:20:52.701981 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-41fd287f-b6e9-4633-8871-f7be2b4a356b tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:20:52.702775 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-41fd287f-b6e9-4633-8871-f7be2b4a356b tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:20:52.703210 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-41fd287f-b6e9-4633-8871-f7be2b4a356b tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:20:52.859611 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-41fd287f-b6e9-4633-8871-f7be2b4a356b tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd24c0e6b236d435bacfb99467b03254d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac26dbbef464ff198b60547a106ce2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 16:20:52.867585 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-41fd287f-b6e9-4633-8871-f7be2b4a356b tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] 10.222.0.64 "GET /compute/v2.1/servers/a76bfa58-eb74-49eb-84c5-52c49e394195" status: 200 len: 1364 microversion: 2.1 time: 0.177873 Oct 27 16:20:52.868282 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 1016/2110] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 16:20:52 2021] GET /compute/v2.1/servers/a76bfa58-eb74-49eb-84c5-52c49e394195 => generated 1364 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 16:20:53.440569 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-e4d3dffe-637c-4089-8f1a-3753a3b06507 tempest-TestMinimumBasicScenario-420461111 tempest-TestMinimumBasicScenario-420461111-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:20:53.441565 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-e4d3dffe-637c-4089-8f1a-3753a3b06507 tempest-TestMinimumBasicScenario-420461111 tempest-TestMinimumBasicScenario-420461111-project] [instance: a4e12070-1613-4a12-9f73-f4e7f40fc3f3] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:20:53.452285 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-e4d3dffe-637c-4089-8f1a-3753a3b06507 tempest-TestMinimumBasicScenario-420461111 tempest-TestMinimumBasicScenario-420461111-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:20:53.453094 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-e4d3dffe-637c-4089-8f1a-3753a3b06507 tempest-TestMinimumBasicScenario-420461111 tempest-TestMinimumBasicScenario-420461111-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:20:53.454484 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-e4d3dffe-637c-4089-8f1a-3753a3b06507 tempest-TestMinimumBasicScenario-420461111 tempest-TestMinimumBasicScenario-420461111-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:20:53.455291 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-e4d3dffe-637c-4089-8f1a-3753a3b06507 tempest-TestMinimumBasicScenario-420461111 tempest-TestMinimumBasicScenario-420461111-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:20:53.661660 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-e4d3dffe-637c-4089-8f1a-3753a3b06507 tempest-TestMinimumBasicScenario-420461111 tempest-TestMinimumBasicScenario-420461111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906ea7817e7b4ca9a240e2c15220e79b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f6eb1316874ed48d552488e289db7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 16:20:53.676989 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-e4d3dffe-637c-4089-8f1a-3753a3b06507 tempest-TestMinimumBasicScenario-420461111 tempest-TestMinimumBasicScenario-420461111-project] 10.222.0.64 "GET /compute/v2.1/servers/a4e12070-1613-4a12-9f73-f4e7f40fc3f3" status: 200 len: 1758 microversion: 2.1 time: 0.240693 Oct 27 16:20:53.677623 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 1095/2111] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 16:20:53 2021] GET /compute/v2.1/servers/a4e12070-1613-4a12-9f73-f4e7f40fc3f3 => generated 1758 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 16:20:53.885969 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-12f9a8d6-0c0d-446c-8380-def425663e9a tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:20:53.887075 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-12f9a8d6-0c0d-446c-8380-def425663e9a tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] [instance: a76bfa58-eb74-49eb-84c5-52c49e394195] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:20:53.900240 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-12f9a8d6-0c0d-446c-8380-def425663e9a tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:20:53.901039 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-12f9a8d6-0c0d-446c-8380-def425663e9a tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:20:53.902483 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-12f9a8d6-0c0d-446c-8380-def425663e9a tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:20:53.903278 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-12f9a8d6-0c0d-446c-8380-def425663e9a tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:20:54.077589 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-12f9a8d6-0c0d-446c-8380-def425663e9a tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd24c0e6b236d435bacfb99467b03254d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac26dbbef464ff198b60547a106ce2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 16:20:54.088593 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-12f9a8d6-0c0d-446c-8380-def425663e9a tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] 10.222.0.64 "GET /compute/v2.1/servers/a76bfa58-eb74-49eb-84c5-52c49e394195" status: 200 len: 1364 microversion: 2.1 time: 0.206715 Oct 27 16:20:54.089369 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 1017/2112] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 16:20:53 2021] GET /compute/v2.1/servers/a76bfa58-eb74-49eb-84c5-52c49e394195 => generated 1364 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 16:20:54.709482 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-3ced1529-cbff-4f2c-a6b3-2213398ca424 tempest-TestMinimumBasicScenario-420461111 tempest-TestMinimumBasicScenario-420461111-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:20:54.710614 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-3ced1529-cbff-4f2c-a6b3-2213398ca424 tempest-TestMinimumBasicScenario-420461111 tempest-TestMinimumBasicScenario-420461111-project] [instance: a4e12070-1613-4a12-9f73-f4e7f40fc3f3] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:20:54.722885 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-3ced1529-cbff-4f2c-a6b3-2213398ca424 tempest-TestMinimumBasicScenario-420461111 tempest-TestMinimumBasicScenario-420461111-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:20:54.723636 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-3ced1529-cbff-4f2c-a6b3-2213398ca424 tempest-TestMinimumBasicScenario-420461111 tempest-TestMinimumBasicScenario-420461111-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:20:54.724699 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-3ced1529-cbff-4f2c-a6b3-2213398ca424 tempest-TestMinimumBasicScenario-420461111 tempest-TestMinimumBasicScenario-420461111-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:20:54.725208 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-3ced1529-cbff-4f2c-a6b3-2213398ca424 tempest-TestMinimumBasicScenario-420461111 tempest-TestMinimumBasicScenario-420461111-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:20:54.894459 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-3ced1529-cbff-4f2c-a6b3-2213398ca424 tempest-TestMinimumBasicScenario-420461111 tempest-TestMinimumBasicScenario-420461111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906ea7817e7b4ca9a240e2c15220e79b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f6eb1316874ed48d552488e289db7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 16:20:54.902823 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-3ced1529-cbff-4f2c-a6b3-2213398ca424 tempest-TestMinimumBasicScenario-420461111 tempest-TestMinimumBasicScenario-420461111-project] 10.222.0.64 "GET /compute/v2.1/servers/a4e12070-1613-4a12-9f73-f4e7f40fc3f3" status: 200 len: 1758 microversion: 2.1 time: 0.200500 Oct 27 16:20:54.903428 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 1096/2113] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 16:20:54 2021] GET /compute/v2.1/servers/a4e12070-1613-4a12-9f73-f4e7f40fc3f3 => generated 1758 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 16:20:55.115124 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-e3e140f7-06d8-448c-afdd-b6ebf50e8f5d tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:20:55.115781 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-e3e140f7-06d8-448c-afdd-b6ebf50e8f5d tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] [instance: a76bfa58-eb74-49eb-84c5-52c49e394195] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:20:55.123076 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-e3e140f7-06d8-448c-afdd-b6ebf50e8f5d tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:20:55.123615 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-e3e140f7-06d8-448c-afdd-b6ebf50e8f5d tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:20:55.124518 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-e3e140f7-06d8-448c-afdd-b6ebf50e8f5d tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:20:55.125079 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-e3e140f7-06d8-448c-afdd-b6ebf50e8f5d tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:20:55.268384 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-e3e140f7-06d8-448c-afdd-b6ebf50e8f5d tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd24c0e6b236d435bacfb99467b03254d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac26dbbef464ff198b60547a106ce2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 16:20:55.276228 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-e3e140f7-06d8-448c-afdd-b6ebf50e8f5d tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] 10.222.0.64 "GET /compute/v2.1/servers/a76bfa58-eb74-49eb-84c5-52c49e394195" status: 200 len: 1364 microversion: 2.1 time: 0.165235 Oct 27 16:20:55.276818 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 1018/2114] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 16:20:55 2021] GET /compute/v2.1/servers/a76bfa58-eb74-49eb-84c5-52c49e394195 => generated 1364 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 16:20:55.813812 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [req-496d02e7-f69f-48cc-9e09-9550f04f8458 req-ade1e469-4958-43b7-96bf-dba602da1286 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a76bfa58-eb74-49eb-84c5-52c49e394195", "name": "network-vif-plugged", "status": "completed", "tag": "87df4a9d-9913-463b-9005-dddacaa1d71a"}]} {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 16:20:55.815492 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 27 16:20:55.815492 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: warnings.warn(msg) Oct 27 16:20:55.823620 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [req-496d02e7-f69f-48cc-9e09-9550f04f8458 req-ade1e469-4958-43b7-96bf-dba602da1286 service nova] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:20:55.824118 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [req-496d02e7-f69f-48cc-9e09-9550f04f8458 req-ade1e469-4958-43b7-96bf-dba602da1286 service nova] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:20:55.839828 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.compute.server_external_events [req-496d02e7-f69f-48cc-9e09-9550f04f8458 req-ade1e469-4958-43b7-96bf-dba602da1286 service nova] Creating event network-vif-plugged:87df4a9d-9913-463b-9005-dddacaa1d71a for instance a76bfa58-eb74-49eb-84c5-52c49e394195 on hv-cinder-80070 Oct 27 16:20:55.845910 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [req-496d02e7-f69f-48cc-9e09-9550f04f8458 req-ade1e469-4958-43b7-96bf-dba602da1286 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037619 Oct 27 16:20:55.846526 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 1097/2115] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Oct 27 16:20:55 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 16:20:55.925739 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-3fb7c6a8-0b84-4265-8853-ca067abd4877 tempest-TestMinimumBasicScenario-420461111 tempest-TestMinimumBasicScenario-420461111-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:20:55.926682 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-3fb7c6a8-0b84-4265-8853-ca067abd4877 tempest-TestMinimumBasicScenario-420461111 tempest-TestMinimumBasicScenario-420461111-project] [instance: a4e12070-1613-4a12-9f73-f4e7f40fc3f3] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:20:55.934194 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-3fb7c6a8-0b84-4265-8853-ca067abd4877 tempest-TestMinimumBasicScenario-420461111 tempest-TestMinimumBasicScenario-420461111-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:20:55.934787 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-3fb7c6a8-0b84-4265-8853-ca067abd4877 tempest-TestMinimumBasicScenario-420461111 tempest-TestMinimumBasicScenario-420461111-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:20:55.936379 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-3fb7c6a8-0b84-4265-8853-ca067abd4877 tempest-TestMinimumBasicScenario-420461111 tempest-TestMinimumBasicScenario-420461111-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:20:55.937153 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-3fb7c6a8-0b84-4265-8853-ca067abd4877 tempest-TestMinimumBasicScenario-420461111 tempest-TestMinimumBasicScenario-420461111-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:20:56.143177 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-3fb7c6a8-0b84-4265-8853-ca067abd4877 tempest-TestMinimumBasicScenario-420461111 tempest-TestMinimumBasicScenario-420461111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906ea7817e7b4ca9a240e2c15220e79b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f6eb1316874ed48d552488e289db7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 16:20:56.158132 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-3fb7c6a8-0b84-4265-8853-ca067abd4877 tempest-TestMinimumBasicScenario-420461111 tempest-TestMinimumBasicScenario-420461111-project] 10.222.0.64 "GET /compute/v2.1/servers/a4e12070-1613-4a12-9f73-f4e7f40fc3f3" status: 200 len: 1761 microversion: 2.1 time: 0.238951 Oct 27 16:20:56.159298 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 1019/2116] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 16:20:55 2021] GET /compute/v2.1/servers/a4e12070-1613-4a12-9f73-f4e7f40fc3f3 => generated 1761 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 16:20:56.295338 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-ca4f4c97-de2d-43a7-91b4-eddc2c1714e1 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:20:56.296135 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-ca4f4c97-de2d-43a7-91b4-eddc2c1714e1 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] [instance: a76bfa58-eb74-49eb-84c5-52c49e394195] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:20:56.303322 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-ca4f4c97-de2d-43a7-91b4-eddc2c1714e1 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:20:56.303913 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-ca4f4c97-de2d-43a7-91b4-eddc2c1714e1 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:20:56.304826 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-ca4f4c97-de2d-43a7-91b4-eddc2c1714e1 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:20:56.305264 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-ca4f4c97-de2d-43a7-91b4-eddc2c1714e1 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:20:56.444402 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-ca4f4c97-de2d-43a7-91b4-eddc2c1714e1 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd24c0e6b236d435bacfb99467b03254d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac26dbbef464ff198b60547a106ce2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 16:20:56.453841 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-ca4f4c97-de2d-43a7-91b4-eddc2c1714e1 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] 10.222.0.64 "GET /compute/v2.1/servers/a76bfa58-eb74-49eb-84c5-52c49e394195" status: 200 len: 1364 microversion: 2.1 time: 0.162930 Oct 27 16:20:56.454435 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 1098/2117] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 16:20:56 2021] GET /compute/v2.1/servers/a76bfa58-eb74-49eb-84c5-52c49e394195 => generated 1364 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 16:20:57.476200 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-e6ddb8a8-9cf3-4a89-9b7c-03149d81d51b tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:20:57.477357 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-e6ddb8a8-9cf3-4a89-9b7c-03149d81d51b tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] [instance: a76bfa58-eb74-49eb-84c5-52c49e394195] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:20:57.491307 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-e6ddb8a8-9cf3-4a89-9b7c-03149d81d51b tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:20:57.492121 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-e6ddb8a8-9cf3-4a89-9b7c-03149d81d51b tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:20:57.493529 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-e6ddb8a8-9cf3-4a89-9b7c-03149d81d51b tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:20:57.494329 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-e6ddb8a8-9cf3-4a89-9b7c-03149d81d51b tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:20:57.654919 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-e6ddb8a8-9cf3-4a89-9b7c-03149d81d51b tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd24c0e6b236d435bacfb99467b03254d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac26dbbef464ff198b60547a106ce2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 16:20:57.663347 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-e6ddb8a8-9cf3-4a89-9b7c-03149d81d51b tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] 10.222.0.64 "GET /compute/v2.1/servers/a76bfa58-eb74-49eb-84c5-52c49e394195" status: 200 len: 1550 microversion: 2.1 time: 0.195386 Oct 27 16:20:57.663990 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 1020/2118] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 16:20:57 2021] GET /compute/v2.1/servers/a76bfa58-eb74-49eb-84c5-52c49e394195 => generated 1550 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 16:20:57.681105 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-732b13cf-e0ec-46fb-b63d-58277cd94d3a tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:20:57.681937 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-732b13cf-e0ec-46fb-b63d-58277cd94d3a tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] [instance: a76bfa58-eb74-49eb-84c5-52c49e394195] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:20:57.689751 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-732b13cf-e0ec-46fb-b63d-58277cd94d3a tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:20:57.690230 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-732b13cf-e0ec-46fb-b63d-58277cd94d3a tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:20:57.691198 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-732b13cf-e0ec-46fb-b63d-58277cd94d3a tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:20:57.691702 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-732b13cf-e0ec-46fb-b63d-58277cd94d3a tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:20:57.787530 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-732b13cf-e0ec-46fb-b63d-58277cd94d3a tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] 10.222.0.64 "GET /compute/v2.1/servers/a76bfa58-eb74-49eb-84c5-52c49e394195/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.110323 Oct 27 16:20:57.788604 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 1099/2119] 10.222.0.64 () {58 vars in 1274 bytes} [Wed Oct 27 16:20:57 2021] GET /compute/v2.1/servers/a76bfa58-eb74-49eb-84c5-52c49e394195/os-interface => generated 285 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 16:20:59.455445 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [req-a47a877b-4d9b-43ae-8a9f-e85146ba64af req-f5ad82bd-4a32-499e-a2be-1ae6bc822214 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a76bfa58-eb74-49eb-84c5-52c49e394195", "tag": "87df4a9d-9913-463b-9005-dddacaa1d71a"}]} {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 16:20:59.457041 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-92f298dd-d21d-4368-af2f-c2d58d5a7863 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 16:20:59.458216 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 27 16:20:59.458216 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: warnings.warn(msg) Oct 27 16:20:59.458580 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-92f298dd-d21d-4368-af2f-c2d58d5a7863 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] [instance: a76bfa58-eb74-49eb-84c5-52c49e394195] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:20:59.466589 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [req-a47a877b-4d9b-43ae-8a9f-e85146ba64af req-f5ad82bd-4a32-499e-a2be-1ae6bc822214 service nova] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:20:59.467106 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [req-a47a877b-4d9b-43ae-8a9f-e85146ba64af req-f5ad82bd-4a32-499e-a2be-1ae6bc822214 service nova] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:20:59.470439 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-92f298dd-d21d-4368-af2f-c2d58d5a7863 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:20:59.471231 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-92f298dd-d21d-4368-af2f-c2d58d5a7863 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:20:59.472752 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-92f298dd-d21d-4368-af2f-c2d58d5a7863 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:20:59.473466 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-92f298dd-d21d-4368-af2f-c2d58d5a7863 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:20:59.480138 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.compute.server_external_events [req-a47a877b-4d9b-43ae-8a9f-e85146ba64af req-f5ad82bd-4a32-499e-a2be-1ae6bc822214 service nova] Creating event network-changed:87df4a9d-9913-463b-9005-dddacaa1d71a for instance a76bfa58-eb74-49eb-84c5-52c49e394195 on hv-cinder-80070 Oct 27 16:20:59.485708 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [req-a47a877b-4d9b-43ae-8a9f-e85146ba64af req-f5ad82bd-4a32-499e-a2be-1ae6bc822214 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034409 Oct 27 16:20:59.486697 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 1100/2120] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Oct 27 16:20:59 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 16:20:59.552054 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-92f298dd-d21d-4368-af2f-c2d58d5a7863 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] 10.222.0.64 "POST /compute/v2.1/servers/a76bfa58-eb74-49eb-84c5-52c49e394195/action" status: 200 len: 14 microversion: 2.1 time: 0.102940 Oct 27 16:20:59.553150 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 1021/2121] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Oct 27 16:20:59 2021] POST /compute/v2.1/servers/a76bfa58-eb74-49eb-84c5-52c49e394195/action => generated 14 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 27 16:21:00.565096 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-9ff7b017-f3e4-4597-bf47-58b1896082db tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 16:21:00.566145 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-9ff7b017-f3e4-4597-bf47-58b1896082db tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] [instance: a76bfa58-eb74-49eb-84c5-52c49e394195] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:21:00.577067 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-9ff7b017-f3e4-4597-bf47-58b1896082db tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:21:00.577904 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-9ff7b017-f3e4-4597-bf47-58b1896082db tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:21:00.579375 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-9ff7b017-f3e4-4597-bf47-58b1896082db tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:21:00.580216 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-9ff7b017-f3e4-4597-bf47-58b1896082db tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:21:00.646313 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-9ff7b017-f3e4-4597-bf47-58b1896082db tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] 10.222.0.64 "POST /compute/v2.1/servers/a76bfa58-eb74-49eb-84c5-52c49e394195/action" status: 200 len: 14 microversion: 2.1 time: 0.086278 Oct 27 16:21:00.647167 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 1101/2122] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Oct 27 16:21:00 2021] POST /compute/v2.1/servers/a76bfa58-eb74-49eb-84c5-52c49e394195/action => generated 14 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 27 16:21:01.659261 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-00da0140-b58a-405a-89ba-1ede3686c85f tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 16:21:01.660397 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-00da0140-b58a-405a-89ba-1ede3686c85f tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] [instance: a76bfa58-eb74-49eb-84c5-52c49e394195] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:21:01.668019 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-00da0140-b58a-405a-89ba-1ede3686c85f tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:21:01.668477 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-00da0140-b58a-405a-89ba-1ede3686c85f tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:21:01.669277 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-00da0140-b58a-405a-89ba-1ede3686c85f tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:21:01.669745 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-00da0140-b58a-405a-89ba-1ede3686c85f tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:21:01.737624 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-00da0140-b58a-405a-89ba-1ede3686c85f tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] 10.222.0.64 "POST /compute/v2.1/servers/a76bfa58-eb74-49eb-84c5-52c49e394195/action" status: 200 len: 14 microversion: 2.1 time: 0.082606 Oct 27 16:21:01.738657 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 1022/2123] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Oct 27 16:21:01 2021] POST /compute/v2.1/servers/a76bfa58-eb74-49eb-84c5-52c49e394195/action => generated 14 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 27 16:21:02.756056 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-adfd94ce-7ff1-4834-a786-451165b2c7bf tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 16:21:02.757894 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-adfd94ce-7ff1-4834-a786-451165b2c7bf tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] [instance: a76bfa58-eb74-49eb-84c5-52c49e394195] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:21:02.771819 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-adfd94ce-7ff1-4834-a786-451165b2c7bf tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:21:02.772679 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-adfd94ce-7ff1-4834-a786-451165b2c7bf tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:21:02.774140 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-adfd94ce-7ff1-4834-a786-451165b2c7bf tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:21:02.774938 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-adfd94ce-7ff1-4834-a786-451165b2c7bf tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:21:02.864481 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-adfd94ce-7ff1-4834-a786-451165b2c7bf tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] 10.222.0.64 "POST /compute/v2.1/servers/a76bfa58-eb74-49eb-84c5-52c49e394195/action" status: 200 len: 14 microversion: 2.1 time: 0.117447 Oct 27 16:21:02.865111 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 1102/2124] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Oct 27 16:21:02 2021] POST /compute/v2.1/servers/a76bfa58-eb74-49eb-84c5-52c49e394195/action => generated 14 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 27 16:21:03.877562 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-4e5dcc57-335b-48bd-83ef-1e1cdfa83607 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 16:21:03.878894 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-4e5dcc57-335b-48bd-83ef-1e1cdfa83607 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] [instance: a76bfa58-eb74-49eb-84c5-52c49e394195] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:21:03.886586 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-4e5dcc57-335b-48bd-83ef-1e1cdfa83607 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:21:03.887021 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-4e5dcc57-335b-48bd-83ef-1e1cdfa83607 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:21:03.887818 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-4e5dcc57-335b-48bd-83ef-1e1cdfa83607 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:21:03.888798 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-4e5dcc57-335b-48bd-83ef-1e1cdfa83607 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:21:03.952605 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-4e5dcc57-335b-48bd-83ef-1e1cdfa83607 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] 10.222.0.64 "POST /compute/v2.1/servers/a76bfa58-eb74-49eb-84c5-52c49e394195/action" status: 200 len: 14 microversion: 2.1 time: 0.079339 Oct 27 16:21:03.953429 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 1023/2125] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Oct 27 16:21:03 2021] POST /compute/v2.1/servers/a76bfa58-eb74-49eb-84c5-52c49e394195/action => generated 14 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 27 16:21:04.965183 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-1cc27371-2361-4001-8a73-d5d4b43a9bef tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 16:21:04.966224 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-1cc27371-2361-4001-8a73-d5d4b43a9bef tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] [instance: a76bfa58-eb74-49eb-84c5-52c49e394195] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:21:04.974563 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-1cc27371-2361-4001-8a73-d5d4b43a9bef tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:21:04.975010 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-1cc27371-2361-4001-8a73-d5d4b43a9bef tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:21:04.975807 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-1cc27371-2361-4001-8a73-d5d4b43a9bef tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:21:04.976268 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-1cc27371-2361-4001-8a73-d5d4b43a9bef tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:21:05.043136 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-1cc27371-2361-4001-8a73-d5d4b43a9bef tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] 10.222.0.64 "POST /compute/v2.1/servers/a76bfa58-eb74-49eb-84c5-52c49e394195/action" status: 200 len: 14 microversion: 2.1 time: 0.082488 Oct 27 16:21:05.044001 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 1103/2126] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Oct 27 16:21:04 2021] POST /compute/v2.1/servers/a76bfa58-eb74-49eb-84c5-52c49e394195/action => generated 14 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 27 16:21:06.055746 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-639beae5-b4e5-454f-b65d-ac71c090b88e tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 16:21:06.056680 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-639beae5-b4e5-454f-b65d-ac71c090b88e tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] [instance: a76bfa58-eb74-49eb-84c5-52c49e394195] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:21:06.064452 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-639beae5-b4e5-454f-b65d-ac71c090b88e tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:21:06.064907 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-639beae5-b4e5-454f-b65d-ac71c090b88e tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:21:06.065718 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-639beae5-b4e5-454f-b65d-ac71c090b88e tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:21:06.066159 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-639beae5-b4e5-454f-b65d-ac71c090b88e tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:21:06.135055 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-639beae5-b4e5-454f-b65d-ac71c090b88e tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] 10.222.0.64 "POST /compute/v2.1/servers/a76bfa58-eb74-49eb-84c5-52c49e394195/action" status: 200 len: 14 microversion: 2.1 time: 0.083320 Oct 27 16:21:06.136078 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 1024/2127] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Oct 27 16:21:06 2021] POST /compute/v2.1/servers/a76bfa58-eb74-49eb-84c5-52c49e394195/action => generated 14 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 27 16:21:07.150078 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-6262e59a-8a63-4cfc-82f9-8f7b9abea7d9 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 16:21:07.151075 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-6262e59a-8a63-4cfc-82f9-8f7b9abea7d9 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] [instance: a76bfa58-eb74-49eb-84c5-52c49e394195] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:21:07.159684 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-6262e59a-8a63-4cfc-82f9-8f7b9abea7d9 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:21:07.160162 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-6262e59a-8a63-4cfc-82f9-8f7b9abea7d9 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:21:07.160960 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-6262e59a-8a63-4cfc-82f9-8f7b9abea7d9 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:21:07.161395 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-6262e59a-8a63-4cfc-82f9-8f7b9abea7d9 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:21:07.224145 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-6262e59a-8a63-4cfc-82f9-8f7b9abea7d9 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] 10.222.0.64 "POST /compute/v2.1/servers/a76bfa58-eb74-49eb-84c5-52c49e394195/action" status: 200 len: 14 microversion: 2.1 time: 0.078112 Oct 27 16:21:07.225142 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 1104/2128] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Oct 27 16:21:07 2021] POST /compute/v2.1/servers/a76bfa58-eb74-49eb-84c5-52c49e394195/action => generated 14 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 27 16:21:08.237399 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-401b4da7-1d1b-4314-854c-dc13ce2a21f3 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 16:21:08.238638 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-401b4da7-1d1b-4314-854c-dc13ce2a21f3 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] [instance: a76bfa58-eb74-49eb-84c5-52c49e394195] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:21:08.246516 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-401b4da7-1d1b-4314-854c-dc13ce2a21f3 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:21:08.247036 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-401b4da7-1d1b-4314-854c-dc13ce2a21f3 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:21:08.248201 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-401b4da7-1d1b-4314-854c-dc13ce2a21f3 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:21:08.248696 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-401b4da7-1d1b-4314-854c-dc13ce2a21f3 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:21:08.326790 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-401b4da7-1d1b-4314-854c-dc13ce2a21f3 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] 10.222.0.64 "POST /compute/v2.1/servers/a76bfa58-eb74-49eb-84c5-52c49e394195/action" status: 200 len: 14 microversion: 2.1 time: 0.095262 Oct 27 16:21:08.327708 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 1025/2129] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Oct 27 16:21:08 2021] POST /compute/v2.1/servers/a76bfa58-eb74-49eb-84c5-52c49e394195/action => generated 14 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 27 16:21:09.343073 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-35d874d2-fd81-44e9-9a79-099ec7e75577 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 16:21:09.344925 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-35d874d2-fd81-44e9-9a79-099ec7e75577 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] [instance: a76bfa58-eb74-49eb-84c5-52c49e394195] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:21:09.357004 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-35d874d2-fd81-44e9-9a79-099ec7e75577 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:21:09.357792 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-35d874d2-fd81-44e9-9a79-099ec7e75577 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:21:09.359127 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-35d874d2-fd81-44e9-9a79-099ec7e75577 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:21:09.359943 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-35d874d2-fd81-44e9-9a79-099ec7e75577 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:21:09.455191 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-35d874d2-fd81-44e9-9a79-099ec7e75577 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] 10.222.0.64 "POST /compute/v2.1/servers/a76bfa58-eb74-49eb-84c5-52c49e394195/action" status: 200 len: 15 microversion: 2.1 time: 0.119753 Oct 27 16:21:09.455979 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 1105/2130] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Oct 27 16:21:09 2021] POST /compute/v2.1/servers/a76bfa58-eb74-49eb-84c5-52c49e394195/action => generated 15 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 27 16:21:10.468203 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-3fbf5095-68e2-4e5e-98f4-4f86f6b10138 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 16:21:10.469731 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-3fbf5095-68e2-4e5e-98f4-4f86f6b10138 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] [instance: a76bfa58-eb74-49eb-84c5-52c49e394195] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:21:10.477871 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-3fbf5095-68e2-4e5e-98f4-4f86f6b10138 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:21:10.478496 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-3fbf5095-68e2-4e5e-98f4-4f86f6b10138 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:21:10.479349 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-3fbf5095-68e2-4e5e-98f4-4f86f6b10138 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:21:10.479819 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-3fbf5095-68e2-4e5e-98f4-4f86f6b10138 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:21:10.572458 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-3fbf5095-68e2-4e5e-98f4-4f86f6b10138 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] 10.222.0.64 "POST /compute/v2.1/servers/a76bfa58-eb74-49eb-84c5-52c49e394195/action" status: 200 len: 12882 microversion: 2.1 time: 0.108543 Oct 27 16:21:10.573759 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 1026/2131] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Oct 27 16:21:10 2021] POST /compute/v2.1/servers/a76bfa58-eb74-49eb-84c5-52c49e394195/action => generated 12882 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 27 16:21:11.587471 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-b7ee4cfc-1851-4869-bc40-3ead58b5f606 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 16:21:11.588596 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-b7ee4cfc-1851-4869-bc40-3ead58b5f606 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] [instance: a76bfa58-eb74-49eb-84c5-52c49e394195] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:21:11.598291 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-b7ee4cfc-1851-4869-bc40-3ead58b5f606 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:21:11.598991 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-b7ee4cfc-1851-4869-bc40-3ead58b5f606 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:21:11.600065 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-b7ee4cfc-1851-4869-bc40-3ead58b5f606 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:21:11.600597 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-b7ee4cfc-1851-4869-bc40-3ead58b5f606 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:21:11.684680 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-b7ee4cfc-1851-4869-bc40-3ead58b5f606 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] 10.222.0.64 "POST /compute/v2.1/servers/a76bfa58-eb74-49eb-84c5-52c49e394195/action" status: 200 len: 18608 microversion: 2.1 time: 0.100779 Oct 27 16:21:11.685810 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 1106/2132] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Oct 27 16:21:11 2021] POST /compute/v2.1/servers/a76bfa58-eb74-49eb-84c5-52c49e394195/action => generated 18608 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 27 16:21:12.705966 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-095e8060-82d5-44e5-a6ca-855b530c3ca6 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 16:21:12.707702 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-095e8060-82d5-44e5-a6ca-855b530c3ca6 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] [instance: a76bfa58-eb74-49eb-84c5-52c49e394195] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:21:12.720216 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-095e8060-82d5-44e5-a6ca-855b530c3ca6 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:21:12.720917 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-095e8060-82d5-44e5-a6ca-855b530c3ca6 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:21:12.722197 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-095e8060-82d5-44e5-a6ca-855b530c3ca6 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:21:12.723469 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-095e8060-82d5-44e5-a6ca-855b530c3ca6 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:21:12.827266 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-095e8060-82d5-44e5-a6ca-855b530c3ca6 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] 10.222.0.64 "POST /compute/v2.1/servers/a76bfa58-eb74-49eb-84c5-52c49e394195/action" status: 200 len: 19342 microversion: 2.1 time: 0.130065 Oct 27 16:21:12.828272 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 1027/2133] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Oct 27 16:21:12 2021] POST /compute/v2.1/servers/a76bfa58-eb74-49eb-84c5-52c49e394195/action => generated 19342 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 16:21:13.846064 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-6022c8f3-e8db-4249-a62f-384d52e1e6a7 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 16:21:13.847941 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-6022c8f3-e8db-4249-a62f-384d52e1e6a7 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] [instance: a76bfa58-eb74-49eb-84c5-52c49e394195] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:21:13.861413 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-6022c8f3-e8db-4249-a62f-384d52e1e6a7 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:21:13.862246 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-6022c8f3-e8db-4249-a62f-384d52e1e6a7 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:21:13.863683 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-6022c8f3-e8db-4249-a62f-384d52e1e6a7 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:21:13.864412 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-6022c8f3-e8db-4249-a62f-384d52e1e6a7 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:21:13.952608 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-6022c8f3-e8db-4249-a62f-384d52e1e6a7 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] 10.222.0.64 "POST /compute/v2.1/servers/a76bfa58-eb74-49eb-84c5-52c49e394195/action" status: 200 len: 21972 microversion: 2.1 time: 0.114354 Oct 27 16:21:13.953495 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 1107/2134] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Oct 27 16:21:13 2021] POST /compute/v2.1/servers/a76bfa58-eb74-49eb-84c5-52c49e394195/action => generated 21972 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 27 16:21:14.970907 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-9436eb3b-22b3-47ff-bbcd-892eee99cb33 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 16:21:14.972696 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-9436eb3b-22b3-47ff-bbcd-892eee99cb33 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] [instance: a76bfa58-eb74-49eb-84c5-52c49e394195] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:21:14.986371 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-9436eb3b-22b3-47ff-bbcd-892eee99cb33 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:21:14.987101 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-9436eb3b-22b3-47ff-bbcd-892eee99cb33 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:21:14.988575 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-9436eb3b-22b3-47ff-bbcd-892eee99cb33 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:21:14.989309 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-9436eb3b-22b3-47ff-bbcd-892eee99cb33 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:21:15.087384 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-9436eb3b-22b3-47ff-bbcd-892eee99cb33 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] 10.222.0.64 "POST /compute/v2.1/servers/a76bfa58-eb74-49eb-84c5-52c49e394195/action" status: 200 len: 23234 microversion: 2.1 time: 0.124322 Oct 27 16:21:15.088118 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 1028/2135] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Oct 27 16:21:14 2021] POST /compute/v2.1/servers/a76bfa58-eb74-49eb-84c5-52c49e394195/action => generated 23234 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 16:21:16.103540 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-a3f89620-c90a-4367-9759-c7bd2ebb7ee1 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 16:21:16.105365 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-a3f89620-c90a-4367-9759-c7bd2ebb7ee1 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] [instance: a76bfa58-eb74-49eb-84c5-52c49e394195] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:21:16.115136 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-a3f89620-c90a-4367-9759-c7bd2ebb7ee1 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:21:16.115689 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-a3f89620-c90a-4367-9759-c7bd2ebb7ee1 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:21:16.116597 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-a3f89620-c90a-4367-9759-c7bd2ebb7ee1 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:21:16.117179 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-a3f89620-c90a-4367-9759-c7bd2ebb7ee1 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:21:16.212204 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-a3f89620-c90a-4367-9759-c7bd2ebb7ee1 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] 10.222.0.64 "POST /compute/v2.1/servers/a76bfa58-eb74-49eb-84c5-52c49e394195/action" status: 200 len: 24453 microversion: 2.1 time: 0.114795 Oct 27 16:21:16.213393 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 1108/2136] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Oct 27 16:21:16 2021] POST /compute/v2.1/servers/a76bfa58-eb74-49eb-84c5-52c49e394195/action => generated 24453 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 16:21:17.230220 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-8ba96b77-cdb6-4cb7-95a3-b43d3a2700cf tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 16:21:17.231899 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-8ba96b77-cdb6-4cb7-95a3-b43d3a2700cf tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] [instance: a76bfa58-eb74-49eb-84c5-52c49e394195] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:21:17.240939 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-8ba96b77-cdb6-4cb7-95a3-b43d3a2700cf tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:21:17.241384 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-8ba96b77-cdb6-4cb7-95a3-b43d3a2700cf tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:21:17.242189 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-8ba96b77-cdb6-4cb7-95a3-b43d3a2700cf tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:21:17.242622 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-8ba96b77-cdb6-4cb7-95a3-b43d3a2700cf tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:21:17.332541 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-8ba96b77-cdb6-4cb7-95a3-b43d3a2700cf tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] 10.222.0.64 "POST /compute/v2.1/servers/a76bfa58-eb74-49eb-84c5-52c49e394195/action" status: 200 len: 25922 microversion: 2.1 time: 0.107422 Oct 27 16:21:17.333733 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 1029/2137] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Oct 27 16:21:17 2021] POST /compute/v2.1/servers/a76bfa58-eb74-49eb-84c5-52c49e394195/action => generated 25922 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 16:21:18.349411 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-6f6bc85b-9f81-4f9e-bccb-70ce98f00b1e tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 16:21:18.350544 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-6f6bc85b-9f81-4f9e-bccb-70ce98f00b1e tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] [instance: a76bfa58-eb74-49eb-84c5-52c49e394195] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:21:18.359313 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-6f6bc85b-9f81-4f9e-bccb-70ce98f00b1e tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:21:18.359808 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-6f6bc85b-9f81-4f9e-bccb-70ce98f00b1e tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:21:18.360699 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-6f6bc85b-9f81-4f9e-bccb-70ce98f00b1e tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:21:18.361239 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-6f6bc85b-9f81-4f9e-bccb-70ce98f00b1e tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:21:18.449508 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-6f6bc85b-9f81-4f9e-bccb-70ce98f00b1e tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] 10.222.0.64 "POST /compute/v2.1/servers/a76bfa58-eb74-49eb-84c5-52c49e394195/action" status: 200 len: 27101 microversion: 2.1 time: 0.104807 Oct 27 16:21:18.450488 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 1109/2138] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Oct 27 16:21:18 2021] POST /compute/v2.1/servers/a76bfa58-eb74-49eb-84c5-52c49e394195/action => generated 27101 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 16:21:19.465824 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-1fdc93bb-0671-4a0c-a21c-619366e80f5d tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 16:21:19.467526 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-1fdc93bb-0671-4a0c-a21c-619366e80f5d tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] [instance: a76bfa58-eb74-49eb-84c5-52c49e394195] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:21:19.475830 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-1fdc93bb-0671-4a0c-a21c-619366e80f5d tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:21:19.476377 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-1fdc93bb-0671-4a0c-a21c-619366e80f5d tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:21:19.477321 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-1fdc93bb-0671-4a0c-a21c-619366e80f5d tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:21:19.477863 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-1fdc93bb-0671-4a0c-a21c-619366e80f5d tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:21:19.573417 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-1fdc93bb-0671-4a0c-a21c-619366e80f5d tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] 10.222.0.64 "POST /compute/v2.1/servers/a76bfa58-eb74-49eb-84c5-52c49e394195/action" status: 200 len: 27692 microversion: 2.1 time: 0.113840 Oct 27 16:21:19.574450 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 1030/2139] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Oct 27 16:21:19 2021] POST /compute/v2.1/servers/a76bfa58-eb74-49eb-84c5-52c49e394195/action => generated 27692 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 16:21:20.588066 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-25d10fa2-a986-4c3a-be9e-e63c8b89b078 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 16:21:20.589137 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-25d10fa2-a986-4c3a-be9e-e63c8b89b078 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] [instance: a76bfa58-eb74-49eb-84c5-52c49e394195] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:21:20.598080 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-25d10fa2-a986-4c3a-be9e-e63c8b89b078 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:21:20.598699 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-25d10fa2-a986-4c3a-be9e-e63c8b89b078 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:21:20.599956 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-25d10fa2-a986-4c3a-be9e-e63c8b89b078 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:21:20.600448 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-25d10fa2-a986-4c3a-be9e-e63c8b89b078 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:21:20.697613 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-25d10fa2-a986-4c3a-be9e-e63c8b89b078 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] 10.222.0.64 "POST /compute/v2.1/servers/a76bfa58-eb74-49eb-84c5-52c49e394195/action" status: 200 len: 28158 microversion: 2.1 time: 0.113431 Oct 27 16:21:20.698490 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 1110/2140] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Oct 27 16:21:20 2021] POST /compute/v2.1/servers/a76bfa58-eb74-49eb-84c5-52c49e394195/action => generated 28158 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 27 16:21:21.712117 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-f11f8918-55a3-4a41-b0d1-e9c4309c82cf tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 16:21:21.713516 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-f11f8918-55a3-4a41-b0d1-e9c4309c82cf tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] [instance: a76bfa58-eb74-49eb-84c5-52c49e394195] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:21:21.721427 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-f11f8918-55a3-4a41-b0d1-e9c4309c82cf tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:21:21.721879 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-f11f8918-55a3-4a41-b0d1-e9c4309c82cf tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:21:21.722672 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-f11f8918-55a3-4a41-b0d1-e9c4309c82cf tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:21:21.723111 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-f11f8918-55a3-4a41-b0d1-e9c4309c82cf tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:21:21.816165 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-f11f8918-55a3-4a41-b0d1-e9c4309c82cf tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] 10.222.0.64 "POST /compute/v2.1/servers/a76bfa58-eb74-49eb-84c5-52c49e394195/action" status: 200 len: 28220 microversion: 2.1 time: 0.108520 Oct 27 16:21:21.816897 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 1031/2141] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Oct 27 16:21:21 2021] POST /compute/v2.1/servers/a76bfa58-eb74-49eb-84c5-52c49e394195/action => generated 28220 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 16:21:22.829644 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-8930b0cb-aa13-4520-a027-41f0cd1da477 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 16:21:22.834265 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-8930b0cb-aa13-4520-a027-41f0cd1da477 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] [instance: a76bfa58-eb74-49eb-84c5-52c49e394195] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:21:22.846192 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-8930b0cb-aa13-4520-a027-41f0cd1da477 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:21:22.846752 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-8930b0cb-aa13-4520-a027-41f0cd1da477 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:21:22.847523 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-8930b0cb-aa13-4520-a027-41f0cd1da477 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:21:22.847998 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-8930b0cb-aa13-4520-a027-41f0cd1da477 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:21:22.933955 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-8930b0cb-aa13-4520-a027-41f0cd1da477 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] 10.222.0.64 "POST /compute/v2.1/servers/a76bfa58-eb74-49eb-84c5-52c49e394195/action" status: 200 len: 28220 microversion: 2.1 time: 0.109193 Oct 27 16:21:22.934977 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 1111/2142] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Oct 27 16:21:22 2021] POST /compute/v2.1/servers/a76bfa58-eb74-49eb-84c5-52c49e394195/action => generated 28220 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 16:21:23.947751 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-ffd7fbab-d147-49bc-a44b-a8e030ae17ff tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 16:21:23.950905 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-ffd7fbab-d147-49bc-a44b-a8e030ae17ff tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] [instance: a76bfa58-eb74-49eb-84c5-52c49e394195] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:21:23.964740 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-ffd7fbab-d147-49bc-a44b-a8e030ae17ff tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:21:23.965548 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-ffd7fbab-d147-49bc-a44b-a8e030ae17ff tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:21:23.967121 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-ffd7fbab-d147-49bc-a44b-a8e030ae17ff tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:21:23.967970 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-ffd7fbab-d147-49bc-a44b-a8e030ae17ff tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:21:24.076225 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-ffd7fbab-d147-49bc-a44b-a8e030ae17ff tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] 10.222.0.64 "POST /compute/v2.1/servers/a76bfa58-eb74-49eb-84c5-52c49e394195/action" status: 200 len: 28511 microversion: 2.1 time: 0.132094 Oct 27 16:21:24.077384 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 1032/2143] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Oct 27 16:21:23 2021] POST /compute/v2.1/servers/a76bfa58-eb74-49eb-84c5-52c49e394195/action => generated 28511 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 16:21:25.094550 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-e51822e1-e867-4d9f-bec4-81f0a522bc5c tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 16:21:25.096349 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-e51822e1-e867-4d9f-bec4-81f0a522bc5c tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] [instance: a76bfa58-eb74-49eb-84c5-52c49e394195] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:21:25.109691 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-e51822e1-e867-4d9f-bec4-81f0a522bc5c tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:21:25.110514 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-e51822e1-e867-4d9f-bec4-81f0a522bc5c tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:21:25.111823 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-e51822e1-e867-4d9f-bec4-81f0a522bc5c tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:21:25.112630 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-e51822e1-e867-4d9f-bec4-81f0a522bc5c tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:21:25.219580 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-e51822e1-e867-4d9f-bec4-81f0a522bc5c tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] 10.222.0.64 "POST /compute/v2.1/servers/a76bfa58-eb74-49eb-84c5-52c49e394195/action" status: 200 len: 28679 microversion: 2.1 time: 0.132891 Oct 27 16:21:25.220948 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 1112/2144] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Oct 27 16:21:25 2021] POST /compute/v2.1/servers/a76bfa58-eb74-49eb-84c5-52c49e394195/action => generated 28679 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 27 16:21:26.234053 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-58faae3f-e5de-4844-8fa8-722dd19e2222 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 16:21:26.235274 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-58faae3f-e5de-4844-8fa8-722dd19e2222 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] [instance: a76bfa58-eb74-49eb-84c5-52c49e394195] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:21:26.248665 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-58faae3f-e5de-4844-8fa8-722dd19e2222 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:21:26.249539 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-58faae3f-e5de-4844-8fa8-722dd19e2222 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:21:26.250481 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-58faae3f-e5de-4844-8fa8-722dd19e2222 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:21:26.251015 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-58faae3f-e5de-4844-8fa8-722dd19e2222 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:21:26.320992 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-58faae3f-e5de-4844-8fa8-722dd19e2222 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] 10.222.0.64 "POST /compute/v2.1/servers/a76bfa58-eb74-49eb-84c5-52c49e394195/action" status: 200 len: 28679 microversion: 2.1 time: 0.091507 Oct 27 16:21:26.322128 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 1033/2145] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Oct 27 16:21:26 2021] POST /compute/v2.1/servers/a76bfa58-eb74-49eb-84c5-52c49e394195/action => generated 28679 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 27 16:21:27.336643 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-99e01f2a-ef20-4f90-b25b-e2a8270ac9fe tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 16:21:27.337713 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-99e01f2a-ef20-4f90-b25b-e2a8270ac9fe tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] [instance: a76bfa58-eb74-49eb-84c5-52c49e394195] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:21:27.346512 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-99e01f2a-ef20-4f90-b25b-e2a8270ac9fe tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:21:27.347008 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-99e01f2a-ef20-4f90-b25b-e2a8270ac9fe tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:21:27.347935 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-99e01f2a-ef20-4f90-b25b-e2a8270ac9fe tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:21:27.348419 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-99e01f2a-ef20-4f90-b25b-e2a8270ac9fe tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:21:27.418420 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-99e01f2a-ef20-4f90-b25b-e2a8270ac9fe tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] 10.222.0.64 "POST /compute/v2.1/servers/a76bfa58-eb74-49eb-84c5-52c49e394195/action" status: 200 len: 28679 microversion: 2.1 time: 0.085581 Oct 27 16:21:27.419471 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 1113/2146] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Oct 27 16:21:27 2021] POST /compute/v2.1/servers/a76bfa58-eb74-49eb-84c5-52c49e394195/action => generated 28679 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 27 16:21:28.431679 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-ff2ffdd2-532d-4cdf-8b23-9570ea67da88 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 16:21:28.432901 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-ff2ffdd2-532d-4cdf-8b23-9570ea67da88 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] [instance: a76bfa58-eb74-49eb-84c5-52c49e394195] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:21:28.442056 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-ff2ffdd2-532d-4cdf-8b23-9570ea67da88 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:21:28.442613 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-ff2ffdd2-532d-4cdf-8b23-9570ea67da88 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:21:28.443500 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-ff2ffdd2-532d-4cdf-8b23-9570ea67da88 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:21:28.444131 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-ff2ffdd2-532d-4cdf-8b23-9570ea67da88 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:21:28.519305 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-ff2ffdd2-532d-4cdf-8b23-9570ea67da88 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] 10.222.0.64 "POST /compute/v2.1/servers/a76bfa58-eb74-49eb-84c5-52c49e394195/action" status: 200 len: 28679 microversion: 2.1 time: 0.091491 Oct 27 16:21:28.520230 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 1034/2147] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Oct 27 16:21:28 2021] POST /compute/v2.1/servers/a76bfa58-eb74-49eb-84c5-52c49e394195/action => generated 28679 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 27 16:21:29.121467 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-805d2788-75c4-4a96-a540-bb3ad112f497 tempest-TestMinimumBasicScenario-420461111 tempest-TestMinimumBasicScenario-420461111-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-2028911144"}} {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 16:21:29.122206 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-805d2788-75c4-4a96-a540-bb3ad112f497 tempest-TestMinimumBasicScenario-420461111 tempest-TestMinimumBasicScenario-420461111-project] [instance: a4e12070-1613-4a12-9f73-f4e7f40fc3f3] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:21:29.130785 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-805d2788-75c4-4a96-a540-bb3ad112f497 tempest-TestMinimumBasicScenario-420461111 tempest-TestMinimumBasicScenario-420461111-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:21:29.131284 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-805d2788-75c4-4a96-a540-bb3ad112f497 tempest-TestMinimumBasicScenario-420461111 tempest-TestMinimumBasicScenario-420461111-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:21:29.132190 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-805d2788-75c4-4a96-a540-bb3ad112f497 tempest-TestMinimumBasicScenario-420461111 tempest-TestMinimumBasicScenario-420461111-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:21:29.132712 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-805d2788-75c4-4a96-a540-bb3ad112f497 tempest-TestMinimumBasicScenario-420461111 tempest-TestMinimumBasicScenario-420461111-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:21:29.328266 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.network.security_group_api [None req-805d2788-75c4-4a96-a540-bb3ad112f497 tempest-TestMinimumBasicScenario-420461111 tempest-TestMinimumBasicScenario-420461111-project] Removing security group 0587eee0-f784-4606-8277-0a6db0496b0f from port e1193d94-4bcf-4f1a-9cb1-7c110907babc Oct 27 16:21:29.534783 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-6ed5e4f8-056b-4bb4-bc10-a83f03261227 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 16:21:29.535761 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-6ed5e4f8-056b-4bb4-bc10-a83f03261227 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] [instance: a76bfa58-eb74-49eb-84c5-52c49e394195] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:21:29.549898 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-6ed5e4f8-056b-4bb4-bc10-a83f03261227 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:21:29.550747 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-6ed5e4f8-056b-4bb4-bc10-a83f03261227 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:21:29.552292 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-6ed5e4f8-056b-4bb4-bc10-a83f03261227 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:21:29.553120 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-6ed5e4f8-056b-4bb4-bc10-a83f03261227 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:21:29.645847 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-6ed5e4f8-056b-4bb4-bc10-a83f03261227 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] 10.222.0.64 "POST /compute/v2.1/servers/a76bfa58-eb74-49eb-84c5-52c49e394195/action" status: 200 len: 28680 microversion: 2.1 time: 0.115427 Oct 27 16:21:29.651775 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 1035/2148] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Oct 27 16:21:29 2021] POST /compute/v2.1/servers/a76bfa58-eb74-49eb-84c5-52c49e394195/action => generated 28680 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 27 16:21:29.736262 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-805d2788-75c4-4a96-a540-bb3ad112f497 tempest-TestMinimumBasicScenario-420461111 tempest-TestMinimumBasicScenario-420461111-project] 10.222.0.64 "POST /compute/v2.1/servers/a4e12070-1613-4a12-9f73-f4e7f40fc3f3/action" status: 202 len: 0 microversion: 2.1 time: 0.618827 Oct 27 16:21:29.756747 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 1114/2149] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Oct 27 16:21:29 2021] POST /compute/v2.1/servers/a4e12070-1613-4a12-9f73-f4e7f40fc3f3/action => generated 0 bytes in 640 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 16:21:29.759189 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [req-4b226d44-432c-4169-afde-235245b6e0d9 req-52983b59-1083-429e-aced-5fe0d2665547 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a4e12070-1613-4a12-9f73-f4e7f40fc3f3", "tag": "e1193d94-4bcf-4f1a-9cb1-7c110907babc"}]} {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 16:21:29.763172 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 27 16:21:29.763172 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: warnings.warn(msg) Oct 27 16:21:29.774643 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [req-4b226d44-432c-4169-afde-235245b6e0d9 req-52983b59-1083-429e-aced-5fe0d2665547 service nova] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:21:29.776313 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [req-4b226d44-432c-4169-afde-235245b6e0d9 req-52983b59-1083-429e-aced-5fe0d2665547 service nova] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:21:29.791482 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.compute.server_external_events [req-4b226d44-432c-4169-afde-235245b6e0d9 req-52983b59-1083-429e-aced-5fe0d2665547 service nova] Creating event network-changed:e1193d94-4bcf-4f1a-9cb1-7c110907babc for instance a4e12070-1613-4a12-9f73-f4e7f40fc3f3 on hv-cinder-80070 Oct 27 16:21:29.799098 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [req-4b226d44-432c-4169-afde-235245b6e0d9 req-52983b59-1083-429e-aced-5fe0d2665547 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045406 Oct 27 16:21:29.800644 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 1036/2150] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Oct 27 16:21:29 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 16:21:30.663907 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-e2a684e0-504b-482a-ba8b-dc7f306c5d3d tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 16:21:30.665613 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-e2a684e0-504b-482a-ba8b-dc7f306c5d3d tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] [instance: a76bfa58-eb74-49eb-84c5-52c49e394195] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:21:30.678777 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-e2a684e0-504b-482a-ba8b-dc7f306c5d3d tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:21:30.680049 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-e2a684e0-504b-482a-ba8b-dc7f306c5d3d tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:21:30.681933 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-e2a684e0-504b-482a-ba8b-dc7f306c5d3d tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:21:30.682707 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-e2a684e0-504b-482a-ba8b-dc7f306c5d3d tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:21:30.795711 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-e2a684e0-504b-482a-ba8b-dc7f306c5d3d tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] 10.222.0.64 "POST /compute/v2.1/servers/a76bfa58-eb74-49eb-84c5-52c49e394195/action" status: 200 len: 30600 microversion: 2.1 time: 0.138624 Oct 27 16:21:30.796976 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 1115/2151] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Oct 27 16:21:30 2021] POST /compute/v2.1/servers/a76bfa58-eb74-49eb-84c5-52c49e394195/action => generated 30600 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 16:21:31.802629 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-e15f9b71-7a00-40e1-abca-6f1b8f51f1a5 tempest-TestMinimumBasicScenario-420461111 tempest-TestMinimumBasicScenario-420461111-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:21:31.803664 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-e15f9b71-7a00-40e1-abca-6f1b8f51f1a5 tempest-TestMinimumBasicScenario-420461111 tempest-TestMinimumBasicScenario-420461111-project] [instance: a4e12070-1613-4a12-9f73-f4e7f40fc3f3] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:21:31.816529 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-e15f9b71-7a00-40e1-abca-6f1b8f51f1a5 tempest-TestMinimumBasicScenario-420461111 tempest-TestMinimumBasicScenario-420461111-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:21:31.817262 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-4957d4a2-e80a-4b7f-a6a9-f416b24aaac9 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 16:21:31.818019 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-e15f9b71-7a00-40e1-abca-6f1b8f51f1a5 tempest-TestMinimumBasicScenario-420461111 tempest-TestMinimumBasicScenario-420461111-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:21:31.818829 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-e15f9b71-7a00-40e1-abca-6f1b8f51f1a5 tempest-TestMinimumBasicScenario-420461111 tempest-TestMinimumBasicScenario-420461111-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:21:31.819551 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-e15f9b71-7a00-40e1-abca-6f1b8f51f1a5 tempest-TestMinimumBasicScenario-420461111 tempest-TestMinimumBasicScenario-420461111-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:21:31.820803 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-4957d4a2-e80a-4b7f-a6a9-f416b24aaac9 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] [instance: a76bfa58-eb74-49eb-84c5-52c49e394195] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:21:31.833378 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-4957d4a2-e80a-4b7f-a6a9-f416b24aaac9 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:21:31.834455 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-4957d4a2-e80a-4b7f-a6a9-f416b24aaac9 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:21:31.836086 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-4957d4a2-e80a-4b7f-a6a9-f416b24aaac9 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:21:31.837046 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-4957d4a2-e80a-4b7f-a6a9-f416b24aaac9 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:21:31.939957 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-4957d4a2-e80a-4b7f-a6a9-f416b24aaac9 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] 10.222.0.64 "POST /compute/v2.1/servers/a76bfa58-eb74-49eb-84c5-52c49e394195/action" status: 200 len: 32633 microversion: 2.1 time: 0.130999 Oct 27 16:21:31.940807 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 1116/2152] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Oct 27 16:21:31 2021] POST /compute/v2.1/servers/a76bfa58-eb74-49eb-84c5-52c49e394195/action => generated 32633 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 16:21:31.950917 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [req-0e063ecf-1ef4-4223-bceb-a39c97dbf3df req-4491591d-b32a-4d57-9a5e-2b18377201f1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a4e12070-1613-4a12-9f73-f4e7f40fc3f3", "tag": "e1193d94-4bcf-4f1a-9cb1-7c110907babc"}]} {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 16:21:31.952719 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 27 16:21:31.952719 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: warnings.warn(msg) Oct 27 16:21:31.960996 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [req-0e063ecf-1ef4-4223-bceb-a39c97dbf3df req-4491591d-b32a-4d57-9a5e-2b18377201f1 service nova] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:21:31.961746 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [req-0e063ecf-1ef4-4223-bceb-a39c97dbf3df req-4491591d-b32a-4d57-9a5e-2b18377201f1 service nova] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:21:31.966938 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.objects.instance [None req-e15f9b71-7a00-40e1-abca-6f1b8f51f1a5 tempest-TestMinimumBasicScenario-420461111 tempest-TestMinimumBasicScenario-420461111-project] Lazy-loading 'services' on Instance uuid a4e12070-1613-4a12-9f73-f4e7f40fc3f3 {{(pid=122225) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 27 16:21:31.975720 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.compute.server_external_events [req-0e063ecf-1ef4-4223-bceb-a39c97dbf3df req-4491591d-b32a-4d57-9a5e-2b18377201f1 service nova] Creating event network-changed:e1193d94-4bcf-4f1a-9cb1-7c110907babc for instance a4e12070-1613-4a12-9f73-f4e7f40fc3f3 on hv-cinder-80070 Oct 27 16:21:31.981313 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [req-0e063ecf-1ef4-4223-bceb-a39c97dbf3df req-4491591d-b32a-4d57-9a5e-2b18377201f1 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035023 Oct 27 16:21:31.986170 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 1117/2153] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Oct 27 16:21:31 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 16:21:32.111164 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-e15f9b71-7a00-40e1-abca-6f1b8f51f1a5 tempest-TestMinimumBasicScenario-420461111 tempest-TestMinimumBasicScenario-420461111-project] 10.222.0.64 "DELETE /compute/v2.1/servers/a4e12070-1613-4a12-9f73-f4e7f40fc3f3/os-volume_attachments/bcdac535-3bb3-4594-a67d-ee2dc9105b51" status: 202 len: 0 microversion: 2.1 time: 0.318169 Oct 27 16:21:32.115989 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 1037/2154] 10.222.0.64 () {58 vars in 1415 bytes} [Wed Oct 27 16:21:31 2021] DELETE /compute/v2.1/servers/a4e12070-1613-4a12-9f73-f4e7f40fc3f3/os-volume_attachments/bcdac535-3bb3-4594-a67d-ee2dc9105b51 => generated 0 bytes in 322 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 16:21:32.133737 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-e68a562f-5f23-4393-b740-449c5fd7777e tempest-TestMinimumBasicScenario-420461111 tempest-TestMinimumBasicScenario-420461111-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:21:32.138632 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-e68a562f-5f23-4393-b740-449c5fd7777e tempest-TestMinimumBasicScenario-420461111 tempest-TestMinimumBasicScenario-420461111-project] [instance: a4e12070-1613-4a12-9f73-f4e7f40fc3f3] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:21:32.164410 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-e68a562f-5f23-4393-b740-449c5fd7777e tempest-TestMinimumBasicScenario-420461111 tempest-TestMinimumBasicScenario-420461111-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:21:32.165873 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-e68a562f-5f23-4393-b740-449c5fd7777e tempest-TestMinimumBasicScenario-420461111 tempest-TestMinimumBasicScenario-420461111-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:21:32.167894 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-e68a562f-5f23-4393-b740-449c5fd7777e tempest-TestMinimumBasicScenario-420461111 tempest-TestMinimumBasicScenario-420461111-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:21:32.169748 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-e68a562f-5f23-4393-b740-449c5fd7777e tempest-TestMinimumBasicScenario-420461111 tempest-TestMinimumBasicScenario-420461111-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:21:32.240154 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-e68a562f-5f23-4393-b740-449c5fd7777e tempest-TestMinimumBasicScenario-420461111 tempest-TestMinimumBasicScenario-420461111-project] 10.222.0.64 "GET /compute/v2.1/servers/a4e12070-1613-4a12-9f73-f4e7f40fc3f3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.120427 Oct 27 16:21:32.241416 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 1118/2155] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Oct 27 16:21:32 2021] GET /compute/v2.1/servers/a4e12070-1613-4a12-9f73-f4e7f40fc3f3/os-volume_attachments => generated 197 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 16:21:32.955708 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-5f8f48c3-d431-4415-ac88-29bf549ff7b4 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 16:21:32.957368 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-5f8f48c3-d431-4415-ac88-29bf549ff7b4 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] [instance: a76bfa58-eb74-49eb-84c5-52c49e394195] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:21:32.966176 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-5f8f48c3-d431-4415-ac88-29bf549ff7b4 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:21:32.966836 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-5f8f48c3-d431-4415-ac88-29bf549ff7b4 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:21:32.968231 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-5f8f48c3-d431-4415-ac88-29bf549ff7b4 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:21:32.969042 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-5f8f48c3-d431-4415-ac88-29bf549ff7b4 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:21:33.059623 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-5f8f48c3-d431-4415-ac88-29bf549ff7b4 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] 10.222.0.64 "POST /compute/v2.1/servers/a76bfa58-eb74-49eb-84c5-52c49e394195/action" status: 200 len: 33575 microversion: 2.1 time: 0.109290 Oct 27 16:21:33.066172 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 1038/2156] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Oct 27 16:21:32 2021] POST /compute/v2.1/servers/a76bfa58-eb74-49eb-84c5-52c49e394195/action => generated 33575 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 27 16:21:33.257756 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-6af1fb2b-2fc7-4864-a6aa-f582601aa115 tempest-TestMinimumBasicScenario-420461111 tempest-TestMinimumBasicScenario-420461111-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:21:33.259387 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-6af1fb2b-2fc7-4864-a6aa-f582601aa115 tempest-TestMinimumBasicScenario-420461111 tempest-TestMinimumBasicScenario-420461111-project] [instance: a4e12070-1613-4a12-9f73-f4e7f40fc3f3] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:21:33.272024 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-6af1fb2b-2fc7-4864-a6aa-f582601aa115 tempest-TestMinimumBasicScenario-420461111 tempest-TestMinimumBasicScenario-420461111-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:21:33.272811 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-6af1fb2b-2fc7-4864-a6aa-f582601aa115 tempest-TestMinimumBasicScenario-420461111 tempest-TestMinimumBasicScenario-420461111-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:21:33.274243 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-6af1fb2b-2fc7-4864-a6aa-f582601aa115 tempest-TestMinimumBasicScenario-420461111 tempest-TestMinimumBasicScenario-420461111-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:21:33.275008 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-6af1fb2b-2fc7-4864-a6aa-f582601aa115 tempest-TestMinimumBasicScenario-420461111 tempest-TestMinimumBasicScenario-420461111-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:21:33.338268 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-6af1fb2b-2fc7-4864-a6aa-f582601aa115 tempest-TestMinimumBasicScenario-420461111 tempest-TestMinimumBasicScenario-420461111-project] 10.222.0.64 "GET /compute/v2.1/servers/a4e12070-1613-4a12-9f73-f4e7f40fc3f3/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.086644 Oct 27 16:21:33.339196 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 1119/2157] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Oct 27 16:21:33 2021] GET /compute/v2.1/servers/a4e12070-1613-4a12-9f73-f4e7f40fc3f3/os-volume_attachments => generated 25 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 27 16:21:33.358725 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-59a23f05-dcae-48a4-b162-dc2e65dc8685 tempest-TestMinimumBasicScenario-420461111 tempest-TestMinimumBasicScenario-420461111-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:21:33.359762 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-59a23f05-dcae-48a4-b162-dc2e65dc8685 tempest-TestMinimumBasicScenario-420461111 tempest-TestMinimumBasicScenario-420461111-project] [instance: a4e12070-1613-4a12-9f73-f4e7f40fc3f3] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:21:33.373985 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-59a23f05-dcae-48a4-b162-dc2e65dc8685 tempest-TestMinimumBasicScenario-420461111 tempest-TestMinimumBasicScenario-420461111-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:21:33.374608 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-59a23f05-dcae-48a4-b162-dc2e65dc8685 tempest-TestMinimumBasicScenario-420461111 tempest-TestMinimumBasicScenario-420461111-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:21:33.376147 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-59a23f05-dcae-48a4-b162-dc2e65dc8685 tempest-TestMinimumBasicScenario-420461111 tempest-TestMinimumBasicScenario-420461111-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:21:33.376930 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-59a23f05-dcae-48a4-b162-dc2e65dc8685 tempest-TestMinimumBasicScenario-420461111 tempest-TestMinimumBasicScenario-420461111-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:21:33.503136 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.wsgi [None req-59a23f05-dcae-48a4-b162-dc2e65dc8685 tempest-TestMinimumBasicScenario-420461111 tempest-TestMinimumBasicScenario-420461111-project] HTTP exception thrown: Instance a4e12070-1613-4a12-9f73-f4e7f40fc3f3 is not attached to volume bcdac535-3bb3-4594-a67d-ee2dc9105b51 Oct 27 16:21:33.504212 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-59a23f05-dcae-48a4-b162-dc2e65dc8685 tempest-TestMinimumBasicScenario-420461111 tempest-TestMinimumBasicScenario-420461111-project] Returning 404 to user: Instance a4e12070-1613-4a12-9f73-f4e7f40fc3f3 is not attached to volume bcdac535-3bb3-4594-a67d-ee2dc9105b51 {{(pid=122225) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 27 16:21:33.505738 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-59a23f05-dcae-48a4-b162-dc2e65dc8685 tempest-TestMinimumBasicScenario-420461111 tempest-TestMinimumBasicScenario-420461111-project] 10.222.0.64 "DELETE /compute/v2.1/servers/a4e12070-1613-4a12-9f73-f4e7f40fc3f3/os-volume_attachments/bcdac535-3bb3-4594-a67d-ee2dc9105b51" status: 404 len: 154 microversion: 2.1 time: 0.155275 Oct 27 16:21:33.506768 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 1039/2158] 10.222.0.64 () {58 vars in 1415 bytes} [Wed Oct 27 16:21:33 2021] DELETE /compute/v2.1/servers/a4e12070-1613-4a12-9f73-f4e7f40fc3f3/os-volume_attachments/bcdac535-3bb3-4594-a67d-ee2dc9105b51 => generated 154 bytes in 158 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 16:21:34.074745 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-286e4f1e-7836-4f13-80ce-2618cdb46c33 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 16:21:34.075802 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-286e4f1e-7836-4f13-80ce-2618cdb46c33 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] [instance: a76bfa58-eb74-49eb-84c5-52c49e394195] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:21:34.082770 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-286e4f1e-7836-4f13-80ce-2618cdb46c33 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:21:34.083348 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-286e4f1e-7836-4f13-80ce-2618cdb46c33 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:21:34.084345 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-286e4f1e-7836-4f13-80ce-2618cdb46c33 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:21:34.084907 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-286e4f1e-7836-4f13-80ce-2618cdb46c33 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:21:34.159754 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-286e4f1e-7836-4f13-80ce-2618cdb46c33 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] 10.222.0.64 "POST /compute/v2.1/servers/a76bfa58-eb74-49eb-84c5-52c49e394195/action" status: 200 len: 34755 microversion: 2.1 time: 0.089235 Oct 27 16:21:34.160472 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 1120/2159] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Oct 27 16:21:34 2021] POST /compute/v2.1/servers/a76bfa58-eb74-49eb-84c5-52c49e394195/action => generated 34755 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 16:21:34.720244 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-974dee6f-0720-4ba9-a9ae-313a5f197677 tempest-TestMinimumBasicScenario-420461111 tempest-TestMinimumBasicScenario-420461111-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:21:34.721090 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-974dee6f-0720-4ba9-a9ae-313a5f197677 tempest-TestMinimumBasicScenario-420461111 tempest-TestMinimumBasicScenario-420461111-project] [instance: a4e12070-1613-4a12-9f73-f4e7f40fc3f3] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:21:34.728551 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-974dee6f-0720-4ba9-a9ae-313a5f197677 tempest-TestMinimumBasicScenario-420461111 tempest-TestMinimumBasicScenario-420461111-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:21:34.728999 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-974dee6f-0720-4ba9-a9ae-313a5f197677 tempest-TestMinimumBasicScenario-420461111 tempest-TestMinimumBasicScenario-420461111-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:21:34.729810 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-974dee6f-0720-4ba9-a9ae-313a5f197677 tempest-TestMinimumBasicScenario-420461111 tempest-TestMinimumBasicScenario-420461111-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:21:34.730253 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-974dee6f-0720-4ba9-a9ae-313a5f197677 tempest-TestMinimumBasicScenario-420461111 tempest-TestMinimumBasicScenario-420461111-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:21:34.760923 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-974dee6f-0720-4ba9-a9ae-313a5f197677 tempest-TestMinimumBasicScenario-420461111 tempest-TestMinimumBasicScenario-420461111-project] [instance: a4e12070-1613-4a12-9f73-f4e7f40fc3f3] Going to try to terminate instance {{(pid=122225) delete /opt/stack/nova/nova/compute/api.py:2612}} Oct 27 16:21:34.849371 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-974dee6f-0720-4ba9-a9ae-313a5f197677 tempest-TestMinimumBasicScenario-420461111 tempest-TestMinimumBasicScenario-420461111-project] 10.222.0.64 "DELETE /compute/v2.1/servers/a4e12070-1613-4a12-9f73-f4e7f40fc3f3" status: 204 len: 0 microversion: 2.1 time: 0.133092 Oct 27 16:21:34.850216 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 1040/2160] 10.222.0.64 () {58 vars in 1238 bytes} [Wed Oct 27 16:21:34 2021] DELETE /compute/v2.1/servers/a4e12070-1613-4a12-9f73-f4e7f40fc3f3 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 27 16:21:34.866716 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-c1d438f5-5b12-4034-821e-891effc6ddc9 tempest-TestMinimumBasicScenario-420461111 tempest-TestMinimumBasicScenario-420461111-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:21:34.868046 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-c1d438f5-5b12-4034-821e-891effc6ddc9 tempest-TestMinimumBasicScenario-420461111 tempest-TestMinimumBasicScenario-420461111-project] [instance: a4e12070-1613-4a12-9f73-f4e7f40fc3f3] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:21:34.882037 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-c1d438f5-5b12-4034-821e-891effc6ddc9 tempest-TestMinimumBasicScenario-420461111 tempest-TestMinimumBasicScenario-420461111-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:21:34.882841 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-c1d438f5-5b12-4034-821e-891effc6ddc9 tempest-TestMinimumBasicScenario-420461111 tempest-TestMinimumBasicScenario-420461111-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:21:34.884350 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-c1d438f5-5b12-4034-821e-891effc6ddc9 tempest-TestMinimumBasicScenario-420461111 tempest-TestMinimumBasicScenario-420461111-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:21:34.885159 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-c1d438f5-5b12-4034-821e-891effc6ddc9 tempest-TestMinimumBasicScenario-420461111 tempest-TestMinimumBasicScenario-420461111-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:21:35.080061 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-c1d438f5-5b12-4034-821e-891effc6ddc9 tempest-TestMinimumBasicScenario-420461111 tempest-TestMinimumBasicScenario-420461111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906ea7817e7b4ca9a240e2c15220e79b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f6eb1316874ed48d552488e289db7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 16:21:35.089170 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-c1d438f5-5b12-4034-821e-891effc6ddc9 tempest-TestMinimumBasicScenario-420461111 tempest-TestMinimumBasicScenario-420461111-project] 10.222.0.64 "GET /compute/v2.1/servers/a4e12070-1613-4a12-9f73-f4e7f40fc3f3" status: 200 len: 1555 microversion: 2.1 time: 0.230297 Oct 27 16:21:35.089952 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 1121/2161] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 16:21:34 2021] GET /compute/v2.1/servers/a4e12070-1613-4a12-9f73-f4e7f40fc3f3 => generated 1555 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 16:21:35.177104 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-6292924c-3ce0-47b7-81c3-e5b36b30f2f2 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 16:21:35.178982 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-6292924c-3ce0-47b7-81c3-e5b36b30f2f2 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] [instance: a76bfa58-eb74-49eb-84c5-52c49e394195] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:21:35.190459 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-6292924c-3ce0-47b7-81c3-e5b36b30f2f2 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:21:35.191252 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-6292924c-3ce0-47b7-81c3-e5b36b30f2f2 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:21:35.192715 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-6292924c-3ce0-47b7-81c3-e5b36b30f2f2 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:21:35.193499 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-6292924c-3ce0-47b7-81c3-e5b36b30f2f2 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:21:35.279168 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-6292924c-3ce0-47b7-81c3-e5b36b30f2f2 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] 10.222.0.64 "POST /compute/v2.1/servers/a76bfa58-eb74-49eb-84c5-52c49e394195/action" status: 200 len: 35821 microversion: 2.1 time: 0.109059 Oct 27 16:21:35.280087 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 1041/2162] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Oct 27 16:21:35 2021] POST /compute/v2.1/servers/a76bfa58-eb74-49eb-84c5-52c49e394195/action => generated 35821 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 16:21:36.108984 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-81436248-1756-4209-b8ba-61506d6483de tempest-TestMinimumBasicScenario-420461111 tempest-TestMinimumBasicScenario-420461111-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:21:36.109826 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-81436248-1756-4209-b8ba-61506d6483de tempest-TestMinimumBasicScenario-420461111 tempest-TestMinimumBasicScenario-420461111-project] [instance: a4e12070-1613-4a12-9f73-f4e7f40fc3f3] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:21:36.117458 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-81436248-1756-4209-b8ba-61506d6483de tempest-TestMinimumBasicScenario-420461111 tempest-TestMinimumBasicScenario-420461111-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:21:36.117960 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-81436248-1756-4209-b8ba-61506d6483de tempest-TestMinimumBasicScenario-420461111 tempest-TestMinimumBasicScenario-420461111-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:21:36.118799 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-81436248-1756-4209-b8ba-61506d6483de tempest-TestMinimumBasicScenario-420461111 tempest-TestMinimumBasicScenario-420461111-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:21:36.119305 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-81436248-1756-4209-b8ba-61506d6483de tempest-TestMinimumBasicScenario-420461111 tempest-TestMinimumBasicScenario-420461111-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:21:36.296035 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-4337c85b-bb09-45b1-b561-0ab8349a54fb tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 16:21:36.297270 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-4337c85b-bb09-45b1-b561-0ab8349a54fb tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] [instance: a76bfa58-eb74-49eb-84c5-52c49e394195] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:21:36.306477 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-81436248-1756-4209-b8ba-61506d6483de tempest-TestMinimumBasicScenario-420461111 tempest-TestMinimumBasicScenario-420461111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906ea7817e7b4ca9a240e2c15220e79b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f6eb1316874ed48d552488e289db7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 16:21:36.308854 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-4337c85b-bb09-45b1-b561-0ab8349a54fb tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:21:36.309598 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-4337c85b-bb09-45b1-b561-0ab8349a54fb tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:21:36.310916 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-4337c85b-bb09-45b1-b561-0ab8349a54fb tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:21:36.311646 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-4337c85b-bb09-45b1-b561-0ab8349a54fb tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:21:36.319239 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-81436248-1756-4209-b8ba-61506d6483de tempest-TestMinimumBasicScenario-420461111 tempest-TestMinimumBasicScenario-420461111-project] 10.222.0.64 "GET /compute/v2.1/servers/a4e12070-1613-4a12-9f73-f4e7f40fc3f3" status: 200 len: 1555 microversion: 2.1 time: 0.214543 Oct 27 16:21:36.320043 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 1122/2163] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 16:21:36 2021] GET /compute/v2.1/servers/a4e12070-1613-4a12-9f73-f4e7f40fc3f3 => generated 1555 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 16:21:36.399753 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-4337c85b-bb09-45b1-b561-0ab8349a54fb tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] 10.222.0.64 "POST /compute/v2.1/servers/a76bfa58-eb74-49eb-84c5-52c49e394195/action" status: 200 len: 37094 microversion: 2.1 time: 0.109654 Oct 27 16:21:36.401985 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 1042/2164] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Oct 27 16:21:36 2021] POST /compute/v2.1/servers/a76bfa58-eb74-49eb-84c5-52c49e394195/action => generated 37094 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 27 16:21:37.345852 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-42f8e7eb-879a-4134-be8b-add57311ad3c tempest-TestMinimumBasicScenario-420461111 tempest-TestMinimumBasicScenario-420461111-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:21:37.348032 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-42f8e7eb-879a-4134-be8b-add57311ad3c tempest-TestMinimumBasicScenario-420461111 tempest-TestMinimumBasicScenario-420461111-project] [instance: a4e12070-1613-4a12-9f73-f4e7f40fc3f3] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:21:37.360084 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-42f8e7eb-879a-4134-be8b-add57311ad3c tempest-TestMinimumBasicScenario-420461111 tempest-TestMinimumBasicScenario-420461111-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:21:37.360828 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-42f8e7eb-879a-4134-be8b-add57311ad3c tempest-TestMinimumBasicScenario-420461111 tempest-TestMinimumBasicScenario-420461111-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:21:37.362561 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-42f8e7eb-879a-4134-be8b-add57311ad3c tempest-TestMinimumBasicScenario-420461111 tempest-TestMinimumBasicScenario-420461111-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:21:37.363384 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-42f8e7eb-879a-4134-be8b-add57311ad3c tempest-TestMinimumBasicScenario-420461111 tempest-TestMinimumBasicScenario-420461111-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:21:37.417463 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-3425ce14-338b-4129-a4e9-d720d7a90672 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 16:21:37.419253 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-3425ce14-338b-4129-a4e9-d720d7a90672 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] [instance: a76bfa58-eb74-49eb-84c5-52c49e394195] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:21:37.427220 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-3425ce14-338b-4129-a4e9-d720d7a90672 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:21:37.427663 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-3425ce14-338b-4129-a4e9-d720d7a90672 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:21:37.429141 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-3425ce14-338b-4129-a4e9-d720d7a90672 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:21:37.429617 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-3425ce14-338b-4129-a4e9-d720d7a90672 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:21:37.470309 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-42f8e7eb-879a-4134-be8b-add57311ad3c tempest-TestMinimumBasicScenario-420461111 tempest-TestMinimumBasicScenario-420461111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906ea7817e7b4ca9a240e2c15220e79b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f6eb1316874ed48d552488e289db7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 16:21:37.483164 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-42f8e7eb-879a-4134-be8b-add57311ad3c tempest-TestMinimumBasicScenario-420461111 tempest-TestMinimumBasicScenario-420461111-project] 10.222.0.64 "GET /compute/v2.1/servers/a4e12070-1613-4a12-9f73-f4e7f40fc3f3" status: 200 len: 1513 microversion: 2.1 time: 0.145016 Oct 27 16:21:37.483924 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 1123/2165] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 16:21:37 2021] GET /compute/v2.1/servers/a4e12070-1613-4a12-9f73-f4e7f40fc3f3 => generated 1513 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 16:21:37.488556 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [req-92667156-57fd-4103-85ce-f1ea8cea2228 req-d7c888b3-e901-4d7c-a011-cedefbbd875d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a4e12070-1613-4a12-9f73-f4e7f40fc3f3", "name": "network-vif-deleted", "tag": "e1193d94-4bcf-4f1a-9cb1-7c110907babc"}]} {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 16:21:37.490211 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 27 16:21:37.490211 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: warnings.warn(msg) Oct 27 16:21:37.498506 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [req-92667156-57fd-4103-85ce-f1ea8cea2228 req-d7c888b3-e901-4d7c-a011-cedefbbd875d service nova] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:21:37.499069 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [req-92667156-57fd-4103-85ce-f1ea8cea2228 req-d7c888b3-e901-4d7c-a011-cedefbbd875d service nova] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:21:37.511727 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.compute.server_external_events [req-92667156-57fd-4103-85ce-f1ea8cea2228 req-d7c888b3-e901-4d7c-a011-cedefbbd875d service nova] Creating event network-vif-deleted:e1193d94-4bcf-4f1a-9cb1-7c110907babc for instance a4e12070-1613-4a12-9f73-f4e7f40fc3f3 on hv-cinder-80070 Oct 27 16:21:37.521403 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [req-92667156-57fd-4103-85ce-f1ea8cea2228 req-d7c888b3-e901-4d7c-a011-cedefbbd875d service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036088 Oct 27 16:21:37.522645 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 1124/2166] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Oct 27 16:21:37 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 16:21:37.522810 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-3425ce14-338b-4129-a4e9-d720d7a90672 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] 10.222.0.64 "POST /compute/v2.1/servers/a76bfa58-eb74-49eb-84c5-52c49e394195/action" status: 200 len: 38214 microversion: 2.1 time: 0.109880 Oct 27 16:21:37.524734 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 1043/2167] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Oct 27 16:21:37 2021] POST /compute/v2.1/servers/a76bfa58-eb74-49eb-84c5-52c49e394195/action => generated 38214 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 16:21:38.504506 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-cde6649f-837a-484b-87b9-012125541241 tempest-TestMinimumBasicScenario-420461111 tempest-TestMinimumBasicScenario-420461111-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:21:38.505207 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-cde6649f-837a-484b-87b9-012125541241 tempest-TestMinimumBasicScenario-420461111 tempest-TestMinimumBasicScenario-420461111-project] [instance: a4e12070-1613-4a12-9f73-f4e7f40fc3f3] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:21:38.511892 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-cde6649f-837a-484b-87b9-012125541241 tempest-TestMinimumBasicScenario-420461111 tempest-TestMinimumBasicScenario-420461111-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:21:38.512928 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-cde6649f-837a-484b-87b9-012125541241 tempest-TestMinimumBasicScenario-420461111 tempest-TestMinimumBasicScenario-420461111-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:21:38.513736 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-cde6649f-837a-484b-87b9-012125541241 tempest-TestMinimumBasicScenario-420461111 tempest-TestMinimumBasicScenario-420461111-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:21:38.514171 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-cde6649f-837a-484b-87b9-012125541241 tempest-TestMinimumBasicScenario-420461111 tempest-TestMinimumBasicScenario-420461111-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:21:38.530020 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.wsgi [None req-cde6649f-837a-484b-87b9-012125541241 tempest-TestMinimumBasicScenario-420461111 tempest-TestMinimumBasicScenario-420461111-project] HTTP exception thrown: Instance a4e12070-1613-4a12-9f73-f4e7f40fc3f3 could not be found. Oct 27 16:21:38.530794 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-cde6649f-837a-484b-87b9-012125541241 tempest-TestMinimumBasicScenario-420461111 tempest-TestMinimumBasicScenario-420461111-project] Returning 404 to user: Instance a4e12070-1613-4a12-9f73-f4e7f40fc3f3 could not be found. {{(pid=122224) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 27 16:21:38.531745 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-cde6649f-837a-484b-87b9-012125541241 tempest-TestMinimumBasicScenario-420461111 tempest-TestMinimumBasicScenario-420461111-project] 10.222.0.64 "GET /compute/v2.1/servers/a4e12070-1613-4a12-9f73-f4e7f40fc3f3" status: 404 len: 111 microversion: 2.1 time: 0.032070 Oct 27 16:21:38.532609 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 1125/2168] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 16:21:38 2021] GET /compute/v2.1/servers/a4e12070-1613-4a12-9f73-f4e7f40fc3f3 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 16:21:38.541103 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-11549724-4110-4ef7-a0fc-b27cad39a1c5 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 16:21:38.542563 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-11549724-4110-4ef7-a0fc-b27cad39a1c5 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] [instance: a76bfa58-eb74-49eb-84c5-52c49e394195] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:21:38.547130 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-400046d8-d904-4771-ae9e-6a7c1f50de7e tempest-TestMinimumBasicScenario-420461111 tempest-TestMinimumBasicScenario-420461111-project] Calling method '.version_select at 0x7fbc05c71940>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:21:38.555754 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-11549724-4110-4ef7-a0fc-b27cad39a1c5 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:21:38.556867 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-11549724-4110-4ef7-a0fc-b27cad39a1c5 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:21:38.558302 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-11549724-4110-4ef7-a0fc-b27cad39a1c5 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:21:38.559107 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-11549724-4110-4ef7-a0fc-b27cad39a1c5 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:21:38.574319 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-400046d8-d904-4771-ae9e-6a7c1f50de7e tempest-TestMinimumBasicScenario-420461111 tempest-TestMinimumBasicScenario-420461111-project] 10.222.0.64 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1316394532" status: 202 len: 0 microversion: 2.1 time: 0.034651 Oct 27 16:21:38.575238 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 1126/2169] 10.222.0.64 () {58 vars in 1271 bytes} [Wed Oct 27 16:21:38 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1316394532 => generated 0 bytes in 37 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 27 16:21:38.646362 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-11549724-4110-4ef7-a0fc-b27cad39a1c5 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] 10.222.0.64 "POST /compute/v2.1/servers/a76bfa58-eb74-49eb-84c5-52c49e394195/action" status: 200 len: 38214 microversion: 2.1 time: 0.111615 Oct 27 16:21:38.647448 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 1044/2170] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Oct 27 16:21:38 2021] POST /compute/v2.1/servers/a76bfa58-eb74-49eb-84c5-52c49e394195/action => generated 38214 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 27 16:21:39.662231 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-bf23fd44-d2f3-476f-9b83-3aa000f78a18 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 16:21:39.663622 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-bf23fd44-d2f3-476f-9b83-3aa000f78a18 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] [instance: a76bfa58-eb74-49eb-84c5-52c49e394195] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:21:39.673352 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-bf23fd44-d2f3-476f-9b83-3aa000f78a18 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:21:39.673915 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-bf23fd44-d2f3-476f-9b83-3aa000f78a18 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:21:39.674805 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-bf23fd44-d2f3-476f-9b83-3aa000f78a18 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:21:39.675327 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-bf23fd44-d2f3-476f-9b83-3aa000f78a18 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:21:39.748113 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-bf23fd44-d2f3-476f-9b83-3aa000f78a18 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] 10.222.0.64 "POST /compute/v2.1/servers/a76bfa58-eb74-49eb-84c5-52c49e394195/action" status: 200 len: 38214 microversion: 2.1 time: 0.089097 Oct 27 16:21:39.749228 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 1127/2171] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Oct 27 16:21:39 2021] POST /compute/v2.1/servers/a76bfa58-eb74-49eb-84c5-52c49e394195/action => generated 38214 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 27 16:21:40.761468 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-19beee78-b141-49ec-b047-4b96a942b36a tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 16:21:40.763620 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-19beee78-b141-49ec-b047-4b96a942b36a tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] [instance: a76bfa58-eb74-49eb-84c5-52c49e394195] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:21:40.774473 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-19beee78-b141-49ec-b047-4b96a942b36a tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:21:40.775780 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-19beee78-b141-49ec-b047-4b96a942b36a tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:21:40.777374 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-19beee78-b141-49ec-b047-4b96a942b36a tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:21:40.778314 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-19beee78-b141-49ec-b047-4b96a942b36a tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:21:40.880617 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-19beee78-b141-49ec-b047-4b96a942b36a tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] 10.222.0.64 "POST /compute/v2.1/servers/a76bfa58-eb74-49eb-84c5-52c49e394195/action" status: 200 len: 38222 microversion: 2.1 time: 0.122730 Oct 27 16:21:40.885265 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 1045/2172] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Oct 27 16:21:40 2021] POST /compute/v2.1/servers/a76bfa58-eb74-49eb-84c5-52c49e394195/action => generated 38222 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 16:21:41.906021 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-10d17988-3303-4c2a-a81d-b36a7f80c126 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 16:21:41.917992 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-10d17988-3303-4c2a-a81d-b36a7f80c126 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] [instance: a76bfa58-eb74-49eb-84c5-52c49e394195] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:21:41.933824 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-10d17988-3303-4c2a-a81d-b36a7f80c126 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:21:41.936486 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-10d17988-3303-4c2a-a81d-b36a7f80c126 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:21:41.938029 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-10d17988-3303-4c2a-a81d-b36a7f80c126 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:21:41.938924 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-10d17988-3303-4c2a-a81d-b36a7f80c126 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:21:42.052288 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-10d17988-3303-4c2a-a81d-b36a7f80c126 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] 10.222.0.64 "POST /compute/v2.1/servers/a76bfa58-eb74-49eb-84c5-52c49e394195/action" status: 200 len: 38345 microversion: 2.1 time: 0.158710 Oct 27 16:21:42.059060 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 1128/2173] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Oct 27 16:21:41 2021] POST /compute/v2.1/servers/a76bfa58-eb74-49eb-84c5-52c49e394195/action => generated 38345 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 16:21:42.070521 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-42a96bc0-a532-43b5-bbe0-10eb4029fc86 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:21:42.071743 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-42a96bc0-a532-43b5-bbe0-10eb4029fc86 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] [instance: a76bfa58-eb74-49eb-84c5-52c49e394195] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:21:42.080701 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-42a96bc0-a532-43b5-bbe0-10eb4029fc86 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:21:42.081686 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-42a96bc0-a532-43b5-bbe0-10eb4029fc86 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:21:42.083808 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-42a96bc0-a532-43b5-bbe0-10eb4029fc86 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:21:42.084578 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-42a96bc0-a532-43b5-bbe0-10eb4029fc86 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:21:42.118994 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-42a96bc0-a532-43b5-bbe0-10eb4029fc86 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] 10.222.0.64 "GET /compute/v2.1/servers/a76bfa58-eb74-49eb-84c5-52c49e394195/ips" status: 200 len: 145 microversion: 2.1 time: 0.052822 Oct 27 16:21:42.120035 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 1046/2174] 10.222.0.64 () {58 vars in 1247 bytes} [Wed Oct 27 16:21:42 2021] GET /compute/v2.1/servers/a76bfa58-eb74-49eb-84c5-52c49e394195/ips => generated 145 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 16:21:43.672649 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-2fc50f8b-53fc-44ea-9b0a-c4dff7f01664 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "216fe877-5b32-485f-83cd-28ddc3679e91"}} {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 16:21:43.677158 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-2fc50f8b-53fc-44ea-9b0a-c4dff7f01664 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] [instance: a76bfa58-eb74-49eb-84c5-52c49e394195] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:21:43.695284 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-2fc50f8b-53fc-44ea-9b0a-c4dff7f01664 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:21:43.704541 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-2fc50f8b-53fc-44ea-9b0a-c4dff7f01664 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:21:43.705419 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-2fc50f8b-53fc-44ea-9b0a-c4dff7f01664 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:21:43.705860 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-2fc50f8b-53fc-44ea-9b0a-c4dff7f01664 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:21:44.158222 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-2fc50f8b-53fc-44ea-9b0a-c4dff7f01664 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] 10.222.0.64 "POST /compute/v2.1/servers/a76bfa58-eb74-49eb-84c5-52c49e394195/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.495138 Oct 27 16:21:44.159710 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 1129/2175] 10.222.0.64 () {60 vars in 1322 bytes} [Wed Oct 27 16:21:43 2021] POST /compute/v2.1/servers/a76bfa58-eb74-49eb-84c5-52c49e394195/os-volume_attachments => generated 194 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 16:21:50.877435 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-ba997e5e-e802-471b-9f1a-da48d8283a9b tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:21:50.878837 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-ba997e5e-e802-471b-9f1a-da48d8283a9b tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] [instance: a76bfa58-eb74-49eb-84c5-52c49e394195] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:21:50.889281 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-ba997e5e-e802-471b-9f1a-da48d8283a9b tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:21:50.890176 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-ba997e5e-e802-471b-9f1a-da48d8283a9b tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:21:50.891672 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-ba997e5e-e802-471b-9f1a-da48d8283a9b tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:21:50.892574 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-ba997e5e-e802-471b-9f1a-da48d8283a9b tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:21:50.967125 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-ba997e5e-e802-471b-9f1a-da48d8283a9b tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] 10.222.0.64 "GET /compute/v2.1/servers/a76bfa58-eb74-49eb-84c5-52c49e394195/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.094779 Oct 27 16:21:50.968099 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 1047/2176] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Oct 27 16:21:50 2021] GET /compute/v2.1/servers/a76bfa58-eb74-49eb-84c5-52c49e394195/os-volume_attachments => generated 197 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 16:21:50.986929 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-978e5c92-e5ea-4fe5-b5e6-a55d91741cff tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:21:50.987896 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-978e5c92-e5ea-4fe5-b5e6-a55d91741cff tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] [instance: a76bfa58-eb74-49eb-84c5-52c49e394195] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:21:50.999168 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-978e5c92-e5ea-4fe5-b5e6-a55d91741cff tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:21:50.999679 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-978e5c92-e5ea-4fe5-b5e6-a55d91741cff tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:21:51.000719 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-978e5c92-e5ea-4fe5-b5e6-a55d91741cff tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:21:51.001193 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-978e5c92-e5ea-4fe5-b5e6-a55d91741cff tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:21:51.057729 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-978e5c92-e5ea-4fe5-b5e6-a55d91741cff tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] 10.222.0.64 "GET /compute/v2.1/servers/a76bfa58-eb74-49eb-84c5-52c49e394195/os-volume_attachments/216fe877-5b32-485f-83cd-28ddc3679e91" status: 200 len: 194 microversion: 2.1 time: 0.079264 Oct 27 16:21:51.058573 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 1130/2177] 10.222.0.64 () {58 vars in 1412 bytes} [Wed Oct 27 16:21:50 2021] GET /compute/v2.1/servers/a76bfa58-eb74-49eb-84c5-52c49e394195/os-volume_attachments/216fe877-5b32-485f-83cd-28ddc3679e91 => generated 194 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 16:21:52.559380 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-7f0c7c35-b20b-4158-bb5e-c8a9d73ded1a tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e1d14131-4095-4c83-8be9-7696c9a053af"}} {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 16:21:52.561419 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-7f0c7c35-b20b-4158-bb5e-c8a9d73ded1a tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] [instance: a76bfa58-eb74-49eb-84c5-52c49e394195] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:21:52.573436 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-7f0c7c35-b20b-4158-bb5e-c8a9d73ded1a tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:21:52.574276 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-7f0c7c35-b20b-4158-bb5e-c8a9d73ded1a tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:21:52.576293 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-7f0c7c35-b20b-4158-bb5e-c8a9d73ded1a tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:21:52.577148 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-7f0c7c35-b20b-4158-bb5e-c8a9d73ded1a tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:21:52.954117 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-7f0c7c35-b20b-4158-bb5e-c8a9d73ded1a tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] 10.222.0.64 "POST /compute/v2.1/servers/a76bfa58-eb74-49eb-84c5-52c49e394195/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.402170 Oct 27 16:21:52.955019 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 1048/2178] 10.222.0.64 () {60 vars in 1322 bytes} [Wed Oct 27 16:21:52 2021] POST /compute/v2.1/servers/a76bfa58-eb74-49eb-84c5-52c49e394195/os-volume_attachments => generated 194 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 16:21:59.608822 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-9bc1e5f8-ff54-4a50-99b8-961acf2e2fb0 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:21:59.610291 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-9bc1e5f8-ff54-4a50-99b8-961acf2e2fb0 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] [instance: a76bfa58-eb74-49eb-84c5-52c49e394195] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:21:59.620809 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-9bc1e5f8-ff54-4a50-99b8-961acf2e2fb0 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:21:59.622053 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-9bc1e5f8-ff54-4a50-99b8-961acf2e2fb0 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:21:59.623323 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-9bc1e5f8-ff54-4a50-99b8-961acf2e2fb0 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:21:59.624104 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-9bc1e5f8-ff54-4a50-99b8-961acf2e2fb0 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:21:59.678540 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-9bc1e5f8-ff54-4a50-99b8-961acf2e2fb0 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] 10.222.0.64 "GET /compute/v2.1/servers/a76bfa58-eb74-49eb-84c5-52c49e394195/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.077550 Oct 27 16:21:59.679500 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 1131/2179] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Oct 27 16:21:59 2021] GET /compute/v2.1/servers/a76bfa58-eb74-49eb-84c5-52c49e394195/os-volume_attachments => generated 371 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 16:21:59.973489 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-06ad8125-bfa3-40e0-a285-0bb69aab278c tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:21:59.974358 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-06ad8125-bfa3-40e0-a285-0bb69aab278c tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] [instance: a76bfa58-eb74-49eb-84c5-52c49e394195] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:21:59.982271 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-06ad8125-bfa3-40e0-a285-0bb69aab278c tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:21:59.982717 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-06ad8125-bfa3-40e0-a285-0bb69aab278c tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:21:59.983538 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-06ad8125-bfa3-40e0-a285-0bb69aab278c tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:21:59.984006 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-06ad8125-bfa3-40e0-a285-0bb69aab278c tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:22:00.020905 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-06ad8125-bfa3-40e0-a285-0bb69aab278c tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] 10.222.0.64 "GET /compute/v2.1/servers/a76bfa58-eb74-49eb-84c5-52c49e394195/os-volume_attachments/216fe877-5b32-485f-83cd-28ddc3679e91" status: 200 len: 194 microversion: 2.1 time: 0.052454 Oct 27 16:22:00.021711 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 1049/2180] 10.222.0.64 () {58 vars in 1412 bytes} [Wed Oct 27 16:21:59 2021] GET /compute/v2.1/servers/a76bfa58-eb74-49eb-84c5-52c49e394195/os-volume_attachments/216fe877-5b32-485f-83cd-28ddc3679e91 => generated 194 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 16:22:00.032762 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-33e4106a-5592-480c-ac1c-c0a1f354d480 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:22:00.033253 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-33e4106a-5592-480c-ac1c-c0a1f354d480 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] [instance: a76bfa58-eb74-49eb-84c5-52c49e394195] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:22:00.039885 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-33e4106a-5592-480c-ac1c-c0a1f354d480 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:22:00.040334 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-33e4106a-5592-480c-ac1c-c0a1f354d480 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:22:00.041133 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-33e4106a-5592-480c-ac1c-c0a1f354d480 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:22:00.041570 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-33e4106a-5592-480c-ac1c-c0a1f354d480 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:22:00.161185 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.objects.instance [None req-33e4106a-5592-480c-ac1c-c0a1f354d480 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lazy-loading 'services' on Instance uuid a76bfa58-eb74-49eb-84c5-52c49e394195 {{(pid=122224) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 27 16:22:00.265445 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-33e4106a-5592-480c-ac1c-c0a1f354d480 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] 10.222.0.64 "DELETE /compute/v2.1/servers/a76bfa58-eb74-49eb-84c5-52c49e394195/os-volume_attachments/216fe877-5b32-485f-83cd-28ddc3679e91" status: 202 len: 0 microversion: 2.1 time: 0.236906 Oct 27 16:22:00.266092 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 1132/2181] 10.222.0.64 () {58 vars in 1415 bytes} [Wed Oct 27 16:22:00 2021] DELETE /compute/v2.1/servers/a76bfa58-eb74-49eb-84c5-52c49e394195/os-volume_attachments/216fe877-5b32-485f-83cd-28ddc3679e91 => generated 0 bytes in 239 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 27 16:22:01.406922 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-f11ccf5d-2ef7-4d9e-975e-64ec2d7cd0aa tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:22:01.407584 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-f11ccf5d-2ef7-4d9e-975e-64ec2d7cd0aa tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] [instance: a76bfa58-eb74-49eb-84c5-52c49e394195] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:22:01.414358 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-f11ccf5d-2ef7-4d9e-975e-64ec2d7cd0aa tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:22:01.414800 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-f11ccf5d-2ef7-4d9e-975e-64ec2d7cd0aa tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:22:01.415593 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-f11ccf5d-2ef7-4d9e-975e-64ec2d7cd0aa tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:22:01.416363 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-f11ccf5d-2ef7-4d9e-975e-64ec2d7cd0aa tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:22:01.451658 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-f11ccf5d-2ef7-4d9e-975e-64ec2d7cd0aa tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] 10.222.0.64 "GET /compute/v2.1/servers/a76bfa58-eb74-49eb-84c5-52c49e394195/os-volume_attachments/e1d14131-4095-4c83-8be9-7696c9a053af" status: 200 len: 194 microversion: 2.1 time: 0.049324 Oct 27 16:22:01.452251 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 1050/2182] 10.222.0.64 () {58 vars in 1412 bytes} [Wed Oct 27 16:22:01 2021] GET /compute/v2.1/servers/a76bfa58-eb74-49eb-84c5-52c49e394195/os-volume_attachments/e1d14131-4095-4c83-8be9-7696c9a053af => generated 194 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 16:22:01.463273 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-9f8a7e79-af4c-48ad-9990-d2c0717f8c64 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:22:01.464125 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-9f8a7e79-af4c-48ad-9990-d2c0717f8c64 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] [instance: a76bfa58-eb74-49eb-84c5-52c49e394195] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:22:01.472900 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-9f8a7e79-af4c-48ad-9990-d2c0717f8c64 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:22:01.473338 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-9f8a7e79-af4c-48ad-9990-d2c0717f8c64 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:22:01.474167 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-9f8a7e79-af4c-48ad-9990-d2c0717f8c64 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:22:01.474594 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-9f8a7e79-af4c-48ad-9990-d2c0717f8c64 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:22:01.579441 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.objects.instance [None req-9f8a7e79-af4c-48ad-9990-d2c0717f8c64 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lazy-loading 'services' on Instance uuid a76bfa58-eb74-49eb-84c5-52c49e394195 {{(pid=122224) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 27 16:22:01.675388 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-9f8a7e79-af4c-48ad-9990-d2c0717f8c64 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] 10.222.0.64 "DELETE /compute/v2.1/servers/a76bfa58-eb74-49eb-84c5-52c49e394195/os-volume_attachments/e1d14131-4095-4c83-8be9-7696c9a053af" status: 202 len: 0 microversion: 2.1 time: 0.216074 Oct 27 16:22:01.676208 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 1133/2183] 10.222.0.64 () {58 vars in 1415 bytes} [Wed Oct 27 16:22:01 2021] DELETE /compute/v2.1/servers/a76bfa58-eb74-49eb-84c5-52c49e394195/os-volume_attachments/e1d14131-4095-4c83-8be9-7696c9a053af => generated 0 bytes in 218 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 27 16:22:02.904871 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-27b2b52e-b7d7-4e7d-92aa-82fb12645c37 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:22:02.906476 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-27b2b52e-b7d7-4e7d-92aa-82fb12645c37 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] [instance: a76bfa58-eb74-49eb-84c5-52c49e394195] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:22:02.914840 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-27b2b52e-b7d7-4e7d-92aa-82fb12645c37 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:22:02.915559 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-27b2b52e-b7d7-4e7d-92aa-82fb12645c37 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:22:02.916938 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-27b2b52e-b7d7-4e7d-92aa-82fb12645c37 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:22:02.917501 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-27b2b52e-b7d7-4e7d-92aa-82fb12645c37 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:22:02.958082 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-27b2b52e-b7d7-4e7d-92aa-82fb12645c37 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] 10.222.0.64 "GET /compute/v2.1/servers/a76bfa58-eb74-49eb-84c5-52c49e394195/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.058645 Oct 27 16:22:02.958725 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 1051/2184] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Oct 27 16:22:02 2021] GET /compute/v2.1/servers/a76bfa58-eb74-49eb-84c5-52c49e394195/os-volume_attachments => generated 25 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 27 16:22:03.114688 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-a05edbb5-ef70-45e0-8d47-09c6a56d413f tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:22:03.116685 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-a05edbb5-ef70-45e0-8d47-09c6a56d413f tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] [instance: a76bfa58-eb74-49eb-84c5-52c49e394195] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:22:03.130422 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-a05edbb5-ef70-45e0-8d47-09c6a56d413f tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:22:03.131224 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-a05edbb5-ef70-45e0-8d47-09c6a56d413f tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:22:03.132681 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-a05edbb5-ef70-45e0-8d47-09c6a56d413f tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:22:03.133465 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-a05edbb5-ef70-45e0-8d47-09c6a56d413f tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:22:03.193059 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-a05edbb5-ef70-45e0-8d47-09c6a56d413f tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] 10.222.0.64 "GET /compute/v2.1/servers/a76bfa58-eb74-49eb-84c5-52c49e394195/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.086318 Oct 27 16:22:03.194137 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 1134/2185] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Oct 27 16:22:03 2021] GET /compute/v2.1/servers/a76bfa58-eb74-49eb-84c5-52c49e394195/os-volume_attachments => generated 25 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 27 16:22:03.261080 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-0316079d-c8ed-4d06-a874-0b137b1ef469 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:22:03.261975 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-0316079d-c8ed-4d06-a874-0b137b1ef469 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] [instance: a76bfa58-eb74-49eb-84c5-52c49e394195] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:22:03.272432 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-0316079d-c8ed-4d06-a874-0b137b1ef469 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:22:03.273219 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-0316079d-c8ed-4d06-a874-0b137b1ef469 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:22:03.274635 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-0316079d-c8ed-4d06-a874-0b137b1ef469 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:22:03.275404 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-0316079d-c8ed-4d06-a874-0b137b1ef469 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:22:03.325854 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-0316079d-c8ed-4d06-a874-0b137b1ef469 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] [instance: a76bfa58-eb74-49eb-84c5-52c49e394195] Going to try to terminate instance {{(pid=122225) delete /opt/stack/nova/nova/compute/api.py:2612}} Oct 27 16:22:03.458872 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-0316079d-c8ed-4d06-a874-0b137b1ef469 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] 10.222.0.64 "DELETE /compute/v2.1/servers/a76bfa58-eb74-49eb-84c5-52c49e394195" status: 204 len: 0 microversion: 2.1 time: 0.203746 Oct 27 16:22:03.459960 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 1052/2186] 10.222.0.64 () {58 vars in 1238 bytes} [Wed Oct 27 16:22:03 2021] DELETE /compute/v2.1/servers/a76bfa58-eb74-49eb-84c5-52c49e394195 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 16:22:03.468978 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-d6192968-4e6f-4f17-acf1-1c77d8eb89a3 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:22:03.469866 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-d6192968-4e6f-4f17-acf1-1c77d8eb89a3 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] [instance: a76bfa58-eb74-49eb-84c5-52c49e394195] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:22:03.477255 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-d6192968-4e6f-4f17-acf1-1c77d8eb89a3 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:22:03.477771 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-d6192968-4e6f-4f17-acf1-1c77d8eb89a3 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:22:03.478698 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-d6192968-4e6f-4f17-acf1-1c77d8eb89a3 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:22:03.479190 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-d6192968-4e6f-4f17-acf1-1c77d8eb89a3 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:22:03.677420 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-d6192968-4e6f-4f17-acf1-1c77d8eb89a3 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd24c0e6b236d435bacfb99467b03254d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac26dbbef464ff198b60547a106ce2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 16:22:03.687933 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-d6192968-4e6f-4f17-acf1-1c77d8eb89a3 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] 10.222.0.64 "GET /compute/v2.1/servers/a76bfa58-eb74-49eb-84c5-52c49e394195" status: 200 len: 1674 microversion: 2.1 time: 0.222899 Oct 27 16:22:03.688692 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 1135/2187] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 16:22:03 2021] GET /compute/v2.1/servers/a76bfa58-eb74-49eb-84c5-52c49e394195 => generated 1674 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 16:22:04.715208 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-32937ff1-c7ac-4e00-be06-b56515d009c5 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:22:04.716609 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-32937ff1-c7ac-4e00-be06-b56515d009c5 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] [instance: a76bfa58-eb74-49eb-84c5-52c49e394195] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:22:04.728630 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-32937ff1-c7ac-4e00-be06-b56515d009c5 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:22:04.729360 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-32937ff1-c7ac-4e00-be06-b56515d009c5 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:22:04.730805 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-32937ff1-c7ac-4e00-be06-b56515d009c5 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:22:04.731803 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-32937ff1-c7ac-4e00-be06-b56515d009c5 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:22:04.932219 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.policy [None req-32937ff1-c7ac-4e00-be06-b56515d009c5 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd24c0e6b236d435bacfb99467b03254d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac26dbbef464ff198b60547a106ce2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122225) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 16:22:04.947492 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-32937ff1-c7ac-4e00-be06-b56515d009c5 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] 10.222.0.64 "GET /compute/v2.1/servers/a76bfa58-eb74-49eb-84c5-52c49e394195" status: 200 len: 1674 microversion: 2.1 time: 0.239974 Oct 27 16:22:04.948522 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 1053/2188] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 16:22:04 2021] GET /compute/v2.1/servers/a76bfa58-eb74-49eb-84c5-52c49e394195 => generated 1674 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 16:22:05.968942 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-c7580e3e-724b-4fc7-8184-b492ef9242ad tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:22:05.969848 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-c7580e3e-724b-4fc7-8184-b492ef9242ad tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] [instance: a76bfa58-eb74-49eb-84c5-52c49e394195] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:22:05.979421 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-c7580e3e-724b-4fc7-8184-b492ef9242ad tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:22:05.980763 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-c7580e3e-724b-4fc7-8184-b492ef9242ad tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:22:05.982261 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-c7580e3e-724b-4fc7-8184-b492ef9242ad tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:22:05.983054 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-c7580e3e-724b-4fc7-8184-b492ef9242ad tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:22:06.156330 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-c7580e3e-724b-4fc7-8184-b492ef9242ad tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd24c0e6b236d435bacfb99467b03254d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac26dbbef464ff198b60547a106ce2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 16:22:06.165655 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-c7580e3e-724b-4fc7-8184-b492ef9242ad tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] 10.222.0.64 "GET /compute/v2.1/servers/a76bfa58-eb74-49eb-84c5-52c49e394195" status: 200 len: 1674 microversion: 2.1 time: 0.200993 Oct 27 16:22:06.166476 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 1136/2189] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 16:22:05 2021] GET /compute/v2.1/servers/a76bfa58-eb74-49eb-84c5-52c49e394195 => generated 1674 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 16:22:06.751139 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [req-82a42485-3e1a-438f-9487-554a362ca2b4 req-aadf46ef-9b73-486e-9858-2f22fb016f6f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a76bfa58-eb74-49eb-84c5-52c49e394195", "name": "network-vif-deleted", "tag": "87df4a9d-9913-463b-9005-dddacaa1d71a"}]} {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 16:22:06.754329 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 27 16:22:06.754329 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: warnings.warn(msg) Oct 27 16:22:06.774227 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [req-82a42485-3e1a-438f-9487-554a362ca2b4 req-aadf46ef-9b73-486e-9858-2f22fb016f6f service nova] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:22:06.775026 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [req-82a42485-3e1a-438f-9487-554a362ca2b4 req-aadf46ef-9b73-486e-9858-2f22fb016f6f service nova] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:22:06.798117 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.compute.server_external_events [req-82a42485-3e1a-438f-9487-554a362ca2b4 req-aadf46ef-9b73-486e-9858-2f22fb016f6f service nova] Creating event network-vif-deleted:87df4a9d-9913-463b-9005-dddacaa1d71a for instance a76bfa58-eb74-49eb-84c5-52c49e394195 on hv-cinder-80070 Oct 27 16:22:06.807661 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [req-82a42485-3e1a-438f-9487-554a362ca2b4 req-aadf46ef-9b73-486e-9858-2f22fb016f6f service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068043 Oct 27 16:22:06.813488 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 1054/2190] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Oct 27 16:22:06 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 16:22:07.190122 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-42e58478-9edb-4b65-a90b-75b609c85b09 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:22:07.192420 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-42e58478-9edb-4b65-a90b-75b609c85b09 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] [instance: a76bfa58-eb74-49eb-84c5-52c49e394195] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:22:07.205848 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-42e58478-9edb-4b65-a90b-75b609c85b09 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:22:07.207174 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-42e58478-9edb-4b65-a90b-75b609c85b09 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:22:07.209291 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-42e58478-9edb-4b65-a90b-75b609c85b09 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:22:07.210316 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-42e58478-9edb-4b65-a90b-75b609c85b09 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:22:07.278985 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-42e58478-9edb-4b65-a90b-75b609c85b09 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:22:07.279509 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-42e58478-9edb-4b65-a90b-75b609c85b09 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:22:07.280103 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.objects.instance [None req-42e58478-9edb-4b65-a90b-75b609c85b09 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lazy-loading 'fault' on Instance uuid a76bfa58-eb74-49eb-84c5-52c49e394195 {{(pid=122224) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 27 16:22:07.335459 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.policy [None req-42e58478-9edb-4b65-a90b-75b609c85b09 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd24c0e6b236d435bacfb99467b03254d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac26dbbef464ff198b60547a106ce2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122224) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 16:22:07.346408 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-42e58478-9edb-4b65-a90b-75b609c85b09 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] 10.222.0.64 "GET /compute/v2.1/servers/a76bfa58-eb74-49eb-84c5-52c49e394195" status: 200 len: 1328 microversion: 2.1 time: 0.165085 Oct 27 16:22:07.359047 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 1137/2191] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 16:22:07 2021] GET /compute/v2.1/servers/a76bfa58-eb74-49eb-84c5-52c49e394195 => generated 1328 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 16:22:08.374273 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-2d3a9b1c-3eab-4be0-beb8-cdc935b8ccef tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:22:08.375886 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-2d3a9b1c-3eab-4be0-beb8-cdc935b8ccef tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] [instance: a76bfa58-eb74-49eb-84c5-52c49e394195] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:22:08.385189 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-2d3a9b1c-3eab-4be0-beb8-cdc935b8ccef tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:22:08.385812 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-2d3a9b1c-3eab-4be0-beb8-cdc935b8ccef tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:22:08.387388 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-2d3a9b1c-3eab-4be0-beb8-cdc935b8ccef tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:22:08.388125 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-2d3a9b1c-3eab-4be0-beb8-cdc935b8ccef tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:22:08.405100 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.wsgi [None req-2d3a9b1c-3eab-4be0-beb8-cdc935b8ccef tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] HTTP exception thrown: Instance a76bfa58-eb74-49eb-84c5-52c49e394195 could not be found. Oct 27 16:22:08.405712 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-2d3a9b1c-3eab-4be0-beb8-cdc935b8ccef tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Returning 404 to user: Instance a76bfa58-eb74-49eb-84c5-52c49e394195 could not be found. {{(pid=122225) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 27 16:22:08.406580 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-2d3a9b1c-3eab-4be0-beb8-cdc935b8ccef tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] 10.222.0.64 "GET /compute/v2.1/servers/a76bfa58-eb74-49eb-84c5-52c49e394195" status: 404 len: 111 microversion: 2.1 time: 0.043120 Oct 27 16:22:08.407160 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 1055/2192] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 16:22:08 2021] GET /compute/v2.1/servers/a76bfa58-eb74-49eb-84c5-52c49e394195 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 16:22:08.416072 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-f4e07e6d-3edd-48a5-9dca-41e023a85a2c tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Calling method '.version_select at 0x7fbc05c71310>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:22:08.437873 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-f4e07e6d-3edd-48a5-9dca-41e023a85a2c tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] 10.222.0.64 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1779637703" status: 202 len: 0 microversion: 2.1 time: 0.025480 Oct 27 16:22:08.438507 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 1138/2193] 10.222.0.64 () {58 vars in 1220 bytes} [Wed Oct 27 16:22:08 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1779637703 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 16:22:11.823497 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-5c377d59-2b43-49a1-bdf6-602fb9569d84 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:22:11.824944 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-5c377d59-2b43-49a1-bdf6-602fb9569d84 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] [instance: a76bfa58-eb74-49eb-84c5-52c49e394195] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:22:11.832378 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-5c377d59-2b43-49a1-bdf6-602fb9569d84 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:22:11.832815 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-5c377d59-2b43-49a1-bdf6-602fb9569d84 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:22:11.833611 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-5c377d59-2b43-49a1-bdf6-602fb9569d84 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:22:11.834047 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-5c377d59-2b43-49a1-bdf6-602fb9569d84 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:22:11.859417 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.wsgi [None req-5c377d59-2b43-49a1-bdf6-602fb9569d84 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] HTTP exception thrown: Instance a76bfa58-eb74-49eb-84c5-52c49e394195 could not be found. Oct 27 16:22:11.860548 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-5c377d59-2b43-49a1-bdf6-602fb9569d84 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Returning 404 to user: Instance a76bfa58-eb74-49eb-84c5-52c49e394195 could not be found. {{(pid=122225) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 27 16:22:11.862114 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-5c377d59-2b43-49a1-bdf6-602fb9569d84 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] 10.222.0.64 "DELETE /compute/v2.1/servers/a76bfa58-eb74-49eb-84c5-52c49e394195" status: 404 len: 111 microversion: 2.1 time: 0.042472 Oct 27 16:22:11.863170 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 1056/2194] 10.222.0.64 () {58 vars in 1238 bytes} [Wed Oct 27 16:22:11 2021] DELETE /compute/v2.1/servers/a76bfa58-eb74-49eb-84c5-52c49e394195 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 16:22:11.873923 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-4dd864e3-5c3a-420f-8c7f-380d659c0266 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:22:11.874711 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-4dd864e3-5c3a-420f-8c7f-380d659c0266 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] [instance: a76bfa58-eb74-49eb-84c5-52c49e394195] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:22:11.881866 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-4dd864e3-5c3a-420f-8c7f-380d659c0266 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:22:11.882365 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-4dd864e3-5c3a-420f-8c7f-380d659c0266 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:22:11.883212 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-4dd864e3-5c3a-420f-8c7f-380d659c0266 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:22:11.883761 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-4dd864e3-5c3a-420f-8c7f-380d659c0266 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:22:11.908942 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.wsgi [None req-4dd864e3-5c3a-420f-8c7f-380d659c0266 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] HTTP exception thrown: Instance a76bfa58-eb74-49eb-84c5-52c49e394195 could not be found. Oct 27 16:22:11.910072 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-4dd864e3-5c3a-420f-8c7f-380d659c0266 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Returning 404 to user: Instance a76bfa58-eb74-49eb-84c5-52c49e394195 could not be found. {{(pid=122224) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 27 16:22:11.911692 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-4dd864e3-5c3a-420f-8c7f-380d659c0266 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] 10.222.0.64 "GET /compute/v2.1/servers/a76bfa58-eb74-49eb-84c5-52c49e394195" status: 404 len: 111 microversion: 2.1 time: 0.042959 Oct 27 16:22:11.913369 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 1139/2195] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 16:22:11 2021] GET /compute/v2.1/servers/a76bfa58-eb74-49eb-84c5-52c49e394195 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 27 16:22:13.114013 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-cc8cea57-7af4-4c5d-b251-1797ace91c14 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Calling method '>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:22:13.114652 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.compute.api [None req-cc8cea57-7af4-4c5d-b251-1797ace91c14 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] [instance: 70be9dd7-1f43-4843-be62-288d53f57c81] Fetching instance by UUID {{(pid=122225) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:22:13.121936 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-cc8cea57-7af4-4c5d-b251-1797ace91c14 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:22:13.122591 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-cc8cea57-7af4-4c5d-b251-1797ace91c14 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:22:13.123453 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-cc8cea57-7af4-4c5d-b251-1797ace91c14 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:22:13.123975 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG oslo_concurrency.lockutils [None req-cc8cea57-7af4-4c5d-b251-1797ace91c14 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:22:13.140003 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.wsgi [None req-cc8cea57-7af4-4c5d-b251-1797ace91c14 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] HTTP exception thrown: Instance 70be9dd7-1f43-4843-be62-288d53f57c81 could not be found. Oct 27 16:22:13.140692 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-cc8cea57-7af4-4c5d-b251-1797ace91c14 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Returning 404 to user: Instance 70be9dd7-1f43-4843-be62-288d53f57c81 could not be found. {{(pid=122225) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 27 16:22:13.141543 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-cc8cea57-7af4-4c5d-b251-1797ace91c14 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] 10.222.0.64 "DELETE /compute/v2.1/servers/70be9dd7-1f43-4843-be62-288d53f57c81" status: 404 len: 111 microversion: 2.1 time: 0.031469 Oct 27 16:22:13.142125 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 1057/2196] 10.222.0.64 () {58 vars in 1238 bytes} [Wed Oct 27 16:22:13 2021] DELETE /compute/v2.1/servers/70be9dd7-1f43-4843-be62-288d53f57c81 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 27 16:22:13.155760 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-463b6ba0-d2d5-407c-8630-66081e496a67 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Calling method '>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:22:13.157001 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.compute.api [None req-463b6ba0-d2d5-407c-8630-66081e496a67 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] [instance: 70be9dd7-1f43-4843-be62-288d53f57c81] Fetching instance by UUID {{(pid=122224) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 16:22:13.167514 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-463b6ba0-d2d5-407c-8630-66081e496a67 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:22:13.168844 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-463b6ba0-d2d5-407c-8630-66081e496a67 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:22:13.170233 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-463b6ba0-d2d5-407c-8630-66081e496a67 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 16:22:13.171014 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG oslo_concurrency.lockutils [None req-463b6ba0-d2d5-407c-8630-66081e496a67 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Lock "c943b248-24a3-4c90-8911-04b0b8d5cf35" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 16:22:13.197739 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.wsgi [None req-463b6ba0-d2d5-407c-8630-66081e496a67 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] HTTP exception thrown: Instance 70be9dd7-1f43-4843-be62-288d53f57c81 could not be found. Oct 27 16:22:13.198767 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-463b6ba0-d2d5-407c-8630-66081e496a67 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] Returning 404 to user: Instance 70be9dd7-1f43-4843-be62-288d53f57c81 could not be found. {{(pid=122224) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 27 16:22:13.200356 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-463b6ba0-d2d5-407c-8630-66081e496a67 tempest-AttachVolumeTestJSON-1984300637 tempest-AttachVolumeTestJSON-1984300637-project] 10.222.0.64 "GET /compute/v2.1/servers/70be9dd7-1f43-4843-be62-288d53f57c81" status: 404 len: 111 microversion: 2.1 time: 0.052915 Oct 27 16:22:13.201368 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 1140/2197] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Oct 27 16:22:13 2021] GET /compute/v2.1/servers/70be9dd7-1f43-4843-be62-288d53f57c81 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 16:22:19.657215 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-bd37378e-a1f3-4a29-aec3-0df220568ede tempest-VolumesNegativeTest-1322311835 tempest-VolumesNegativeTest-1322311835-project] Action: 'create', calling method: .version_select at 0x7fbc0ac6eca0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1650566589", "metadata": {"Type": "work"}}} {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 16:22:19.658939 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-bd37378e-a1f3-4a29-aec3-0df220568ede tempest-VolumesNegativeTest-1322311835 tempest-VolumesNegativeTest-1322311835-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=122225) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 27 16:22:19.660078 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-bd37378e-a1f3-4a29-aec3-0df220568ede tempest-VolumesNegativeTest-1322311835 tempest-VolumesNegativeTest-1322311835-project] 10.222.0.64 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.158357 Oct 27 16:22:19.660826 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 1058/2198] 10.222.0.64 () {60 vars in 1155 bytes} [Wed Oct 27 16:22:19 2021] POST /compute/v2.1/os-volumes => generated 127 bytes in 160 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 27 16:22:19.674638 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-e783d768-f9da-4de3-8092-d1a4d36db1c9 tempest-VolumesNegativeTest-1322311835 tempest-VolumesNegativeTest-1322311835-project] Action: 'create', calling method: .version_select at 0x7fbc05c92a60>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1185460503", "metadata": {"Type": "work"}}} {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 16:22:19.677629 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-e783d768-f9da-4de3-8092-d1a4d36db1c9 tempest-VolumesNegativeTest-1322311835 tempest-VolumesNegativeTest-1322311835-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=122224) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 27 16:22:19.679447 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-e783d768-f9da-4de3-8092-d1a4d36db1c9 tempest-VolumesNegativeTest-1322311835 tempest-VolumesNegativeTest-1322311835-project] 10.222.0.64 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.011752 Oct 27 16:22:19.680486 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 1141/2199] 10.222.0.64 () {60 vars in 1155 bytes} [Wed Oct 27 16:22:19 2021] POST /compute/v2.1/os-volumes => generated 125 bytes in 14 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 27 16:22:19.691058 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-d84f89e9-56e3-4328-99eb-c1ae8e8a9647 tempest-VolumesNegativeTest-1322311835 tempest-VolumesNegativeTest-1322311835-project] Action: 'create', calling method: .version_select at 0x7fbc0ac3ef70>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1547694362", "metadata": {"Type": "work"}}} {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 16:22:19.692279 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-d84f89e9-56e3-4328-99eb-c1ae8e8a9647 tempest-VolumesNegativeTest-1322311835 tempest-VolumesNegativeTest-1322311835-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=122225) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 27 16:22:19.693123 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-d84f89e9-56e3-4328-99eb-c1ae8e8a9647 tempest-VolumesNegativeTest-1322311835 tempest-VolumesNegativeTest-1322311835-project] 10.222.0.64 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.005818 Oct 27 16:22:19.693670 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 1059/2200] 10.222.0.64 () {60 vars in 1155 bytes} [Wed Oct 27 16:22:19 2021] POST /compute/v2.1/os-volumes => generated 121 bytes in 7 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 27 16:22:19.704817 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-1074b8be-2d61-4fd3-a308-fbeab232253f tempest-VolumesNegativeTest-1322311835 tempest-VolumesNegativeTest-1322311835-project] Calling method '.version_select at 0x7fbc05d3f4c0>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:22:19.856472 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.wsgi [None req-1074b8be-2d61-4fd3-a308-fbeab232253f tempest-VolumesNegativeTest-1322311835 tempest-VolumesNegativeTest-1322311835-project] HTTP exception thrown: Volume tempest-invalid-812376738 could not be found. Oct 27 16:22:19.857212 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-1074b8be-2d61-4fd3-a308-fbeab232253f tempest-VolumesNegativeTest-1322311835 tempest-VolumesNegativeTest-1322311835-project] Returning 404 to user: Volume tempest-invalid-812376738 could not be found. {{(pid=122224) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 27 16:22:19.858155 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-1074b8be-2d61-4fd3-a308-fbeab232253f tempest-VolumesNegativeTest-1322311835 tempest-VolumesNegativeTest-1322311835-project] 10.222.0.64 "DELETE /compute/v2.1/os-volumes/tempest-invalid-812376738" status: 404 len: 98 microversion: 2.1 time: 0.157685 Oct 27 16:22:19.858811 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 1142/2201] 10.222.0.64 () {58 vars in 1214 bytes} [Wed Oct 27 16:22:19 2021] DELETE /compute/v2.1/os-volumes/tempest-invalid-812376738 => generated 98 bytes in 160 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 27 16:22:19.869114 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-21d7e5fd-f985-4421-81c1-6424dccf7cbe tempest-VolumesNegativeTest-1322311835 tempest-VolumesNegativeTest-1322311835-project] 10.222.0.64 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003666 Oct 27 16:22:19.869650 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 1060/2202] 10.222.0.64 () {58 vars in 1139 bytes} [Wed Oct 27 16:22:19 2021] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Oct 27 16:22:19.880075 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-7f517db2-bd2c-4da6-a620-71a82c509f4c tempest-VolumesNegativeTest-1322311835 tempest-VolumesNegativeTest-1322311835-project] 10.222.0.64 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003828 Oct 27 16:22:19.880610 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 1143/2203] 10.222.0.64 () {58 vars in 1136 bytes} [Wed Oct 27 16:22:19 2021] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Oct 27 16:22:19.892910 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-8908b934-0539-4354-b0af-a02dd3dbab18 tempest-VolumesNegativeTest-1322311835 tempest-VolumesNegativeTest-1322311835-project] Calling method '.version_select at 0x7fbc0ab990d0>' {{(pid=122225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:22:19.999315 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.wsgi [None req-8908b934-0539-4354-b0af-a02dd3dbab18 tempest-VolumesNegativeTest-1322311835 tempest-VolumesNegativeTest-1322311835-project] HTTP exception thrown: Volume 4a98b7c7-d877-4527-9ebe-37bb3c05cf66 could not be found. Oct 27 16:22:19.999944 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: DEBUG nova.api.openstack.wsgi [None req-8908b934-0539-4354-b0af-a02dd3dbab18 tempest-VolumesNegativeTest-1322311835 tempest-VolumesNegativeTest-1322311835-project] Returning 404 to user: Volume 4a98b7c7-d877-4527-9ebe-37bb3c05cf66 could not be found. {{(pid=122225) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 27 16:22:20.000772 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO nova.api.openstack.requestlog [None req-8908b934-0539-4354-b0af-a02dd3dbab18 tempest-VolumesNegativeTest-1322311835 tempest-VolumesNegativeTest-1322311835-project] 10.222.0.64 "DELETE /compute/v2.1/os-volumes/4a98b7c7-d877-4527-9ebe-37bb3c05cf66" status: 404 len: 109 microversion: 2.1 time: 0.112195 Oct 27 16:22:20.001462 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: [pid: 122225|app: 0|req: 1061/2204] 10.222.0.64 () {58 vars in 1247 bytes} [Wed Oct 27 16:22:19 2021] DELETE /compute/v2.1/os-volumes/4a98b7c7-d877-4527-9ebe-37bb3c05cf66 => generated 109 bytes in 115 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 16:22:20.010841 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-2a7a3ada-e427-4988-882d-edfe6dc022d4 tempest-VolumesNegativeTest-1322311835 tempest-VolumesNegativeTest-1322311835-project] Calling method '.version_select at 0x7fbc05c713a0>' {{(pid=122224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 16:22:20.050976 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.wsgi [None req-2a7a3ada-e427-4988-882d-edfe6dc022d4 tempest-VolumesNegativeTest-1322311835 tempest-VolumesNegativeTest-1322311835-project] HTTP exception thrown: Volume 8e1d9c2d-5c7b-44f3-896b-2a32b5aec230 could not be found. Oct 27 16:22:20.051692 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: DEBUG nova.api.openstack.wsgi [None req-2a7a3ada-e427-4988-882d-edfe6dc022d4 tempest-VolumesNegativeTest-1322311835 tempest-VolumesNegativeTest-1322311835-project] Returning 404 to user: Volume 8e1d9c2d-5c7b-44f3-896b-2a32b5aec230 could not be found. {{(pid=122224) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 27 16:22:20.052672 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO nova.api.openstack.requestlog [None req-2a7a3ada-e427-4988-882d-edfe6dc022d4 tempest-VolumesNegativeTest-1322311835 tempest-VolumesNegativeTest-1322311835-project] 10.222.0.64 "GET /compute/v2.1/os-volumes/8e1d9c2d-5c7b-44f3-896b-2a32b5aec230" status: 404 len: 109 microversion: 2.1 time: 0.045743 Oct 27 16:22:20.053360 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: [pid: 122224|app: 0|req: 1144/2205] 10.222.0.64 () {58 vars in 1244 bytes} [Wed Oct 27 16:22:20 2021] GET /compute/v2.1/os-volumes/8e1d9c2d-5c7b-44f3-896b-2a32b5aec230 => generated 109 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 27 16:22:37.246278 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 27 16:22:37.247333 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: Wed Oct 27 16:22:37 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Oct 27 16:22:41.593499 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 27 16:22:41.594286 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: Wed Oct 27 16:22:41 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Oct 27 16:24:39.095733 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 27 16:24:39.096764 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: Wed Oct 27 16:24:39 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Oct 27 16:24:41.529873 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 27 16:24:41.530605 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: Wed Oct 27 16:24:41 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Oct 27 16:25:57.278417 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 27 16:25:57.279483 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: Wed Oct 27 16:25:57 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Oct 27 16:25:57.317330 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 27 16:25:57.318171 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: Wed Oct 27 16:25:57 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Oct 27 16:26:01.624746 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 27 16:26:01.625820 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: Wed Oct 27 16:26:01 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Oct 27 16:27:45.685242 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 27 16:27:45.686213 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: Wed Oct 27 16:27:45 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Oct 27 16:27:59.119698 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 27 16:27:59.120583 dv-cinder-800703-2-iscsi devstack@n-api.service[122225]: Wed Oct 27 16:27:59 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Oct 27 16:28:01.558937 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 27 16:28:01.559820 dv-cinder-800703-2-iscsi devstack@n-api.service[122224]: Wed Oct 27 16:28:01 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!